[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:05:26.576294 21312 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.208.62:43357
I20260709 13:05:26.577968 21312 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:05:26.579083 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:26.595857 21318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.595865 21319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.595897 21321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:26.597064 21312 server_base.cc:1061] running on GCE node
I20260709 13:05:27.707698 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:27.707971 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:27.708132 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602327708117 us; error 0 us; skew 500 ppm
I20260709 13:05:27.708971 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:27.714426 21312 webserver.cc:533] Webserver started at http://127.20.208.62:35029/ using document root <none> and password file <none>
I20260709 13:05:27.715302 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:27.715502 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:27.715935 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:27.722309 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/master-0-root/instance:
uuid: "d8e3c10c03494309a51c139803519c6c"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-6j4g"
I20260709 13:05:27.733682 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:05:27.741763 21327 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.743448 21312 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:27.743870 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/master-0-root
uuid: "d8e3c10c03494309a51c139803519c6c"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-6j4g"
I20260709 13:05:27.744222 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:27.794265 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:27.795848 21312 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:05:27.796303 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:27.866736 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.62:43357
I20260709 13:05:27.866811 21378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.62:43357 every 8 connection(s)
I20260709 13:05:27.874722 21379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.897431 21379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c: Bootstrap starting.
I20260709 13:05:27.903468 21379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.905422 21379 log.cc:826] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c: Log is configured to *not* fsync() on all Append() calls
I20260709 13:05:27.910125 21379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c: No bootstrap required, opened a new log
I20260709 13:05:27.930701 21379 raft_consensus.cc:359] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8e3c10c03494309a51c139803519c6c" member_type: VOTER }
I20260709 13:05:27.931268 21379 raft_consensus.cc:385] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.931529 21379 raft_consensus.cc:740] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8e3c10c03494309a51c139803519c6c, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.932446 21379 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8e3c10c03494309a51c139803519c6c" member_type: VOTER }
I20260709 13:05:27.932986 21379 raft_consensus.cc:399] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:27.933283 21379 raft_consensus.cc:493] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:27.933620 21379 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.937831 21379 raft_consensus.cc:515] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8e3c10c03494309a51c139803519c6c" member_type: VOTER }
I20260709 13:05:27.938628 21379 leader_election.cc:304] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8e3c10c03494309a51c139803519c6c; no voters: 
I20260709 13:05:27.940384 21379 leader_election.cc:290] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:27.940755 21382 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.943229 21382 raft_consensus.cc:697] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 1 LEADER]: Becoming Leader. State: Replica: d8e3c10c03494309a51c139803519c6c, State: Running, Role: LEADER
I20260709 13:05:27.944267 21382 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8e3c10c03494309a51c139803519c6c" member_type: VOTER }
I20260709 13:05:27.945267 21379 sys_catalog.cc:565] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:27.954356 21383 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8e3c10c03494309a51c139803519c6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8e3c10c03494309a51c139803519c6c" member_type: VOTER } }
I20260709 13:05:27.954842 21384 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8e3c10c03494309a51c139803519c6c. Latest consensus state: current_term: 1 leader_uuid: "d8e3c10c03494309a51c139803519c6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8e3c10c03494309a51c139803519c6c" member_type: VOTER } }
I20260709 13:05:27.955188 21383 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:27.955564 21384 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:27.958321 21390 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:27.970728 21390 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:27.973022 21312 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:27.988237 21390 catalog_manager.cc:1383] Generated new cluster ID: 3d7181e2f0c24f25bd54395dfd893f19
I20260709 13:05:27.988569 21390 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:28.007841 21390 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:28.009464 21390 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:28.030314 21390 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c: Generated new TSK 0
I20260709 13:05:28.031273 21390 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:28.040064 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.050076 21402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.048600 21401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.053755 21404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.054656 21312 server_base.cc:1061] running on GCE node
I20260709 13:05:28.055510 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.055766 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.055953 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602328055933 us; error 0 us; skew 500 ppm
I20260709 13:05:28.056607 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.060837 21312 webserver.cc:533] Webserver started at http://127.20.208.1:46477/ using document root <none> and password file <none>
I20260709 13:05:28.061414 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.061617 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.061908 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.063011 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-0-root/instance:
uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-6j4g"
I20260709 13:05:28.068921 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 13:05:28.073488 21409 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.074390 21312 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.003s
I20260709 13:05:28.074817 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-0-root
uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-6j4g"
I20260709 13:05:28.075268 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.111687 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.113616 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.116851 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.122661 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.123034 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.123370 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.123594 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.214574 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.1:38033
I20260709 13:05:28.214638 21471 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.1:38033 every 8 connection(s)
I20260709 13:05:28.222781 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.231922 21476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.237666 21477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.241871 21479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.242656 21312 server_base.cc:1061] running on GCE node
I20260709 13:05:28.243558 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.243779 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.243981 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602328243962 us; error 0 us; skew 500 ppm
I20260709 13:05:28.244802 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.248245 21312 webserver.cc:533] Webserver started at http://127.20.208.2:36077/ using document root <none> and password file <none>
I20260709 13:05:28.248631 21472 heartbeater.cc:344] Connected to a master server at 127.20.208.62:43357
I20260709 13:05:28.248806 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.249063 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.249161 21472 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.249333 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.250365 21472 heartbeater.cc:507] Master 127.20.208.62:43357 requested a full tablet report, sending...
I20260709 13:05:28.250484 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-1-root/instance:
uuid: "e2b0b8b156304ad890700786de9427e8"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-6j4g"
I20260709 13:05:28.254175 21344 ts_manager.cc:194] Registered new tserver with Master: 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033)
I20260709 13:05:28.256711 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
I20260709 13:05:28.257400 21344 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43766
I20260709 13:05:28.261626 21484 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.262482 21312 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:05:28.262774 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-1-root
uuid: "e2b0b8b156304ad890700786de9427e8"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-6j4g"
I20260709 13:05:28.263034 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.305060 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.306303 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.308710 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.311967 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.312161 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.312413 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.312601 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:28.409170 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.2:40151
I20260709 13:05:28.409256 21546 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.2:40151 every 8 connection(s)
I20260709 13:05:28.414951 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.423265 21550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.428980 21551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.431602 21547 heartbeater.cc:344] Connected to a master server at 127.20.208.62:43357
I20260709 13:05:28.431939 21547 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.433072 21312 server_base.cc:1061] running on GCE node
I20260709 13:05:28.433015 21547 heartbeater.cc:507] Master 127.20.208.62:43357 requested a full tablet report, sending...
W20260709 13:05:28.433020 21553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.434688 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.434963 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.435169 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602328435151 us; error 0 us; skew 500 ppm
I20260709 13:05:28.435371 21344 ts_manager.cc:194] Registered new tserver with Master: e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:28.435926 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.436894 21344 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43774
I20260709 13:05:28.438894 21312 webserver.cc:533] Webserver started at http://127.20.208.3:41437/ using document root <none> and password file <none>
I20260709 13:05:28.439558 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.439805 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.440119 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.441640 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-2-root/instance:
uuid: "553c493339cb4e2e88cc5539035f06ea"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-6j4g"
I20260709 13:05:28.447661 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:05:28.452224 21558 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.453080 21312 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:28.453375 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-2-root
uuid: "553c493339cb4e2e88cc5539035f06ea"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-6j4g"
I20260709 13:05:28.453655 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326409895-21312-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.495415 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.496740 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.498838 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.502004 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.502247 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.502503 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.502693 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.593717 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.3:35191
I20260709 13:05:28.593812 21620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.3:35191 every 8 connection(s)
I20260709 13:05:28.610458 21621 heartbeater.cc:344] Connected to a master server at 127.20.208.62:43357
I20260709 13:05:28.610810 21621 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.611599 21621 heartbeater.cc:507] Master 127.20.208.62:43357 requested a full tablet report, sending...
I20260709 13:05:28.613835 21344 ts_manager.cc:194] Registered new tserver with Master: 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:28.614578 21312 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015738497s
I20260709 13:05:28.615689 21344 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43782
I20260709 13:05:28.678625 21344 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43796:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:28.683729 21344 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:28.775729 21586 tablet_service.cc:1511] Processing CreateTablet for tablet d46799ac44b3492c8b5d3928270ca263 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:28.777516 21586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46799ac44b3492c8b5d3928270ca263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.779563 21585 tablet_service.cc:1511] Processing CreateTablet for tablet 7ada68483f624db98f8c9b99332a39ec (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:28.787588 21585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ada68483f624db98f8c9b99332a39ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.785051 21583 tablet_service.cc:1511] Processing CreateTablet for tablet ff1cd2210abe461397347df2c882d656 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:28.790212 21582 tablet_service.cc:1511] Processing CreateTablet for tablet dabe3609ae1641e8b814b1d861589931 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:28.787256 21584 tablet_service.cc:1511] Processing CreateTablet for tablet e35ce8a46cb74a9891137c76958cb72e (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:28.793776 21583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1cd2210abe461397347df2c882d656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.796592 21584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35ce8a46cb74a9891137c76958cb72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.799515 21582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabe3609ae1641e8b814b1d861589931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.799001 21581 tablet_service.cc:1511] Processing CreateTablet for tablet 890cd37fd42e44b2a355362268083959 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:28.802031 21581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890cd37fd42e44b2a355362268083959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.823022 21580 tablet_service.cc:1511] Processing CreateTablet for tablet a5a0c4435ea44bac9b57b5322e90c429 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:28.824512 21580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a0c4435ea44bac9b57b5322e90c429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.837059 21512 tablet_service.cc:1511] Processing CreateTablet for tablet d46799ac44b3492c8b5d3928270ca263 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:28.845050 21511 tablet_service.cc:1511] Processing CreateTablet for tablet 7ada68483f624db98f8c9b99332a39ec (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:28.847440 21510 tablet_service.cc:1511] Processing CreateTablet for tablet e35ce8a46cb74a9891137c76958cb72e (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:28.847852 21512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46799ac44b3492c8b5d3928270ca263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.850484 21509 tablet_service.cc:1511] Processing CreateTablet for tablet ff1cd2210abe461397347df2c882d656 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:28.853080 21579 tablet_service.cc:1511] Processing CreateTablet for tablet abbfff84611444438e8527b4edf623a6 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:28.856128 21511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ada68483f624db98f8c9b99332a39ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.863559 21579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbfff84611444438e8527b4edf623a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.861797 21510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35ce8a46cb74a9891137c76958cb72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.868090 21506 tablet_service.cc:1511] Processing CreateTablet for tablet a5a0c4435ea44bac9b57b5322e90c429 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:28.873004 21509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1cd2210abe461397347df2c882d656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.863582 21507 tablet_service.cc:1511] Processing CreateTablet for tablet 890cd37fd42e44b2a355362268083959 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:28.863615 21508 tablet_service.cc:1511] Processing CreateTablet for tablet dabe3609ae1641e8b814b1d861589931 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:28.877774 21504 tablet_service.cc:1511] Processing CreateTablet for tablet bdb72965fcf3409d970349085b4b982d (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:28.885071 21437 tablet_service.cc:1511] Processing CreateTablet for tablet d46799ac44b3492c8b5d3928270ca263 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:28.889642 21506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a0c4435ea44bac9b57b5322e90c429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.880774 21505 tablet_service.cc:1511] Processing CreateTablet for tablet abbfff84611444438e8527b4edf623a6 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:28.887920 21578 tablet_service.cc:1511] Processing CreateTablet for tablet bdb72965fcf3409d970349085b4b982d (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:28.894677 21435 tablet_service.cc:1511] Processing CreateTablet for tablet e35ce8a46cb74a9891137c76958cb72e (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:28.901479 21578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdb72965fcf3409d970349085b4b982d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.898546 21436 tablet_service.cc:1511] Processing CreateTablet for tablet 7ada68483f624db98f8c9b99332a39ec (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:28.904412 21434 tablet_service.cc:1511] Processing CreateTablet for tablet ff1cd2210abe461397347df2c882d656 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:28.910307 21505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbfff84611444438e8527b4edf623a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.913173 21437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46799ac44b3492c8b5d3928270ca263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.921545 21432 tablet_service.cc:1511] Processing CreateTablet for tablet 890cd37fd42e44b2a355362268083959 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:28.926833 21432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890cd37fd42e44b2a355362268083959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.932914 21508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabe3609ae1641e8b814b1d861589931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.938848 21430 tablet_service.cc:1511] Processing CreateTablet for tablet abbfff84611444438e8527b4edf623a6 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:28.941744 21430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbfff84611444438e8527b4edf623a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.930303 21433 tablet_service.cc:1511] Processing CreateTablet for tablet dabe3609ae1641e8b814b1d861589931 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:28.946607 21429 tablet_service.cc:1511] Processing CreateTablet for tablet bdb72965fcf3409d970349085b4b982d (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:28.947638 21507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890cd37fd42e44b2a355362268083959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.924819 21431 tablet_service.cc:1511] Processing CreateTablet for tablet a5a0c4435ea44bac9b57b5322e90c429 (DEFAULT_TABLE table=test-workload [id=a3f15f51c4fc494b9e386a1930eb2ff0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:28.947109 21435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35ce8a46cb74a9891137c76958cb72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.952814 21504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdb72965fcf3409d970349085b4b982d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.956264 21436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ada68483f624db98f8c9b99332a39ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.973014 21640 tablet_bootstrap.cc:492] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8: Bootstrap starting.
I20260709 13:05:28.979437 21640 tablet_bootstrap.cc:654] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:28.984120 21392 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:28.991254 21433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabe3609ae1641e8b814b1d861589931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.005841 21429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdb72965fcf3409d970349085b4b982d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.016724 21431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a0c4435ea44bac9b57b5322e90c429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.024992 21434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1cd2210abe461397347df2c882d656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.033074 21639 tablet_bootstrap.cc:492] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea: Bootstrap starting.
I20260709 13:05:29.045828 21641 tablet_bootstrap.cc:492] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Bootstrap starting.
I20260709 13:05:29.094038 21640 tablet_bootstrap.cc:492] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8: No bootstrap required, opened a new log
I20260709 13:05:29.094558 21640 ts_tablet_manager.cc:1403] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.024s
I20260709 13:05:29.123174 21639 tablet_bootstrap.cc:654] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.133577 21640 raft_consensus.cc:359] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:29.134689 21640 raft_consensus.cc:385] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.136711 21640 raft_consensus.cc:740] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.137934 21640 consensus_queue.cc:260] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:29.139545 21639 tablet_bootstrap.cc:492] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea: No bootstrap required, opened a new log
I20260709 13:05:29.141039 21639 ts_tablet_manager.cc:1403] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea: Time spent bootstrapping tablet: real 0.128s	user 0.019s	sys 0.009s
I20260709 13:05:29.144225 21639 raft_consensus.cc:359] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.146159 21639 raft_consensus.cc:385] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.146579 21639 raft_consensus.cc:740] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.145829 21641 tablet_bootstrap.cc:654] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.150146 21547 heartbeater.cc:499] Master 127.20.208.62:43357 was elected leader, sending a full tablet report...
I20260709 13:05:29.150490 21640 ts_tablet_manager.cc:1434] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.009s
I20260709 13:05:29.151327 21640 tablet_bootstrap.cc:492] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8: Bootstrap starting.
I20260709 13:05:29.154587 21639 consensus_queue.cc:260] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.156706 21640 tablet_bootstrap.cc:654] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.163756 21621 heartbeater.cc:499] Master 127.20.208.62:43357 was elected leader, sending a full tablet report...
I20260709 13:05:29.164841 21639 ts_tablet_manager.cc:1434] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.008s
I20260709 13:05:29.166416 21639 tablet_bootstrap.cc:492] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea: Bootstrap starting.
W20260709 13:05:29.167255 21548 tablet.cc:2406] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:29.171550 21641 tablet_bootstrap.cc:492] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: No bootstrap required, opened a new log
I20260709 13:05:29.172071 21641 ts_tablet_manager.cc:1403] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.000s
I20260709 13:05:29.175143 21641 raft_consensus.cc:359] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:29.175927 21641 raft_consensus.cc:385] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.183444 21639 tablet_bootstrap.cc:654] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.176234 21641 raft_consensus.cc:740] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.188346 21641 consensus_queue.cc:260] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:29.192759 21472 heartbeater.cc:499] Master 127.20.208.62:43357 was elected leader, sending a full tablet report...
I20260709 13:05:29.193552 21641 ts_tablet_manager.cc:1434] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:05:29.194602 21641 tablet_bootstrap.cc:492] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Bootstrap starting.
I20260709 13:05:29.204792 21639 tablet_bootstrap.cc:492] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea: No bootstrap required, opened a new log
I20260709 13:05:29.205345 21639 ts_tablet_manager.cc:1403] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.002s
I20260709 13:05:29.208384 21639 raft_consensus.cc:359] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:29.209189 21639 raft_consensus.cc:385] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.209515 21639 raft_consensus.cc:740] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.210281 21639 consensus_queue.cc:260] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:29.212100 21641 tablet_bootstrap.cc:654] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.216385 21646 raft_consensus.cc:493] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.216981 21646 raft_consensus.cc:515] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.220388 21646 leader_election.cc:290] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:29.222179 21639 ts_tablet_manager.cc:1434] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:29.223186 21639 tablet_bootstrap.cc:492] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea: Bootstrap starting.
I20260709 13:05:29.237185 21639 tablet_bootstrap.cc:654] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.239384 21640 tablet_bootstrap.cc:492] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8: No bootstrap required, opened a new log
I20260709 13:05:29.240056 21640 ts_tablet_manager.cc:1403] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8: Time spent bootstrapping tablet: real 0.089s	user 0.026s	sys 0.047s
I20260709 13:05:29.240307 21641 tablet_bootstrap.cc:492] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: No bootstrap required, opened a new log
I20260709 13:05:29.240931 21641 ts_tablet_manager.cc:1403] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.005s
I20260709 13:05:29.243803 21640 raft_consensus.cc:359] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.244585 21640 raft_consensus.cc:385] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.244899 21640 raft_consensus.cc:740] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.245352 21641 raft_consensus.cc:359] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.247605 21641 raft_consensus.cc:385] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.247936 21641 raft_consensus.cc:740] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.247771 21640 consensus_queue.cc:260] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.248647 21641 consensus_queue.cc:260] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.253355 21640 ts_tablet_manager.cc:1434] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:05:29.255471 21641 ts_tablet_manager.cc:1434] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:05:29.256518 21641 tablet_bootstrap.cc:492] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Bootstrap starting.
I20260709 13:05:29.258845 21640 tablet_bootstrap.cc:492] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8: Bootstrap starting.
I20260709 13:05:29.266407 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
W20260709 13:05:29.268397 21561 leader_election.cc:343] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.278299 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b0b8b156304ad890700786de9427e8" is_pre_election: true
W20260709 13:05:29.280435 21561 leader_election.cc:343] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.281064 21561 leader_election.cc:304] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea; no voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8
I20260709 13:05:29.282181 21651 raft_consensus.cc:2749] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.282516 21640 tablet_bootstrap.cc:654] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.288280 21639 tablet_bootstrap.cc:492] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea: No bootstrap required, opened a new log
I20260709 13:05:29.288841 21639 ts_tablet_manager.cc:1403] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.010s
I20260709 13:05:29.288942 21641 tablet_bootstrap.cc:654] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.291745 21639 raft_consensus.cc:359] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.292538 21639 raft_consensus.cc:385] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.292856 21639 raft_consensus.cc:740] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.293654 21639 consensus_queue.cc:260] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.295329 21640 tablet_bootstrap.cc:492] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8: No bootstrap required, opened a new log
I20260709 13:05:29.296018 21640 ts_tablet_manager.cc:1403] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.008s
I20260709 13:05:29.299651 21641 tablet_bootstrap.cc:492] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: No bootstrap required, opened a new log
I20260709 13:05:29.299211 21640 raft_consensus.cc:359] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.300159 21641 ts_tablet_manager.cc:1403] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.004s
I20260709 13:05:29.300107 21640 raft_consensus.cc:385] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.300621 21640 raft_consensus.cc:740] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.301555 21640 consensus_queue.cc:260] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.302628 21639 ts_tablet_manager.cc:1434] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:29.304088 21640 ts_tablet_manager.cc:1434] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:29.305155 21640 tablet_bootstrap.cc:492] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8: Bootstrap starting.
I20260709 13:05:29.307106 21641 raft_consensus.cc:359] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.307891 21641 raft_consensus.cc:385] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.308189 21641 raft_consensus.cc:740] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.308970 21641 consensus_queue.cc:260] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.311129 21641 ts_tablet_manager.cc:1434] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:05:29.312137 21641 tablet_bootstrap.cc:492] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Bootstrap starting.
I20260709 13:05:29.312750 21640 tablet_bootstrap.cc:654] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.318977 21641 tablet_bootstrap.cc:654] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.321877 21644 raft_consensus.cc:493] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.322436 21644 raft_consensus.cc:515] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.327941 21639 tablet_bootstrap.cc:492] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea: Bootstrap starting.
I20260709 13:05:29.328868 21644 leader_election.cc:290] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.335521 21639 tablet_bootstrap.cc:654] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.341035 21649 raft_consensus.cc:493] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.341612 21649 raft_consensus.cc:515] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.344666 21644 raft_consensus.cc:493] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.345204 21644 raft_consensus.cc:515] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:29.347445 21644 leader_election.cc:290] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191), 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033)
I20260709 13:05:29.344345 21649 leader_election.cc:290] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.352520 21640 tablet_bootstrap.cc:492] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8: No bootstrap required, opened a new log
I20260709 13:05:29.353147 21640 ts_tablet_manager.cc:1403] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.009s
I20260709 13:05:29.356350 21640 raft_consensus.cc:359] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.365646 21640 raft_consensus.cc:385] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.366182 21640 raft_consensus.cc:740] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.367080 21651 raft_consensus.cc:493] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.367640 21651 raft_consensus.cc:515] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.370033 21651 leader_election.cc:290] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:29.372381 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890cd37fd42e44b2a355362268083959" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.372890 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890cd37fd42e44b2a355362268083959" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b0b8b156304ad890700786de9427e8" is_pre_election: true
I20260709 13:05:29.373035 21640 consensus_queue.cc:260] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.373272 21447 raft_consensus.cc:2468] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 0.
W20260709 13:05:29.374356 21561 leader_election.cc:343] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.375139 21561 leader_election.cc:304] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: e2b0b8b156304ad890700786de9427e8
I20260709 13:05:29.376174 21651 raft_consensus.cc:2804] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.376536 21651 raft_consensus.cc:493] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.376868 21651 raft_consensus.cc:3060] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.382637 21640 ts_tablet_manager.cc:1434] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:05:29.383726 21640 tablet_bootstrap.cc:492] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8: Bootstrap starting.
I20260709 13:05:29.384212 21651 raft_consensus.cc:515] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.387105 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890cd37fd42e44b2a355362268083959" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:29.387692 21447 raft_consensus.cc:3060] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.394906 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea" is_pre_election: true
I20260709 13:05:29.395687 21596 raft_consensus.cc:2468] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 0.
I20260709 13:05:29.397042 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea" is_pre_election: true
I20260709 13:05:29.397806 21595 raft_consensus.cc:2468] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 0.
I20260709 13:05:29.398655 21447 raft_consensus.cc:2468] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 1.
I20260709 13:05:29.400605 21486 leader_election.cc:304] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:29.403527 21561 leader_election.cc:304] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:29.403677 21644 raft_consensus.cc:2804] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.403865 21486 leader_election.cc:304] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:29.404069 21644 raft_consensus.cc:493] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.404515 21644 raft_consensus.cc:3060] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.406270 21646 raft_consensus.cc:2804] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.407641 21641 tablet_bootstrap.cc:492] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: No bootstrap required, opened a new log
I20260709 13:05:29.408098 21641 ts_tablet_manager.cc:1403] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.016s
I20260709 13:05:29.403446 21651 leader_election.cc:290] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:29.408111 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890cd37fd42e44b2a355362268083959" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b0b8b156304ad890700786de9427e8"
W20260709 13:05:29.415897 21561 leader_election.cc:343] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.414247 21644 raft_consensus.cc:515] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.423832 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.424350 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.425227 21446 raft_consensus.cc:2468] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 0.
W20260709 13:05:29.425379 21487 leader_election.cc:343] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.425308 21445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:29.427011 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:29.427534 21595 raft_consensus.cc:3060] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:29.427492 21487 leader_election.cc:343] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.432296 21595 raft_consensus.cc:2468] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 1.
I20260709 13:05:29.424288 21644 leader_election.cc:290] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.432732 21646 raft_consensus.cc:697] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Becoming Leader. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:29.434165 21641 raft_consensus.cc:359] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.434396 21646 consensus_queue.cc:237] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.434928 21641 raft_consensus.cc:385] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.435350 21641 raft_consensus.cc:740] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.436959 21640 tablet_bootstrap.cc:654] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.436690 21641 consensus_queue.cc:260] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.440862 21486 leader_election.cc:304] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4
I20260709 13:05:29.439568 21644 raft_consensus.cc:2804] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.442180 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabe3609ae1641e8b814b1d861589931" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b0b8b156304ad890700786de9427e8" is_pre_election: true
I20260709 13:05:29.442350 21644 raft_consensus.cc:493] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.442862 21644 raft_consensus.cc:3060] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:29.444244 21412 leader_election.cc:343] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.446327 21639 tablet_bootstrap.cc:492] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea: No bootstrap required, opened a new log
I20260709 13:05:29.446790 21639 ts_tablet_manager.cc:1403] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea: Time spent bootstrapping tablet: real 0.119s	user 0.018s	sys 0.007s
I20260709 13:05:29.453136 21639 raft_consensus.cc:359] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.453976 21639 raft_consensus.cc:385] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.456525 21639 raft_consensus.cc:740] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.457392 21639 consensus_queue.cc:260] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.449788 21641 ts_tablet_manager.cc:1434] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:05:29.445848 21666 raft_consensus.cc:2804] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.471844 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabe3609ae1641e8b814b1d861589931" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea" is_pre_election: true
W20260709 13:05:29.486358 21411 leader_election.cc:343] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.486930 21411 leader_election.cc:304] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4; no voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8
I20260709 13:05:29.488083 21649 raft_consensus.cc:2749] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.489123 21641 tablet_bootstrap.cc:492] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Bootstrap starting.
I20260709 13:05:29.495118 21639 ts_tablet_manager.cc:1434] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:05:29.510444 21639 tablet_bootstrap.cc:492] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea: Bootstrap starting.
I20260709 13:05:29.503285 21666 raft_consensus.cc:697] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:29.513528 21666 consensus_queue.cc:237] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.516424 21639 tablet_bootstrap.cc:654] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.501389 21644 raft_consensus.cc:515] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:29.519837 21671 raft_consensus.cc:493] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.525538 21666 raft_consensus.cc:493] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.526019 21666 raft_consensus.cc:515] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.527184 21640 tablet_bootstrap.cc:492] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8: No bootstrap required, opened a new log
I20260709 13:05:29.527580 21640 ts_tablet_manager.cc:1403] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8: Time spent bootstrapping tablet: real 0.144s	user 0.022s	sys 0.034s
I20260709 13:05:29.528199 21666 leader_election.cc:290] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.529145 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.529618 21644 leader_election.cc:290] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Requested vote from peers 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191), 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033)
W20260709 13:05:29.530807 21487 leader_election.cc:343] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.531388 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:29.531806 21447 raft_consensus.cc:3060] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.532209 21640 raft_consensus.cc:359] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.523952 21671 raft_consensus.cc:515] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.533555 21640 raft_consensus.cc:385] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.533551 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea" is_pre_election: true
I20260709 13:05:29.534991 21640 raft_consensus.cc:740] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.536115 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:29.536885 21641 tablet_bootstrap.cc:654] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.536947 21596 raft_consensus.cc:3060] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:29.537734 21486 leader_election.cc:343] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.538154 21486 leader_election.cc:304] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2b0b8b156304ad890700786de9427e8; no voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea
I20260709 13:05:29.538806 21644 raft_consensus.cc:2749] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.536134 21640 consensus_queue.cc:260] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.541960 21640 ts_tablet_manager.cc:1434] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 13:05:29.545351 21640 tablet_bootstrap.cc:492] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8: Bootstrap starting.
I20260709 13:05:29.547830 21447 raft_consensus.cc:2468] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 1.
I20260709 13:05:29.546150 21639 tablet_bootstrap.cc:492] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea: No bootstrap required, opened a new log
I20260709 13:05:29.549357 21596 raft_consensus.cc:2468] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 1.
I20260709 13:05:29.549619 21639 ts_tablet_manager.cc:1403] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.004s
I20260709 13:05:29.550355 21487 leader_election.cc:304] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:29.551895 21644 raft_consensus.cc:2804] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.551738 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbfff84611444438e8527b4edf623a6" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.552495 21671 leader_election.cc:290] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.553190 21644 raft_consensus.cc:697] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:29.553426 21447 raft_consensus.cc:2468] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 0.
I20260709 13:05:29.554690 21644 consensus_queue.cc:237] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:29.555065 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbfff84611444438e8527b4edf623a6" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea" is_pre_election: true
I20260709 13:05:29.555326 21487 leader_election.cc:304] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:29.555985 21641 tablet_bootstrap.cc:492] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: No bootstrap required, opened a new log
I20260709 13:05:29.557130 21641 ts_tablet_manager.cc:1403] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.005s
I20260709 13:05:29.558266 21666 raft_consensus.cc:2804] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:29.559805 21486 leader_election.cc:343] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.558866 21666 raft_consensus.cc:493] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.560699 21639 raft_consensus.cc:359] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.565610 21666 raft_consensus.cc:3060] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.565923 21639 raft_consensus.cc:385] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.566306 21639 raft_consensus.cc:740] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.567160 21639 consensus_queue.cc:260] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.569527 21639 ts_tablet_manager.cc:1434] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:05:29.570559 21639 tablet_bootstrap.cc:492] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea: Bootstrap starting.
I20260709 13:05:29.564265 21641 raft_consensus.cc:359] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.574957 21641 raft_consensus.cc:385] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.576201 21641 raft_consensus.cc:740] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.575949 21344 catalog_manager.cc:5697] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.576997 21641 consensus_queue.cc:260] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.582204 21641 ts_tablet_manager.cc:1434] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:05:29.583329 21641 tablet_bootstrap.cc:492] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Bootstrap starting.
I20260709 13:05:29.583971 21640 tablet_bootstrap.cc:654] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.579066 21341 catalog_manager.cc:5697] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 553c493339cb4e2e88cc5539035f06ea (127.20.208.3). New cstate: current_term: 1 leader_uuid: "553c493339cb4e2e88cc5539035f06ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.585400 21666 raft_consensus.cc:515] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.588737 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbfff84611444438e8527b4edf623a6" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:29.589157 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbfff84611444438e8527b4edf623a6" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:29.589444 21447 raft_consensus.cc:3060] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.589859 21596 raft_consensus.cc:3060] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.592823 21666 leader_election.cc:290] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.596668 21447 raft_consensus.cc:2468] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 1.
I20260709 13:05:29.598086 21487 leader_election.cc:304] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:29.600260 21666 raft_consensus.cc:2804] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.601101 21596 raft_consensus.cc:2468] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 1.
I20260709 13:05:29.602700 21639 tablet_bootstrap.cc:654] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.602609 21666 raft_consensus.cc:697] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:29.604578 21666 consensus_queue.cc:237] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.610827 21640 tablet_bootstrap.cc:492] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8: No bootstrap required, opened a new log
I20260709 13:05:29.611586 21640 ts_tablet_manager.cc:1403] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.005s
I20260709 13:05:29.613978 21641 tablet_bootstrap.cc:654] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.629253 21640 raft_consensus.cc:359] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.630262 21640 raft_consensus.cc:385] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.630630 21640 raft_consensus.cc:740] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.631583 21640 consensus_queue.cc:260] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.649471 21641 tablet_bootstrap.cc:492] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: No bootstrap required, opened a new log
I20260709 13:05:29.650142 21641 ts_tablet_manager.cc:1403] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent bootstrapping tablet: real 0.067s	user 0.005s	sys 0.013s
I20260709 13:05:29.654114 21640 ts_tablet_manager.cc:1434] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8: Time spent starting tablet: real 0.036s	user 0.000s	sys 0.008s
I20260709 13:05:29.655560 21640 tablet_bootstrap.cc:492] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8: Bootstrap starting.
I20260709 13:05:29.662909 21639 tablet_bootstrap.cc:492] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea: No bootstrap required, opened a new log
I20260709 13:05:29.663559 21639 ts_tablet_manager.cc:1403] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea: Time spent bootstrapping tablet: real 0.093s	user 0.032s	sys 0.026s
I20260709 13:05:29.666918 21639 raft_consensus.cc:359] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.667896 21639 raft_consensus.cc:385] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.668342 21639 raft_consensus.cc:740] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.669255 21639 consensus_queue.cc:260] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.669667 21641 raft_consensus.cc:359] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.670513 21641 raft_consensus.cc:385] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.670853 21641 raft_consensus.cc:740] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.672204 21639 ts_tablet_manager.cc:1434] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:29.673388 21639 tablet_bootstrap.cc:492] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea: Bootstrap starting.
I20260709 13:05:29.671702 21641 consensus_queue.cc:260] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.681169 21641 ts_tablet_manager.cc:1434] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 13:05:29.681957 21666 raft_consensus.cc:493] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.682436 21641 tablet_bootstrap.cc:492] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Bootstrap starting.
I20260709 13:05:29.682457 21666 raft_consensus.cc:515] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.684847 21666 leader_election.cc:290] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.686434 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1cd2210abe461397347df2c882d656" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea" is_pre_election: true
I20260709 13:05:29.688763 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1cd2210abe461397347df2c882d656" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.689450 21447 raft_consensus.cc:2468] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 0.
I20260709 13:05:29.689702 21639 tablet_bootstrap.cc:654] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.690515 21640 tablet_bootstrap.cc:654] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:29.690639 21486 leader_election.cc:343] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.692199 21487 leader_election.cc:304] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 553c493339cb4e2e88cc5539035f06ea
I20260709 13:05:29.693459 21666 raft_consensus.cc:2804] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.693938 21641 tablet_bootstrap.cc:654] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.693926 21666 raft_consensus.cc:493] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.694548 21666 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.697710 21640 tablet_bootstrap.cc:492] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8: No bootstrap required, opened a new log
I20260709 13:05:29.698246 21640 ts_tablet_manager.cc:1403] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.008s
I20260709 13:05:29.701505 21666 raft_consensus.cc:515] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.701552 21640 raft_consensus.cc:359] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.702502 21640 raft_consensus.cc:385] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.702855 21640 raft_consensus.cc:740] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.703302 21639 tablet_bootstrap.cc:492] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea: No bootstrap required, opened a new log
I20260709 13:05:29.703811 21639 ts_tablet_manager.cc:1403] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.002s
I20260709 13:05:29.703826 21640 consensus_queue.cc:260] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.704728 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1cd2210abe461397347df2c882d656" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:29.705283 21447 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.706966 21640 ts_tablet_manager.cc:1434] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:05:29.706833 21639 raft_consensus.cc:359] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.707580 21639 raft_consensus.cc:385] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.707880 21639 raft_consensus.cc:740] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.707986 21640 tablet_bootstrap.cc:492] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8: Bootstrap starting.
I20260709 13:05:29.708693 21639 consensus_queue.cc:260] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.711716 21641 tablet_bootstrap.cc:492] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4: No bootstrap required, opened a new log
I20260709 13:05:29.712208 21641 ts_tablet_manager.cc:1403] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.002s
I20260709 13:05:29.713547 21447 raft_consensus.cc:2468] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 1.
I20260709 13:05:29.714918 21487 leader_election.cc:304] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:29.717271 21641 raft_consensus.cc:359] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.717684 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1cd2210abe461397347df2c882d656" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:29.718035 21641 raft_consensus.cc:385] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.718390 21641 raft_consensus.cc:740] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.718413 21596 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.719310 21641 consensus_queue.cc:260] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.722011 21641 ts_tablet_manager.cc:1434] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:29.722515 21644 raft_consensus.cc:2804] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.714871 21639 ts_tablet_manager.cc:1434] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:05:29.724035 21639 tablet_bootstrap.cc:492] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea: Bootstrap starting.
I20260709 13:05:29.725443 21596 raft_consensus.cc:2468] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 1.
I20260709 13:05:29.727029 21666 leader_election.cc:290] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.723030 21644 raft_consensus.cc:697] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:29.729393 21644 consensus_queue.cc:237] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.730753 21639 tablet_bootstrap.cc:654] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.732610 21641 tablet_bootstrap.cc:492] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Bootstrap starting.
I20260709 13:05:29.742980 21641 tablet_bootstrap.cc:654] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.745083 21341 catalog_manager.cc:5697] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.746963 21341 catalog_manager.cc:5697] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.752487 21640 tablet_bootstrap.cc:654] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.762526 21641 tablet_bootstrap.cc:492] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4: No bootstrap required, opened a new log
I20260709 13:05:29.763027 21641 ts_tablet_manager.cc:1403] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.005s
I20260709 13:05:29.765690 21641 raft_consensus.cc:359] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.767020 21641 raft_consensus.cc:385] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.767318 21641 raft_consensus.cc:740] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.768816 21641 consensus_queue.cc:260] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.772221 21640 tablet_bootstrap.cc:492] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8: No bootstrap required, opened a new log
I20260709 13:05:29.772691 21640 ts_tablet_manager.cc:1403] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.006s
I20260709 13:05:29.773048 21641 ts_tablet_manager.cc:1434] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:29.773929 21641 tablet_bootstrap.cc:492] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Bootstrap starting.
I20260709 13:05:29.775286 21640 raft_consensus.cc:359] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.775962 21640 raft_consensus.cc:385] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.776223 21640 raft_consensus.cc:740] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.776875 21640 consensus_queue.cc:260] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.777980 21639 tablet_bootstrap.cc:492] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea: No bootstrap required, opened a new log
I20260709 13:05:29.779047 21640 ts_tablet_manager.cc:1434] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:05:29.779901 21640 tablet_bootstrap.cc:492] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8: Bootstrap starting.
I20260709 13:05:29.780052 21641 tablet_bootstrap.cc:654] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.782115 21646 raft_consensus.cc:493] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.782618 21646 raft_consensus.cc:515] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.782363 21340 catalog_manager.cc:5697] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.784636 21646 leader_election.cc:290] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:29.785737 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.786414 21447 raft_consensus.cc:2468] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 0.
I20260709 13:05:29.788039 21649 raft_consensus.cc:493] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.787925 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b0b8b156304ad890700786de9427e8" is_pre_election: true
I20260709 13:05:29.788273 21561 leader_election.cc:304] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:29.788595 21649 raft_consensus.cc:515] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.788837 21522 raft_consensus.cc:2468] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 0.
I20260709 13:05:29.790666 21649 leader_election.cc:290] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.791209 21646 raft_consensus.cc:2804] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.791565 21646 raft_consensus.cc:493] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.791534 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b0b8b156304ad890700786de9427e8" is_pre_election: true
I20260709 13:05:29.792135 21646 raft_consensus.cc:3060] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.791746 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea" is_pre_election: true
I20260709 13:05:29.793763 21596 raft_consensus.cc:2393] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in current term 1: Already voted for candidate e2b0b8b156304ad890700786de9427e8 in this term.
I20260709 13:05:29.790421 21639 ts_tablet_manager.cc:1403] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.012s
I20260709 13:05:29.795441 21412 leader_election.cc:304] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4; no voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8
I20260709 13:05:29.797060 21649 raft_consensus.cc:3060] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.797863 21639 raft_consensus.cc:359] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.798511 21639 raft_consensus.cc:385] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.798790 21639 raft_consensus.cc:740] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.803864 21649 raft_consensus.cc:2749] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.807291 21646 raft_consensus.cc:515] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.809358 21646 leader_election.cc:290] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:29.810381 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:29.810949 21447 raft_consensus.cc:3060] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.811852 21644 raft_consensus.cc:493] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.812302 21644 raft_consensus.cc:515] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.814374 21644 leader_election.cc:290] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.815168 21640 tablet_bootstrap.cc:654] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.815670 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabe3609ae1641e8b814b1d861589931" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea" is_pre_election: true
I20260709 13:05:29.816359 21596 raft_consensus.cc:2468] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 0.
I20260709 13:05:29.818717 21447 raft_consensus.cc:2468] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 1.
I20260709 13:05:29.808729 21639 consensus_queue.cc:260] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.820624 21561 leader_election.cc:304] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:29.821478 21646 raft_consensus.cc:2804] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.821950 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:29.822124 21646 raft_consensus.cc:697] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Becoming Leader. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:29.822579 21522 raft_consensus.cc:3060] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.823069 21646 consensus_queue.cc:237] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.825014 21639 ts_tablet_manager.cc:1434] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:05:29.825242 21486 leader_election.cc:304] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:29.826057 21644 raft_consensus.cc:2804] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.826433 21644 raft_consensus.cc:493] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.826790 21644 raft_consensus.cc:3060] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.827140 21639 tablet_bootstrap.cc:492] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea: Bootstrap starting.
I20260709 13:05:29.831549 21522 raft_consensus.cc:2468] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 1.
I20260709 13:05:29.832378 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabe3609ae1641e8b814b1d861589931" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.833105 21644 raft_consensus.cc:515] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.840209 21640 tablet_bootstrap.cc:492] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8: No bootstrap required, opened a new log
I20260709 13:05:29.840354 21644 leader_election.cc:290] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.840827 21640 ts_tablet_manager.cc:1403] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.006s
I20260709 13:05:29.841077 21445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabe3609ae1641e8b814b1d861589931" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:29.841955 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabe3609ae1641e8b814b1d861589931" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:29.842497 21596 raft_consensus.cc:3060] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.833930 21639 tablet_bootstrap.cc:654] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.835038 21641 tablet_bootstrap.cc:492] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4: No bootstrap required, opened a new log
I20260709 13:05:29.843990 21641 ts_tablet_manager.cc:1403] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent bootstrapping tablet: real 0.070s	user 0.003s	sys 0.050s
I20260709 13:05:29.843708 21640 raft_consensus.cc:359] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.844424 21640 raft_consensus.cc:385] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.844733 21640 raft_consensus.cc:740] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.845378 21640 consensus_queue.cc:260] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.847018 21641 raft_consensus.cc:359] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.847571 21640 ts_tablet_manager.cc:1434] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:29.847733 21641 raft_consensus.cc:385] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.848132 21641 raft_consensus.cc:740] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.837412 21447 raft_consensus.cc:2468] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 0.
I20260709 13:05:29.848891 21641 consensus_queue.cc:260] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.849458 21596 raft_consensus.cc:2468] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 1.
I20260709 13:05:29.851143 21641 ts_tablet_manager.cc:1434] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:29.852662 21486 leader_election.cc:304] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4
I20260709 13:05:29.853791 21644 raft_consensus.cc:2804] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.854290 21644 raft_consensus.cc:697] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:29.855044 21644 consensus_queue.cc:237] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.859820 21639 tablet_bootstrap.cc:492] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea: No bootstrap required, opened a new log
I20260709 13:05:29.860203 21639 ts_tablet_manager.cc:1403] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:05:29.862764 21639 raft_consensus.cc:359] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.863499 21639 raft_consensus.cc:385] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.864632 21639 raft_consensus.cc:740] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.865504 21639 consensus_queue.cc:260] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.866279 21340 catalog_manager.cc:5697] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 553c493339cb4e2e88cc5539035f06ea (127.20.208.3). New cstate: current_term: 1 leader_uuid: "553c493339cb4e2e88cc5539035f06ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.867712 21639 ts_tablet_manager.cc:1434] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:29.877606 21343 catalog_manager.cc:5697] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.919628 21644 raft_consensus.cc:493] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.920077 21644 raft_consensus.cc:515] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.922277 21644 leader_election.cc:290] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.922727 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb72965fcf3409d970349085b4b982d" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.922887 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb72965fcf3409d970349085b4b982d" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea" is_pre_election: true
I20260709 13:05:29.923483 21596 raft_consensus.cc:2468] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 0.
I20260709 13:05:29.923451 21447 raft_consensus.cc:2468] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 0.
I20260709 13:05:29.924609 21486 leader_election.cc:304] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:29.925513 21644 raft_consensus.cc:2804] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.925887 21644 raft_consensus.cc:493] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.926215 21644 raft_consensus.cc:3060] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.931113 21644 raft_consensus.cc:515] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.932848 21644 leader_election.cc:290] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.933717 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb72965fcf3409d970349085b4b982d" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:29.933939 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb72965fcf3409d970349085b4b982d" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:29.934186 21447 raft_consensus.cc:3060] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.934585 21596 raft_consensus.cc:3060] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.939095 21447 raft_consensus.cc:2468] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 1.
I20260709 13:05:29.940130 21487 leader_election.cc:304] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:29.940955 21644 raft_consensus.cc:2804] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.941196 21596 raft_consensus.cc:2468] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 1.
I20260709 13:05:29.941354 21644 raft_consensus.cc:697] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:29.942222 21644 consensus_queue.cc:237] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.945248 21666 consensus_queue.cc:1048] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.950767 21343 catalog_manager.cc:5697] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.951601 21666 raft_consensus.cc:493] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.952178 21666 raft_consensus.cc:515] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.954283 21666 leader_election.cc:290] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:29.955948 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890cd37fd42e44b2a355362268083959" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553c493339cb4e2e88cc5539035f06ea" is_pre_election: true
I20260709 13:05:29.958460 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890cd37fd42e44b2a355362268083959" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.959219 21447 raft_consensus.cc:2393] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2b0b8b156304ad890700786de9427e8 in current term 1: Already voted for candidate 553c493339cb4e2e88cc5539035f06ea in this term.
I20260709 13:05:29.961644 21487 leader_election.cc:304] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2b0b8b156304ad890700786de9427e8; no voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea
I20260709 13:05:29.962572 21666 raft_consensus.cc:3060] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.965298 21646 raft_consensus.cc:493] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.965826 21646 raft_consensus.cc:515] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.967837 21666 raft_consensus.cc:2749] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.968132 21646 leader_election.cc:290] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:29.969559 21445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" is_pre_election: true
I20260709 13:05:29.970216 21445 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 0.
I20260709 13:05:29.971823 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b0b8b156304ad890700786de9427e8" is_pre_election: true
I20260709 13:05:29.972985 21522 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 0.
I20260709 13:05:29.973958 21561 leader_election.cc:304] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:29.974344 21671 consensus_queue.cc:1048] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.977288 21667 raft_consensus.cc:2804] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.977780 21667 raft_consensus.cc:493] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.978148 21667 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.985731 21667 raft_consensus.cc:515] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:29.988345 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:29.988945 21447 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.992781 21667 leader_election.cc:290] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:29.993852 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:29.994450 21522 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:29.996871 21392 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:30.001839 21447 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 1.
I20260709 13:05:30.003484 21561 leader_election.cc:304] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:30.004285 21667 raft_consensus.cc:2804] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:30.004323 21522 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 1.
I20260709 13:05:30.005128 21646 consensus_queue.cc:1048] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.016324 21667 raft_consensus.cc:697] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Becoming Leader. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:30.017439 21667 consensus_queue.cc:237] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.021378 21646 consensus_queue.cc:1048] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.037048 21343 catalog_manager.cc:5697] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 553c493339cb4e2e88cc5539035f06ea (127.20.208.3). New cstate: current_term: 1 leader_uuid: "553c493339cb4e2e88cc5539035f06ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.076978 21671 consensus_queue.cc:1048] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.087841 21671 consensus_queue.cc:1048] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.099382 21671 consensus_queue.cc:1048] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.113970 21670 consensus_queue.cc:1048] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.154449 21670 consensus_queue.cc:1048] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.166610 21671 consensus_queue.cc:1048] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.215173 21667 consensus_queue.cc:1048] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.227766 21713 consensus_queue.cc:1048] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.274887 21522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
mode: GRACEFUL
new_leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:47004
I20260709 13:05:30.275645 21522 raft_consensus.cc:606] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Received request to transfer leadership to TS 0f6b44d51d6840e0b8d60cbd8fd2afd4
I20260709 13:05:30.281754 21522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
mode: GRACEFUL
new_leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:47004
I20260709 13:05:30.282284 21522 raft_consensus.cc:606] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Received request to transfer leadership to TS 0f6b44d51d6840e0b8d60cbd8fd2afd4
I20260709 13:05:30.298194 21596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e"
dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
mode: GRACEFUL
new_leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:05:30.298719 21596 raft_consensus.cc:606] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Received request to transfer leadership to TS 0f6b44d51d6840e0b8d60cbd8fd2afd4
I20260709 13:05:30.301014 21447 raft_consensus.cc:3060] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.303637 21522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1cd2210abe461397347df2c882d656"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
mode: GRACEFUL
new_leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:47004
I20260709 13:05:30.304147 21522 raft_consensus.cc:606] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Received request to transfer leadership to TS 0f6b44d51d6840e0b8d60cbd8fd2afd4
I20260709 13:05:30.309003 21671 consensus_queue.cc:1048] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.312413 21596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "890cd37fd42e44b2a355362268083959"
dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
mode: GRACEFUL
new_leader_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:05:30.313048 21596 raft_consensus.cc:606] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Received request to transfer leadership to TS e2b0b8b156304ad890700786de9427e8
I20260709 13:05:30.324899 21644 consensus_queue.cc:1048] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.327392 21595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429"
dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
mode: GRACEFUL
new_leader_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:05:30.328042 21595 raft_consensus.cc:606] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Received request to transfer leadership to TS e2b0b8b156304ad890700786de9427e8
I20260709 13:05:30.339563 21522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdb72965fcf3409d970349085b4b982d"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
mode: GRACEFUL
new_leader_uuid: "553c493339cb4e2e88cc5539035f06ea"
 from {username='slave'} at 127.0.0.1:47004
I20260709 13:05:30.340179 21522 raft_consensus.cc:606] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Received request to transfer leadership to TS 553c493339cb4e2e88cc5539035f06ea
I20260709 13:05:30.452872 21713 consensus_queue.cc:1048] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.455078 21644 consensus_queue.cc:1048] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.466583 21646 consensus_queue.cc:1048] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.473315 21670 consensus_queue.cc:1048] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.485441 21670 raft_consensus.cc:993] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8: : Instructing follower 553c493339cb4e2e88cc5539035f06ea to start an election
I20260709 13:05:30.485929 21670 raft_consensus.cc:1081] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Signalling peer 553c493339cb4e2e88cc5539035f06ea to start an election
I20260709 13:05:30.488178 21596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdb72965fcf3409d970349085b4b982d"
dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
 from {username='slave'} at 127.0.0.1:58024
I20260709 13:05:30.488827 21596 raft_consensus.cc:493] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.489221 21596 raft_consensus.cc:3060] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.502564 21646 raft_consensus.cc:993] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea: : Instructing follower 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:30.502207 21596 raft_consensus.cc:515] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.503021 21646 raft_consensus.cc:1081] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Signalling peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:30.504395 21596 leader_election.cc:290] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 2 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:30.506040 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb72965fcf3409d970349085b4b982d" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:30.506673 21522 raft_consensus.cc:3055] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.507014 21522 raft_consensus.cc:740] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:30.507009 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb72965fcf3409d970349085b4b982d" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:30.507803 21446 raft_consensus.cc:3060] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.508006 21522 consensus_queue.cc:260] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.509444 21522 raft_consensus.cc:3060] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.512766 21445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:05:30.516837 21445 raft_consensus.cc:493] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.517325 21445 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.515887 21522 raft_consensus.cc:2468] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 2.
I20260709 13:05:30.519224 21670 raft_consensus.cc:993] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8: : Instructing follower 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:30.519637 21670 raft_consensus.cc:1081] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Signalling peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:30.519059 21561 leader_election.cc:304] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:30.520939 21667 raft_consensus.cc:2804] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.521189 21447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:43096
I20260709 13:05:30.521428 21667 raft_consensus.cc:697] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 2 LEADER]: Becoming Leader. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:30.521744 21447 raft_consensus.cc:493] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.522083 21447 raft_consensus.cc:3060] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.522248 21667 consensus_queue.cc:237] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.526407 21446 raft_consensus.cc:2468] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 2.
I20260709 13:05:30.528507 21447 raft_consensus.cc:515] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.531243 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:30.531845 21522 raft_consensus.cc:3055] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.532183 21522 raft_consensus.cc:740] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:30.534600 21447 leader_election.cc:290] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 2 election: Requested vote from peers e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:30.534144 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:30.532368 21341 catalog_manager.cc:5697] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea reported cstate change: term changed from 1 to 2, leader changed from e2b0b8b156304ad890700786de9427e8 (127.20.208.2) to 553c493339cb4e2e88cc5539035f06ea (127.20.208.3). New cstate: current_term: 2 leader_uuid: "553c493339cb4e2e88cc5539035f06ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.535626 21522 consensus_queue.cc:260] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.536790 21445 raft_consensus.cc:515] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.537992 21522 raft_consensus.cc:3060] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.536803 21596 raft_consensus.cc:3060] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.540148 21445 leader_election.cc:290] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 2 election: Requested vote from peers e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:30.541723 21521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:30.542227 21521 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.546247 21596 raft_consensus.cc:2468] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 2.
I20260709 13:05:30.547300 21521 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 2.
I20260709 13:05:30.547397 21411 leader_election.cc:304] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:30.547668 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:30.548238 21595 raft_consensus.cc:3055] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.548619 21595 raft_consensus.cc:740] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:30.548799 21412 leader_election.cc:304] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:30.549592 21649 raft_consensus.cc:2804] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.549451 21595 consensus_queue.cc:260] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.548270 21722 raft_consensus.cc:2804] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.550755 21595 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.551182 21649 raft_consensus.cc:697] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Becoming Leader. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:30.551999 21649 consensus_queue.cc:237] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.557953 21646 raft_consensus.cc:993] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea: : Instructing follower e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:30.558441 21646 raft_consensus.cc:1081] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Signalling peer e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:30.560278 21520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "890cd37fd42e44b2a355362268083959"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43138
I20260709 13:05:30.560967 21520 raft_consensus.cc:493] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.561369 21520 raft_consensus.cc:3060] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.563295 21343 catalog_manager.cc:5697] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 reported cstate change: term changed from 1 to 2, leader changed from 553c493339cb4e2e88cc5539035f06ea (127.20.208.3) to 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.572322 21520 raft_consensus.cc:515] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.576967 21445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890cd37fd42e44b2a355362268083959" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:30.577862 21445 raft_consensus.cc:3060] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.564007 21595 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 2.
I20260709 13:05:30.586315 21520 leader_election.cc:290] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 2 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:30.588932 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890cd37fd42e44b2a355362268083959" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:30.589475 21722 raft_consensus.cc:697] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Becoming Leader. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:30.589751 21595 raft_consensus.cc:3055] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.590109 21595 raft_consensus.cc:740] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:30.590498 21722 consensus_queue.cc:237] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.591177 21595 consensus_queue.cc:260] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.592489 21595 raft_consensus.cc:3060] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.595113 21445 raft_consensus.cc:2468] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 2.
I20260709 13:05:30.596421 21487 leader_election.cc:304] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:30.593148 21522 raft_consensus.cc:2468] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 2.
I20260709 13:05:30.597249 21670 raft_consensus.cc:2804] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.600934 21670 raft_consensus.cc:697] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 2 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:30.601788 21670 consensus_queue.cc:237] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.604861 21343 catalog_manager.cc:5697] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 reported cstate change: term changed from 1 to 2, leader changed from e2b0b8b156304ad890700786de9427e8 (127.20.208.2) to 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.610222 21341 catalog_manager.cc:5697] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 1 to 2, leader changed from 553c493339cb4e2e88cc5539035f06ea (127.20.208.3) to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.612835 21595 raft_consensus.cc:2468] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 2.
I20260709 13:05:30.726881 21644 raft_consensus.cc:993] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8: : Instructing follower 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:30.727403 21644 raft_consensus.cc:1081] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Signalling peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:30.727077 21671 raft_consensus.cc:993] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8: : Instructing follower 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:30.728701 21671 raft_consensus.cc:1081] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Signalling peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:30.731084 21446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:43096
I20260709 13:05:30.731084 21447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff1cd2210abe461397347df2c882d656"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:43096
I20260709 13:05:30.731850 21446 raft_consensus.cc:493] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.731905 21447 raft_consensus.cc:493] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.732338 21446 raft_consensus.cc:3060] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.732389 21447 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.737241 21447 raft_consensus.cc:515] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.739253 21447 leader_election.cc:290] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 2 election: Requested vote from peers e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:30.739246 21446 raft_consensus.cc:515] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:30.740911 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1cd2210abe461397347df2c882d656" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:30.741153 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1cd2210abe461397347df2c882d656" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:30.741590 21595 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.741722 21522 raft_consensus.cc:3055] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.742089 21522 raft_consensus.cc:740] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:30.742987 21522 consensus_queue.cc:260] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.743620 21520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:30.744238 21520 raft_consensus.cc:3055] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.744591 21520 raft_consensus.cc:740] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:30.744740 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:30.745366 21596 raft_consensus.cc:3060] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.745412 21520 consensus_queue.cc:260] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:30.746894 21520 raft_consensus.cc:3060] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.748636 21522 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.748970 21595 raft_consensus.cc:2468] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 2.
I20260709 13:05:30.750203 21411 leader_election.cc:304] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:30.751121 21722 raft_consensus.cc:2804] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.751574 21722 raft_consensus.cc:697] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Becoming Leader. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:30.752384 21722 consensus_queue.cc:237] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.754271 21596 raft_consensus.cc:2468] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 2.
I20260709 13:05:30.755944 21522 raft_consensus.cc:2468] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 2.
I20260709 13:05:30.756866 21411 leader_election.cc:304] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:30.757910 21726 raft_consensus.cc:2804] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.758368 21726 raft_consensus.cc:697] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Becoming Leader. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:30.759169 21726 consensus_queue.cc:237] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:30.760622 21446 leader_election.cc:290] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 2 election: Requested vote from peers 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:30.761747 21520 raft_consensus.cc:2468] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 2.
I20260709 13:05:30.760890 21343 catalog_manager.cc:5697] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 reported cstate change: term changed from 1 to 2, leader changed from e2b0b8b156304ad890700786de9427e8 (127.20.208.2) to 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.774528 21343 catalog_manager.cc:5697] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 reported cstate change: term changed from 1 to 2, leader changed from e2b0b8b156304ad890700786de9427e8 (127.20.208.2) to 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.833297 21646 raft_consensus.cc:993] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea: : Instructing follower e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:30.833811 21667 raft_consensus.cc:1081] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Signalling peer e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:30.835456 21520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43138
I20260709 13:05:30.836100 21520 raft_consensus.cc:493] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.837040 21520 raft_consensus.cc:3060] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.841944 21520 raft_consensus.cc:515] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.843650 21520 leader_election.cc:290] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 2 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:30.844769 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:30.844843 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:30.845391 21596 raft_consensus.cc:3055] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.845422 21446 raft_consensus.cc:3060] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.845764 21596 raft_consensus.cc:740] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:30.846514 21596 consensus_queue.cc:260] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.847505 21596 raft_consensus.cc:3060] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.851703 21446 raft_consensus.cc:2468] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 2.
I20260709 13:05:30.851728 21596 raft_consensus.cc:2468] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 2.
I20260709 13:05:30.853029 21487 leader_election.cc:304] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:30.853669 21670 raft_consensus.cc:2804] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.854122 21670 raft_consensus.cc:697] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 2 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:30.854892 21670 consensus_queue.cc:237] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:30.861227 21343 catalog_manager.cc:5697] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 1 to 2, leader changed from 553c493339cb4e2e88cc5539035f06ea (127.20.208.3) to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.935318 21596 raft_consensus.cc:1275] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.936585 21726 consensus_queue.cc:1048] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.943990 21520 raft_consensus.cc:1275] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.946645 21722 consensus_queue.cc:1048] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.983666 21520 raft_consensus.cc:1275] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.984879 21649 consensus_queue.cc:1048] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.993046 21596 raft_consensus.cc:1275] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.994602 21726 consensus_queue.cc:1048] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.136467 21596 raft_consensus.cc:1275] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.137739 21670 consensus_queue.cc:1048] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.140910 21446 raft_consensus.cc:1275] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Refusing update from remote peer 553c493339cb4e2e88cc5539035f06ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.142360 21667 consensus_queue.cc:1048] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.146689 21447 raft_consensus.cc:1275] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.148506 21671 consensus_queue.cc:1048] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.154569 21520 raft_consensus.cc:1275] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Refusing update from remote peer 553c493339cb4e2e88cc5539035f06ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.156139 21667 consensus_queue.cc:1048] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.188431 21596 raft_consensus.cc:1275] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.189697 21726 consensus_queue.cc:1048] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.198021 21520 raft_consensus.cc:1275] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.199625 21725 consensus_queue.cc:1048] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.233870 21596 raft_consensus.cc:1275] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.235039 21725 consensus_queue.cc:1048] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.243281 21520 raft_consensus.cc:1275] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.245028 21726 consensus_queue.cc:1048] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.405791 21446 raft_consensus.cc:1275] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.407048 21670 consensus_queue.cc:1048] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.415272 21596 raft_consensus.cc:1275] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.417876 21670 consensus_queue.cc:1048] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:33.371526 21312 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:05:33.372402 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:33.390489 21520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abbfff84611444438e8527b4edf623a6"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
mode: GRACEFUL
new_leader_uuid: "553c493339cb4e2e88cc5539035f06ea"
 from {username='slave'} at 127.0.0.1:47020
I20260709 13:05:33.391001 21520 raft_consensus.cc:606] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Received request to transfer leadership to TS 553c493339cb4e2e88cc5539035f06ea
I20260709 13:05:33.401335 21446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
mode: GRACEFUL
new_leader_uuid: "553c493339cb4e2e88cc5539035f06ea"
 from {username='slave'} at 127.0.0.1:51384
I20260709 13:05:33.401996 21446 raft_consensus.cc:606] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Received request to transfer leadership to TS 553c493339cb4e2e88cc5539035f06ea
I20260709 13:05:33.403141 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:33.403549 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:33.682336 21743 raft_consensus.cc:993] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4: : Instructing follower 553c493339cb4e2e88cc5539035f06ea to start an election
I20260709 13:05:33.682794 21743 raft_consensus.cc:1081] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Signalling peer 553c493339cb4e2e88cc5539035f06ea to start an election
I20260709 13:05:33.684247 21595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e"
dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
 from {username='slave'} at 127.0.0.1:58038
I20260709 13:05:33.684756 21595 raft_consensus.cc:493] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.685042 21595 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.689524 21595 raft_consensus.cc:515] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:33.691248 21595 leader_election.cc:290] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 3 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:33.692049 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:33.692345 21520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:33.692664 21446 raft_consensus.cc:3055] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:33.692853 21520 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.692986 21446 raft_consensus.cc:740] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:33.693739 21446 consensus_queue.cc:260] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:33.694635 21446 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.697575 21520 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 3.
I20260709 13:05:33.698771 21561 leader_election.cc:304] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:33.699352 21446 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 3.
I20260709 13:05:33.699579 21747 raft_consensus.cc:2804] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:33.700807 21747 raft_consensus.cc:697] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 3 LEADER]: Becoming Leader. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:33.701491 21747 consensus_queue.cc:237] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:33.708869 21754 raft_consensus.cc:993] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8: : Instructing follower 553c493339cb4e2e88cc5539035f06ea to start an election
I20260709 13:05:33.709367 21746 raft_consensus.cc:1081] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Signalling peer 553c493339cb4e2e88cc5539035f06ea to start an election
I20260709 13:05:33.710856 21595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abbfff84611444438e8527b4edf623a6"
dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
 from {username='slave'} at 127.0.0.1:58024
I20260709 13:05:33.711328 21595 raft_consensus.cc:493] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.711623 21595 raft_consensus.cc:3060] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.711208 21341 catalog_manager.cc:5697] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea reported cstate change: term changed from 2 to 3, leader changed from 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1) to 553c493339cb4e2e88cc5539035f06ea (127.20.208.3). New cstate: current_term: 3 leader_uuid: "553c493339cb4e2e88cc5539035f06ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.717712 21595 raft_consensus.cc:515] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:33.719769 21595 leader_election.cc:290] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 2 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:33.720782 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbfff84611444438e8527b4edf623a6" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:33.721216 21520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbfff84611444438e8527b4edf623a6" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:33.721626 21446 raft_consensus.cc:3060] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.721845 21520 raft_consensus.cc:3055] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:33.722200 21520 raft_consensus.cc:740] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:33.722862 21520 consensus_queue.cc:260] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:33.723801 21520 raft_consensus.cc:3060] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.728700 21520 raft_consensus.cc:2468] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 2.
I20260709 13:05:33.729086 21446 raft_consensus.cc:2468] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 2.
I20260709 13:05:33.729987 21561 leader_election.cc:304] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:33.730966 21747 raft_consensus.cc:2804] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:33.731462 21747 raft_consensus.cc:697] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 2 LEADER]: Becoming Leader. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:33.732237 21747 consensus_queue.cc:237] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:33.739029 21341 catalog_manager.cc:5697] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea reported cstate change: term changed from 1 to 2, leader changed from e2b0b8b156304ad890700786de9427e8 (127.20.208.2) to 553c493339cb4e2e88cc5539035f06ea (127.20.208.3). New cstate: current_term: 2 leader_uuid: "553c493339cb4e2e88cc5539035f06ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.146132 21520 raft_consensus.cc:1275] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Refusing update from remote peer 553c493339cb4e2e88cc5539035f06ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.147380 21747 consensus_queue.cc:1048] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.156782 21446 raft_consensus.cc:1275] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Refusing update from remote peer 553c493339cb4e2e88cc5539035f06ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.158279 21752 consensus_queue.cc:1048] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.190564 21520 raft_consensus.cc:1275] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Refusing update from remote peer 553c493339cb4e2e88cc5539035f06ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.191773 21752 consensus_queue.cc:1048] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:34.200989 21446 raft_consensus.cc:1275] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Refusing update from remote peer 553c493339cb4e2e88cc5539035f06ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.203784 21766 consensus_queue.cc:1048] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:34.404384 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:34.423169 21446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
mode: GRACEFUL
new_leader_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:51392
I20260709 13:05:34.423705 21446 raft_consensus.cc:606] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Received request to transfer leadership to TS e2b0b8b156304ad890700786de9427e8
I20260709 13:05:34.428416 21446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
mode: GRACEFUL
new_leader_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:51392
I20260709 13:05:34.428911 21446 raft_consensus.cc:606] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Received request to transfer leadership to TS e2b0b8b156304ad890700786de9427e8
I20260709 13:05:34.433498 21595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e"
dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
mode: GRACEFUL
new_leader_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:05:34.433996 21595 raft_consensus.cc:606] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 3 LEADER]: Received request to transfer leadership to TS e2b0b8b156304ad890700786de9427e8
I20260709 13:05:34.438549 21446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1cd2210abe461397347df2c882d656"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
mode: GRACEFUL
new_leader_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:51392
I20260709 13:05:34.439082 21446 raft_consensus.cc:606] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Received request to transfer leadership to TS e2b0b8b156304ad890700786de9427e8
I20260709 13:05:34.450445 21595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abbfff84611444438e8527b4edf623a6"
dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
mode: GRACEFUL
new_leader_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:05:34.450930 21595 raft_consensus.cc:606] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 2 LEADER]: Received request to transfer leadership to TS e2b0b8b156304ad890700786de9427e8
I20260709 13:05:34.611511 21743 raft_consensus.cc:993] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: : Instructing follower e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:34.611907 21770 raft_consensus.cc:1081] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Signalling peer e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:34.613481 21520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff1cd2210abe461397347df2c882d656"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43142
I20260709 13:05:34.613962 21520 raft_consensus.cc:493] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.614228 21520 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.618553 21520 raft_consensus.cc:515] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.620126 21520 leader_election.cc:290] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 3 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:34.620919 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1cd2210abe461397347df2c882d656" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:34.621111 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1cd2210abe461397347df2c882d656" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:34.621451 21446 raft_consensus.cc:3055] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.621634 21595 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.621778 21446 raft_consensus.cc:740] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:34.622505 21446 consensus_queue.cc:260] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.623363 21446 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.626150 21595 raft_consensus.cc:2468] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 3.
I20260709 13:05:34.627348 21486 leader_election.cc:304] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:34.628027 21754 raft_consensus.cc:2804] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.627986 21446 raft_consensus.cc:2468] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 3.
I20260709 13:05:34.628624 21754 raft_consensus.cc:697] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:34.629400 21754 consensus_queue.cc:237] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.636595 21341 catalog_manager.cc:5697] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 2 to 3, leader changed from 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1) to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.641772 21743 raft_consensus.cc:993] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: : Instructing follower e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:34.642220 21770 raft_consensus.cc:1081] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Signalling peer e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:34.643890 21520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43142
I20260709 13:05:34.644384 21520 raft_consensus.cc:493] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.644809 21520 raft_consensus.cc:3060] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.650236 21520 raft_consensus.cc:515] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:34.651728 21520 leader_election.cc:290] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 3 election: Requested vote from peers 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191), 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033)
I20260709 13:05:34.652590 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:34.652681 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46799ac44b3492c8b5d3928270ca263" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:34.653115 21595 raft_consensus.cc:3060] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.653152 21446 raft_consensus.cc:3055] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.653473 21446 raft_consensus.cc:740] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:34.654052 21446 consensus_queue.cc:260] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:34.654879 21446 raft_consensus.cc:3060] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.658142 21595 raft_consensus.cc:2468] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 3.
I20260709 13:05:34.659235 21446 raft_consensus.cc:2468] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 3.
I20260709 13:05:34.659251 21486 leader_election.cc:304] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:34.660112 21754 raft_consensus.cc:2804] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.660537 21754 raft_consensus.cc:697] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:34.661201 21754 consensus_queue.cc:237] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } }
I20260709 13:05:34.667413 21341 catalog_manager.cc:5697] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 2 to 3, leader changed from 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1) to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.687896 21747 raft_consensus.cc:993] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea: : Instructing follower e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:34.688356 21766 raft_consensus.cc:1081] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 3 LEADER]: Signalling peer e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:34.689867 21520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43138
I20260709 13:05:34.690375 21520 raft_consensus.cc:493] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.690673 21520 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.695255 21520 raft_consensus.cc:515] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.696952 21520 leader_election.cc:290] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 4 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:34.698076 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:34.698119 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:34.698764 21595 raft_consensus.cc:3055] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:34.698809 21446 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.699123 21595 raft_consensus.cc:740] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:34.699883 21595 consensus_queue.cc:260] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.700838 21595 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.704104 21446 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 4.
I20260709 13:05:34.705296 21487 leader_election.cc:304] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:34.705750 21595 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 4.
I20260709 13:05:34.705978 21754 raft_consensus.cc:2804] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:34.706487 21754 raft_consensus.cc:697] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 4 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:34.707361 21754 consensus_queue.cc:237] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.713020 21341 catalog_manager.cc:5697] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 3 to 4, leader changed from 553c493339cb4e2e88cc5539035f06ea (127.20.208.3) to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 4 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.764269 21747 raft_consensus.cc:993] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea: : Instructing follower e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:34.764734 21766 raft_consensus.cc:1081] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 2 LEADER]: Signalling peer e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:34.766059 21520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abbfff84611444438e8527b4edf623a6"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43138
I20260709 13:05:34.766505 21520 raft_consensus.cc:493] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.766786 21520 raft_consensus.cc:3060] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.770807 21520 raft_consensus.cc:515] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.772246 21520 leader_election.cc:290] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 3 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:34.773187 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbfff84611444438e8527b4edf623a6" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:34.773345 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbfff84611444438e8527b4edf623a6" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:34.773661 21446 raft_consensus.cc:3060] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.773839 21595 raft_consensus.cc:3055] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.774139 21595 raft_consensus.cc:740] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:34.774782 21595 consensus_queue.cc:260] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.775882 21595 raft_consensus.cc:3060] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.778754 21446 raft_consensus.cc:2468] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 3.
I20260709 13:05:34.779850 21487 leader_election.cc:304] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:34.780539 21754 raft_consensus.cc:2804] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.780920 21754 raft_consensus.cc:697] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:34.781097 21595 raft_consensus.cc:2468] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 3.
I20260709 13:05:34.781649 21754 consensus_queue.cc:237] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.787819 21341 catalog_manager.cc:5697] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 2 to 3, leader changed from 553c493339cb4e2e88cc5539035f06ea (127.20.208.3) to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.973567 21743 raft_consensus.cc:993] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4: : Instructing follower e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:34.974015 21770 raft_consensus.cc:1081] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Signalling peer e2b0b8b156304ad890700786de9427e8 to start an election
I20260709 13:05:34.975529 21520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
 from {username='slave'} at 127.0.0.1:43142
I20260709 13:05:34.975997 21520 raft_consensus.cc:493] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.976264 21520 raft_consensus.cc:3060] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.980405 21520 raft_consensus.cc:515] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.981928 21520 leader_election.cc:290] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 3 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:34.982725 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:34.982935 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ada68483f624db98f8c9b99332a39ec" candidate_uuid: "e2b0b8b156304ad890700786de9427e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:34.983309 21446 raft_consensus.cc:3055] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.983433 21595 raft_consensus.cc:3060] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.983624 21446 raft_consensus.cc:740] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:34.984359 21446 consensus_queue.cc:260] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.985313 21446 raft_consensus.cc:3060] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.988257 21595 raft_consensus.cc:2468] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 3.
I20260709 13:05:34.989317 21486 leader_election.cc:304] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553c493339cb4e2e88cc5539035f06ea, e2b0b8b156304ad890700786de9427e8; no voters: 
I20260709 13:05:34.989545 21446 raft_consensus.cc:2468] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b0b8b156304ad890700786de9427e8 in term 3.
I20260709 13:05:34.989987 21754 raft_consensus.cc:2804] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.990483 21754 raft_consensus.cc:697] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Becoming Leader. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:34.991164 21754 consensus_queue.cc:237] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:34.997174 21341 catalog_manager.cc:5697] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 reported cstate change: term changed from 2 to 3, leader changed from 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1) to e2b0b8b156304ad890700786de9427e8 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "e2b0b8b156304ad890700786de9427e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.056516 21595 raft_consensus.cc:1275] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.057475 21596 raft_consensus.cc:1275] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.057785 21754 consensus_queue.cc:1048] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.058832 21746 consensus_queue.cc:1048] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.074752 21446 raft_consensus.cc:1275] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.076356 21754 consensus_queue.cc:1048] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.086581 21447 raft_consensus.cc:1275] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.088033 21781 consensus_queue.cc:1048] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.161027 21447 raft_consensus.cc:1275] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 4 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:35.162417 21781 consensus_queue.cc:1048] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:35.169757 21596 raft_consensus.cc:1275] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 4 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:35.171255 21754 consensus_queue.cc:1048] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:35.267989 21447 raft_consensus.cc:1275] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.269248 21754 consensus_queue.cc:1048] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.277052 21596 raft_consensus.cc:1275] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.279074 21754 consensus_queue.cc:1048] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.567350 21596 raft_consensus.cc:1275] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.568498 21781 consensus_queue.cc:1048] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.579157 21447 raft_consensus.cc:1275] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Refusing update from remote peer e2b0b8b156304ad890700786de9427e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.580853 21754 consensus_queue.cc:1048] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.455400 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:37.463078 21520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "890cd37fd42e44b2a355362268083959"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
mode: GRACEFUL
new_leader_uuid: "553c493339cb4e2e88cc5539035f06ea"
 from {username='slave'} at 127.0.0.1:47020
I20260709 13:05:37.463737 21520 raft_consensus.cc:606] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 2 LEADER]: Received request to transfer leadership to TS 553c493339cb4e2e88cc5539035f06ea
I20260709 13:05:37.466427 21520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
mode: GRACEFUL
new_leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:47020
I20260709 13:05:37.466895 21520 raft_consensus.cc:606] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 2 LEADER]: Received request to transfer leadership to TS 0f6b44d51d6840e0b8d60cbd8fd2afd4
I20260709 13:05:37.469156 21520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dabe3609ae1641e8b814b1d861589931"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
mode: GRACEFUL
new_leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:47020
I20260709 13:05:37.469580 21520 raft_consensus.cc:606] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Received request to transfer leadership to TS 0f6b44d51d6840e0b8d60cbd8fd2afd4
I20260709 13:05:37.471625 21520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
mode: GRACEFUL
new_leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:47020
I20260709 13:05:37.472023 21520 raft_consensus.cc:606] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 4 LEADER]: Received request to transfer leadership to TS 0f6b44d51d6840e0b8d60cbd8fd2afd4
I20260709 13:05:37.474052 21520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1cd2210abe461397347df2c882d656"
dest_uuid: "e2b0b8b156304ad890700786de9427e8"
mode: GRACEFUL
new_leader_uuid: "553c493339cb4e2e88cc5539035f06ea"
 from {username='slave'} at 127.0.0.1:47020
I20260709 13:05:37.474437 21520 raft_consensus.cc:606] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Received request to transfer leadership to TS 553c493339cb4e2e88cc5539035f06ea
I20260709 13:05:37.475346 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:37.475764 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:37.501458 21754 raft_consensus.cc:993] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8: : Instructing follower 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:37.501955 21790 raft_consensus.cc:1081] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Signalling peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:37.503499 21447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dabe3609ae1641e8b814b1d861589931"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:43096
I20260709 13:05:37.503949 21447 raft_consensus.cc:493] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.504254 21447 raft_consensus.cc:3060] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.509330 21447 raft_consensus.cc:515] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.511149 21447 leader_election.cc:290] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 2 election: Requested vote from peers e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:37.512014 21520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabe3609ae1641e8b814b1d861589931" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:37.512373 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabe3609ae1641e8b814b1d861589931" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:37.512742 21520 raft_consensus.cc:3055] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.512879 21596 raft_consensus.cc:3060] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.513003 21520 raft_consensus.cc:740] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:37.513739 21520 consensus_queue.cc:260] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.514611 21520 raft_consensus.cc:3060] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.517443 21596 raft_consensus.cc:2468] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 2.
I20260709 13:05:37.518676 21411 leader_election.cc:304] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:37.519862 21520 raft_consensus.cc:2468] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 2.
I20260709 13:05:37.520318 21791 raft_consensus.cc:2804] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:37.521552 21791 raft_consensus.cc:697] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Becoming Leader. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:37.522411 21791 consensus_queue.cc:237] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.529692 21340 catalog_manager.cc:5697] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 reported cstate change: term changed from 1 to 2, leader changed from e2b0b8b156304ad890700786de9427e8 (127.20.208.2) to 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.659448 21754 raft_consensus.cc:993] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8: : Instructing follower 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:37.659873 21790 raft_consensus.cc:1081] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 4 LEADER]: Signalling peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:37.661267 21447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:43096
I20260709 13:05:37.661782 21447 raft_consensus.cc:493] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.662050 21447 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.666316 21447 raft_consensus.cc:515] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.667699 21447 leader_election.cc:290] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 5 election: Requested vote from peers e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:37.668644 21520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:37.668622 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ce8a46cb74a9891137c76958cb72e" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:37.669319 21596 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.669283 21520 raft_consensus.cc:3055] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:37.669764 21520 raft_consensus.cc:740] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:37.670521 21520 consensus_queue.cc:260] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.671646 21520 raft_consensus.cc:3060] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.675395 21596 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 5.
I20260709 13:05:37.676539 21411 leader_election.cc:304] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:37.677325 21791 raft_consensus.cc:2804] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:37.677531 21520 raft_consensus.cc:2468] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 5.
I20260709 13:05:37.677736 21791 raft_consensus.cc:697] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 5 LEADER]: Becoming Leader. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:37.678953 21791 consensus_queue.cc:237] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.685633 21340 catalog_manager.cc:5697] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 reported cstate change: term changed from 4 to 5, leader changed from e2b0b8b156304ad890700786de9427e8 (127.20.208.2) to 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1). New cstate: current_term: 5 leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.728847 21754 raft_consensus.cc:993] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8: : Instructing follower 553c493339cb4e2e88cc5539035f06ea to start an election
I20260709 13:05:37.729277 21790 raft_consensus.cc:1081] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 2 LEADER]: Signalling peer 553c493339cb4e2e88cc5539035f06ea to start an election
I20260709 13:05:37.730664 21596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "890cd37fd42e44b2a355362268083959"
dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
 from {username='slave'} at 127.0.0.1:58024
I20260709 13:05:37.731078 21596 raft_consensus.cc:493] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.731343 21596 raft_consensus.cc:3060] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.735378 21596 raft_consensus.cc:515] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.736881 21596 leader_election.cc:290] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 3 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:37.737823 21447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890cd37fd42e44b2a355362268083959" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:37.738125 21520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890cd37fd42e44b2a355362268083959" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:37.738330 21447 raft_consensus.cc:3060] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.738597 21520 raft_consensus.cc:3055] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:37.738863 21520 raft_consensus.cc:740] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:37.739408 21520 consensus_queue.cc:260] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.740231 21520 raft_consensus.cc:3060] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.742702 21447 raft_consensus.cc:2468] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 3.
I20260709 13:05:37.743826 21561 leader_election.cc:304] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:37.744127 21520 raft_consensus.cc:2468] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 3.
I20260709 13:05:37.744699 21766 raft_consensus.cc:2804] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:37.745843 21766 raft_consensus.cc:697] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 3 LEADER]: Becoming Leader. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:37.746731 21766 consensus_queue.cc:237] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.753782 21340 catalog_manager.cc:5697] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea reported cstate change: term changed from 2 to 3, leader changed from e2b0b8b156304ad890700786de9427e8 (127.20.208.2) to 553c493339cb4e2e88cc5539035f06ea (127.20.208.3). New cstate: current_term: 3 leader_uuid: "553c493339cb4e2e88cc5539035f06ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.802055 21754 raft_consensus.cc:993] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8: : Instructing follower 553c493339cb4e2e88cc5539035f06ea to start an election
I20260709 13:05:37.802524 21754 raft_consensus.cc:1081] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Signalling peer 553c493339cb4e2e88cc5539035f06ea to start an election
I20260709 13:05:37.804044 21754 raft_consensus.cc:993] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8: : Instructing follower 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:37.804171 21596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff1cd2210abe461397347df2c882d656"
dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
 from {username='slave'} at 127.0.0.1:58024
I20260709 13:05:37.804566 21801 raft_consensus.cc:1081] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 2 LEADER]: Signalling peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 to start an election
I20260709 13:05:37.804728 21596 raft_consensus.cc:493] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.805081 21596 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.806120 21447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429"
dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
 from {username='slave'} at 127.0.0.1:43096
I20260709 13:05:37.806645 21447 raft_consensus.cc:493] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.806967 21447 raft_consensus.cc:3060] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.811240 21596 raft_consensus.cc:515] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.812958 21447 raft_consensus.cc:515] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.813315 21596 leader_election.cc:290] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 4 election: Requested vote from peers 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033), e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151)
I20260709 13:05:37.814073 21446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1cd2210abe461397347df2c882d656" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4"
I20260709 13:05:37.814306 21520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1cd2210abe461397347df2c882d656" candidate_uuid: "553c493339cb4e2e88cc5539035f06ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:37.814702 21446 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.814818 21520 raft_consensus.cc:3055] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:37.815554 21447 leader_election.cc:290] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 3 election: Requested vote from peers e2b0b8b156304ad890700786de9427e8 (127.20.208.2:40151), 553c493339cb4e2e88cc5539035f06ea (127.20.208.3:35191)
I20260709 13:05:37.816043 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "553c493339cb4e2e88cc5539035f06ea"
I20260709 13:05:37.816160 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a0c4435ea44bac9b57b5322e90c429" candidate_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2b0b8b156304ad890700786de9427e8"
I20260709 13:05:37.816596 21596 raft_consensus.cc:3060] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.816692 21522 raft_consensus.cc:3055] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:37.815608 21520 raft_consensus.cc:740] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:37.817013 21522 raft_consensus.cc:740] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2b0b8b156304ad890700786de9427e8, State: Running, Role: LEADER
I20260709 13:05:37.817915 21520 consensus_queue.cc:260] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.818028 21522 consensus_queue.cc:260] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.819181 21520 raft_consensus.cc:3060] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.819345 21522 raft_consensus.cc:3060] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.821512 21446 raft_consensus.cc:2468] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 4.
I20260709 13:05:37.822682 21561 leader_election.cc:304] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:37.823004 21596 raft_consensus.cc:2468] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 3.
I20260709 13:05:37.823573 21766 raft_consensus.cc:2804] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:37.824193 21766 raft_consensus.cc:697] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 4 LEADER]: Becoming Leader. State: Replica: 553c493339cb4e2e88cc5539035f06ea, State: Running, Role: LEADER
I20260709 13:05:37.824745 21411 leader_election.cc:304] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6b44d51d6840e0b8d60cbd8fd2afd4, 553c493339cb4e2e88cc5539035f06ea; no voters: 
I20260709 13:05:37.825109 21766 consensus_queue.cc:237] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.825693 21791 raft_consensus.cc:2804] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:37.826212 21791 raft_consensus.cc:697] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 LEADER]: Becoming Leader. State: Replica: 0f6b44d51d6840e0b8d60cbd8fd2afd4, State: Running, Role: LEADER
I20260709 13:05:37.826735 21522 raft_consensus.cc:2468] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f6b44d51d6840e0b8d60cbd8fd2afd4 in term 3.
I20260709 13:05:37.827147 21791 consensus_queue.cc:237] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } }
I20260709 13:05:37.828189 21520 raft_consensus.cc:2468] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 553c493339cb4e2e88cc5539035f06ea in term 4.
I20260709 13:05:37.835088 21340 catalog_manager.cc:5697] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea reported cstate change: term changed from 3 to 4, leader changed from e2b0b8b156304ad890700786de9427e8 (127.20.208.2) to 553c493339cb4e2e88cc5539035f06ea (127.20.208.3). New cstate: current_term: 4 leader_uuid: "553c493339cb4e2e88cc5539035f06ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.837121 21341 catalog_manager.cc:5697] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 reported cstate change: term changed from 2 to 3, leader changed from e2b0b8b156304ad890700786de9427e8 (127.20.208.2) to 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.906684 21595 raft_consensus.cc:1275] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:37.908313 21791 consensus_queue.cc:1048] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:37.918685 21520 raft_consensus.cc:1275] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:37.920310 21791 consensus_queue.cc:1048] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.148533 21595 raft_consensus.cc:1275] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 5 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:38.149793 21791 consensus_queue.cc:1048] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.158442 21520 raft_consensus.cc:1275] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 5 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:38.160645 21810 consensus_queue.cc:1048] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:38.235687 21446 raft_consensus.cc:1275] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 4 FOLLOWER]: Refusing update from remote peer 553c493339cb4e2e88cc5539035f06ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:38.236968 21766 consensus_queue.cc:1048] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.246390 21520 raft_consensus.cc:1275] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 4 FOLLOWER]: Refusing update from remote peer 553c493339cb4e2e88cc5539035f06ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:38.248529 21766 consensus_queue.cc:1048] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.263970 21520 raft_consensus.cc:1275] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Refusing update from remote peer 553c493339cb4e2e88cc5539035f06ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.265218 21766 consensus_queue.cc:1048] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:38.275965 21446 raft_consensus.cc:1275] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Refusing update from remote peer 553c493339cb4e2e88cc5539035f06ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.277365 21813 consensus_queue.cc:1048] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6b44d51d6840e0b8d60cbd8fd2afd4" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:38.305375 21595 raft_consensus.cc:1275] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.306690 21810 consensus_queue.cc:1048] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553c493339cb4e2e88cc5539035f06ea" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:38.307557 21520 raft_consensus.cc:1275] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Refusing update from remote peer 0f6b44d51d6840e0b8d60cbd8fd2afd4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.308768 21810 consensus_queue.cc:1048] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b0b8b156304ad890700786de9427e8" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:38.476629 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:38.482117 21312 tablet_server.cc:179] TabletServer@127.20.208.1:0 shutting down...
I20260709 13:05:38.505489 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.506466 21312 tablet_replica.cc:333] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4: stopping tablet replica
I20260709 13:05:38.507265 21312 raft_consensus.cc:2243] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.508198 21312 raft_consensus.cc:2272] T e35ce8a46cb74a9891137c76958cb72e P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:38.508853 21487 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:38.512692 21487 consensus_peers.cc:597] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 -> Peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033): Couldn't send request to peer 0f6b44d51d6840e0b8d60cbd8fd2afd4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.512786 21312 tablet_replica.cc:333] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4: stopping tablet replica
I20260709 13:05:38.513319 21312 raft_consensus.cc:2243] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.513737 21312 raft_consensus.cc:2272] T bdb72965fcf3409d970349085b4b982d P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.515439 21312 tablet_replica.cc:333] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4: stopping tablet replica
I20260709 13:05:38.515924 21312 raft_consensus.cc:2243] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.516312 21312 raft_consensus.cc:2272] T 7ada68483f624db98f8c9b99332a39ec P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.517912 21312 tablet_replica.cc:333] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: stopping tablet replica
I20260709 13:05:38.518383 21312 raft_consensus.cc:2243] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.519068 21312 raft_consensus.cc:2272] T dabe3609ae1641e8b814b1d861589931 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.521171 21312 tablet_replica.cc:333] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: stopping tablet replica
I20260709 13:05:38.521706 21312 raft_consensus.cc:2243] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.522378 21312 raft_consensus.cc:2272] T a5a0c4435ea44bac9b57b5322e90c429 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.524258 21312 tablet_replica.cc:333] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: stopping tablet replica
I20260709 13:05:38.524839 21312 raft_consensus.cc:2243] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.525264 21312 raft_consensus.cc:2272] T abbfff84611444438e8527b4edf623a6 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.526933 21312 tablet_replica.cc:333] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: stopping tablet replica
I20260709 13:05:38.527395 21312 raft_consensus.cc:2243] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.527812 21312 raft_consensus.cc:2272] T 890cd37fd42e44b2a355362268083959 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.529883 21312 tablet_replica.cc:333] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: stopping tablet replica
I20260709 13:05:38.530370 21312 raft_consensus.cc:2243] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.530814 21312 raft_consensus.cc:2272] T ff1cd2210abe461397347df2c882d656 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.533088 21312 tablet_replica.cc:333] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4: stopping tablet replica
I20260709 13:05:38.533526 21312 raft_consensus.cc:2243] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.533931 21312 raft_consensus.cc:2272] T d46799ac44b3492c8b5d3928270ca263 P 0f6b44d51d6840e0b8d60cbd8fd2afd4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.623199 21312 tablet_server.cc:196] TabletServer@127.20.208.1:0 shutdown complete.
I20260709 13:05:38.641091 21312 tablet_server.cc:179] TabletServer@127.20.208.2:0 shutting down...
I20260709 13:05:38.662384 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.663020 21312 tablet_replica.cc:333] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8: stopping tablet replica
I20260709 13:05:38.663591 21312 raft_consensus.cc:2243] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.664067 21312 raft_consensus.cc:2272] T bdb72965fcf3409d970349085b4b982d P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.665884 21312 tablet_replica.cc:333] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8: stopping tablet replica
I20260709 13:05:38.666369 21312 raft_consensus.cc:2243] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.666745 21312 raft_consensus.cc:2272] T 890cd37fd42e44b2a355362268083959 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.668740 21312 tablet_replica.cc:333] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8: stopping tablet replica
I20260709 13:05:38.669207 21312 raft_consensus.cc:2243] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.669564 21312 raft_consensus.cc:2272] T e35ce8a46cb74a9891137c76958cb72e P e2b0b8b156304ad890700786de9427e8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.671797 21312 tablet_replica.cc:333] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8: stopping tablet replica
I20260709 13:05:38.672266 21312 raft_consensus.cc:2243] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.672739 21312 raft_consensus.cc:2272] T dabe3609ae1641e8b814b1d861589931 P e2b0b8b156304ad890700786de9427e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.674634 21312 tablet_replica.cc:333] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8: stopping tablet replica
I20260709 13:05:38.675091 21312 raft_consensus.cc:2243] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.675450 21312 raft_consensus.cc:2272] T a5a0c4435ea44bac9b57b5322e90c429 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.677380 21312 tablet_replica.cc:333] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8: stopping tablet replica
I20260709 13:05:38.677826 21312 raft_consensus.cc:2243] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.678488 21312 raft_consensus.cc:2272] T 7ada68483f624db98f8c9b99332a39ec P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.680112 21312 tablet_replica.cc:333] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8: stopping tablet replica
I20260709 13:05:38.680590 21312 raft_consensus.cc:2243] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.681322 21312 raft_consensus.cc:2272] T abbfff84611444438e8527b4edf623a6 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.683414 21312 tablet_replica.cc:333] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8: stopping tablet replica
I20260709 13:05:38.683843 21312 raft_consensus.cc:2243] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.684190 21312 raft_consensus.cc:2272] T ff1cd2210abe461397347df2c882d656 P e2b0b8b156304ad890700786de9427e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.686058 21312 tablet_replica.cc:333] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8: stopping tablet replica
I20260709 13:05:38.686475 21312 raft_consensus.cc:2243] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.687182 21312 raft_consensus.cc:2272] T d46799ac44b3492c8b5d3928270ca263 P e2b0b8b156304ad890700786de9427e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.713418 21312 tablet_server.cc:196] TabletServer@127.20.208.2:0 shutdown complete.
I20260709 13:05:38.729274 21312 tablet_server.cc:179] TabletServer@127.20.208.3:0 shutting down...
I20260709 13:05:38.748998 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.749725 21312 tablet_replica.cc:333] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea: stopping tablet replica
I20260709 13:05:38.750425 21312 raft_consensus.cc:2243] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.751112 21312 raft_consensus.cc:2272] T bdb72965fcf3409d970349085b4b982d P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.753422 21312 tablet_replica.cc:333] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea: stopping tablet replica
I20260709 13:05:38.753979 21312 raft_consensus.cc:2243] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.754417 21312 raft_consensus.cc:2272] T e35ce8a46cb74a9891137c76958cb72e P 553c493339cb4e2e88cc5539035f06ea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.756788 21312 tablet_replica.cc:333] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea: stopping tablet replica
I20260709 13:05:38.757344 21312 raft_consensus.cc:2243] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.757817 21312 raft_consensus.cc:2272] T abbfff84611444438e8527b4edf623a6 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.759568 21312 tablet_replica.cc:333] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea: stopping tablet replica
I20260709 13:05:38.760205 21312 raft_consensus.cc:2243] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.760759 21312 raft_consensus.cc:2272] T dabe3609ae1641e8b814b1d861589931 P 553c493339cb4e2e88cc5539035f06ea [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:38.760964 21561 consensus_peers.cc:597] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea -> Peer 0f6b44d51d6840e0b8d60cbd8fd2afd4 (127.20.208.1:38033): Couldn't send request to peer 0f6b44d51d6840e0b8d60cbd8fd2afd4. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:38033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.762712 21312 tablet_replica.cc:333] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea: stopping tablet replica
I20260709 13:05:38.763206 21312 raft_consensus.cc:2243] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.763566 21312 raft_consensus.cc:2272] T a5a0c4435ea44bac9b57b5322e90c429 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.765518 21312 tablet_replica.cc:333] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea: stopping tablet replica
I20260709 13:05:38.765961 21312 raft_consensus.cc:2243] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.766619 21312 raft_consensus.cc:2272] T 890cd37fd42e44b2a355362268083959 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.768546 21312 tablet_replica.cc:333] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea: stopping tablet replica
I20260709 13:05:38.768970 21312 raft_consensus.cc:2243] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.769622 21312 raft_consensus.cc:2272] T ff1cd2210abe461397347df2c882d656 P 553c493339cb4e2e88cc5539035f06ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.771389 21312 tablet_replica.cc:333] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea: stopping tablet replica
I20260709 13:05:38.771818 21312 raft_consensus.cc:2243] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.772215 21312 raft_consensus.cc:2272] T d46799ac44b3492c8b5d3928270ca263 P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.773963 21312 tablet_replica.cc:333] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea: stopping tablet replica
I20260709 13:05:38.774415 21312 raft_consensus.cc:2243] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.774816 21312 raft_consensus.cc:2272] T 7ada68483f624db98f8c9b99332a39ec P 553c493339cb4e2e88cc5539035f06ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.800889 21312 tablet_server.cc:196] TabletServer@127.20.208.3:0 shutdown complete.
I20260709 13:05:38.817059 21312 master.cc:562] Master@127.20.208.62:43357 shutting down...
I20260709 13:05:38.883826 21399 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:05:38.958632 21312 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.959183 21312 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.959514 21312 tablet_replica.cc:333] T 00000000000000000000000000000000 P d8e3c10c03494309a51c139803519c6c: stopping tablet replica
I20260709 13:05:38.978873 21312 master.cc:584] Master@127.20.208.62:43357 shutdown complete.
0f6b44d51d6840e0b8d60cbd8fd2afd4  4
553c493339cb4e2e88cc5539035f06ea  1
e2b0b8b156304ad890700786de9427e8  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12442 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:05:39.015664 21312 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.208.62:37955
I20260709 13:05:39.016830 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.022006 21824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.022060 21823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.023736 21826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.024392 21312 server_base.cc:1061] running on GCE node
I20260709 13:05:39.025224 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.025458 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.025632 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602339025606 us; error 0 us; skew 500 ppm
I20260709 13:05:39.026149 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.028517 21312 webserver.cc:533] Webserver started at http://127.20.208.62:34907/ using document root <none> and password file <none>
I20260709 13:05:39.029021 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.029206 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.029461 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.030576 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/master-0-root/instance:
uuid: "77ad3b4116ad4d46bfb9f09646879145"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-6j4g"
I20260709 13:05:39.034909 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:05:39.038412 21831 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.039142 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:39.039427 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/master-0-root
uuid: "77ad3b4116ad4d46bfb9f09646879145"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-6j4g"
I20260709 13:05:39.039717 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.060137 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.061414 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.098850 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.62:37955
I20260709 13:05:39.098927 21882 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.62:37955 every 8 connection(s)
I20260709 13:05:39.102738 21883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.112284 21883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145: Bootstrap starting.
I20260709 13:05:39.116905 21883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.121101 21883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145: No bootstrap required, opened a new log
I20260709 13:05:39.123255 21883 raft_consensus.cc:359] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ad3b4116ad4d46bfb9f09646879145" member_type: VOTER }
I20260709 13:05:39.123639 21883 raft_consensus.cc:385] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.123816 21883 raft_consensus.cc:740] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ad3b4116ad4d46bfb9f09646879145, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.124303 21883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ad3b4116ad4d46bfb9f09646879145" member_type: VOTER }
I20260709 13:05:39.124742 21883 raft_consensus.cc:399] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:39.124938 21883 raft_consensus.cc:493] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:39.125156 21883 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.129204 21883 raft_consensus.cc:515] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ad3b4116ad4d46bfb9f09646879145" member_type: VOTER }
I20260709 13:05:39.129716 21883 leader_election.cc:304] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77ad3b4116ad4d46bfb9f09646879145; no voters: 
I20260709 13:05:39.130836 21883 leader_election.cc:290] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:39.131142 21886 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.132408 21886 raft_consensus.cc:697] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 1 LEADER]: Becoming Leader. State: Replica: 77ad3b4116ad4d46bfb9f09646879145, State: Running, Role: LEADER
I20260709 13:05:39.133203 21886 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ad3b4116ad4d46bfb9f09646879145" member_type: VOTER }
I20260709 13:05:39.133723 21883 sys_catalog.cc:565] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:39.137565 21887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77ad3b4116ad4d46bfb9f09646879145" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ad3b4116ad4d46bfb9f09646879145" member_type: VOTER } }
I20260709 13:05:39.138023 21888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77ad3b4116ad4d46bfb9f09646879145. Latest consensus state: current_term: 1 leader_uuid: "77ad3b4116ad4d46bfb9f09646879145" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ad3b4116ad4d46bfb9f09646879145" member_type: VOTER } }
I20260709 13:05:39.138545 21887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:39.138813 21888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:39.142119 21893 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:39.147850 21893 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:39.152275 21312 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:39.157045 21893 catalog_manager.cc:1383] Generated new cluster ID: d94b915d7bff4c4b8c75b8afb837f798
I20260709 13:05:39.157338 21893 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:39.187372 21893 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:39.188715 21893 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:39.200290 21893 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145: Generated new TSK 0
I20260709 13:05:39.200930 21893 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:39.218619 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.224707 21904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.224977 21905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.227089 21312 server_base.cc:1061] running on GCE node
W20260709 13:05:39.227056 21907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.228276 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.228538 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.228725 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602339228696 us; error 0 us; skew 500 ppm
I20260709 13:05:39.229230 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.231518 21312 webserver.cc:533] Webserver started at http://127.20.208.1:45927/ using document root <none> and password file <none>
I20260709 13:05:39.232031 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.232203 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.232501 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.233570 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-0-root/instance:
uuid: "150d714edd0d4abd9846b82908a3f9d2"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-6j4g"
I20260709 13:05:39.238194 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:39.241933 21912 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.242714 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:05:39.243027 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-0-root
uuid: "150d714edd0d4abd9846b82908a3f9d2"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-6j4g"
I20260709 13:05:39.243310 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.264349 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.265668 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.267181 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.269510 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.269776 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.270063 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.270299 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.309231 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.1:46495
I20260709 13:05:39.309331 21974 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.1:46495 every 8 connection(s)
I20260709 13:05:39.313962 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.321226 21979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.321746 21980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.325546 21312 server_base.cc:1061] running on GCE node
W20260709 13:05:39.325645 21983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.326644 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.326853 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.327024 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602339327005 us; error 0 us; skew 500 ppm
I20260709 13:05:39.327548 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.330288 21312 webserver.cc:533] Webserver started at http://127.20.208.2:44495/ using document root <none> and password file <none>
I20260709 13:05:39.330886 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.331104 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.331423 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.332235 21975 heartbeater.cc:344] Connected to a master server at 127.20.208.62:37955
I20260709 13:05:39.332588 21975 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.332810 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-1-root/instance:
uuid: "bd27a2d35b9e4722825b35bba658dc15"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-6j4g"
I20260709 13:05:39.333278 21975 heartbeater.cc:507] Master 127.20.208.62:37955 requested a full tablet report, sending...
I20260709 13:05:39.335532 21848 ts_manager.cc:194] Registered new tserver with Master: 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495)
I20260709 13:05:39.337440 21848 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33946
I20260709 13:05:39.338128 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:39.342242 21987 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.343181 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:39.343500 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-1-root
uuid: "bd27a2d35b9e4722825b35bba658dc15"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-6j4g"
I20260709 13:05:39.343811 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.355600 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.356904 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.358323 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.360548 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.360762 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.360996 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.361152 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.399703 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.2:35623
I20260709 13:05:39.399827 22049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.2:35623 every 8 connection(s)
I20260709 13:05:39.404253 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.410777 22053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.412766 22054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.415258 22056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.416100 22050 heartbeater.cc:344] Connected to a master server at 127.20.208.62:37955
I20260709 13:05:39.416461 22050 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.416510 21312 server_base.cc:1061] running on GCE node
I20260709 13:05:39.417407 22050 heartbeater.cc:507] Master 127.20.208.62:37955 requested a full tablet report, sending...
I20260709 13:05:39.417469 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.417786 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.417938 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602339417919 us; error 0 us; skew 500 ppm
I20260709 13:05:39.418613 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.419476 21848 ts_manager.cc:194] Registered new tserver with Master: bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:39.421099 21848 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33958
I20260709 13:05:39.421150 21312 webserver.cc:533] Webserver started at http://127.20.208.3:38795/ using document root <none> and password file <none>
I20260709 13:05:39.421694 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.421893 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.422222 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.423360 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-2-root/instance:
uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-6j4g"
I20260709 13:05:39.427769 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:05:39.431136 22061 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.431929 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:39.432204 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-2-root
uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-6j4g"
I20260709 13:05:39.432443 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326409895-21312-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.447191 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.448329 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.449806 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.452011 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.452239 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.452494 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.452666 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:39.493160 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.3:42233
I20260709 13:05:39.493248 22123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.3:42233 every 8 connection(s)
I20260709 13:05:39.506453 22124 heartbeater.cc:344] Connected to a master server at 127.20.208.62:37955
I20260709 13:05:39.506819 22124 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.507576 22124 heartbeater.cc:507] Master 127.20.208.62:37955 requested a full tablet report, sending...
I20260709 13:05:39.509673 21848 ts_manager.cc:194] Registered new tserver with Master: b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:39.510655 21312 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014454926s
I20260709 13:05:39.511011 21848 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33966
I20260709 13:05:39.535772 21848 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33976:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:39.538757 21848 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:39.608381 22015 tablet_service.cc:1511] Processing CreateTablet for tablet 27b5cba35d084b678a85ce9d6ea1ef1e (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:39.609901 22015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b5cba35d084b678a85ce9d6ea1ef1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.609709 22014 tablet_service.cc:1511] Processing CreateTablet for tablet 4a50de642a0044cda051e93ed9d4d66f (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:39.611251 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a50de642a0044cda051e93ed9d4d66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.615540 22013 tablet_service.cc:1511] Processing CreateTablet for tablet ce202f928598437c8bf300c5d31915cc (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:39.617086 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce202f928598437c8bf300c5d31915cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.623481 22012 tablet_service.cc:1511] Processing CreateTablet for tablet 8094ed2465f84b6caa1d51d92eb2c9c6 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:39.625144 22012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8094ed2465f84b6caa1d51d92eb2c9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.629555 22011 tablet_service.cc:1511] Processing CreateTablet for tablet 55c001d0afc34556b3b2d3913060d925 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:39.631160 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c001d0afc34556b3b2d3913060d925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.637254 22010 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2ef699d7334c4a830e657fbf6abbdc (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:39.638743 22010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2ef699d7334c4a830e657fbf6abbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.638626 21940 tablet_service.cc:1511] Processing CreateTablet for tablet 27b5cba35d084b678a85ce9d6ea1ef1e (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:39.640072 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b5cba35d084b678a85ce9d6ea1ef1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.642254 21935 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2ef699d7334c4a830e657fbf6abbdc (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:39.642403 21937 tablet_service.cc:1511] Processing CreateTablet for tablet 8094ed2465f84b6caa1d51d92eb2c9c6 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:39.643641 21935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2ef699d7334c4a830e657fbf6abbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.644934 21936 tablet_service.cc:1511] Processing CreateTablet for tablet 55c001d0afc34556b3b2d3913060d925 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:39.646306 21939 tablet_service.cc:1511] Processing CreateTablet for tablet 4a50de642a0044cda051e93ed9d4d66f (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:39.646521 21936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c001d0afc34556b3b2d3913060d925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.650257 21937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8094ed2465f84b6caa1d51d92eb2c9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.650707 21938 tablet_service.cc:1511] Processing CreateTablet for tablet ce202f928598437c8bf300c5d31915cc (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:39.653661 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a50de642a0044cda051e93ed9d4d66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.658125 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce202f928598437c8bf300c5d31915cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.672385 21934 tablet_service.cc:1511] Processing CreateTablet for tablet 1445a2d3dd0f4b2fb79c2a8ab748ba23 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:39.673810 21934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1445a2d3dd0f4b2fb79c2a8ab748ba23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.676136 21933 tablet_service.cc:1511] Processing CreateTablet for tablet ba68ec8226af4cc0b9dc3eb584418fd6 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:39.677546 22009 tablet_service.cc:1511] Processing CreateTablet for tablet ba68ec8226af4cc0b9dc3eb584418fd6 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:39.678881 22009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba68ec8226af4cc0b9dc3eb584418fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.684896 21933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba68ec8226af4cc0b9dc3eb584418fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.687093 21932 tablet_service.cc:1511] Processing CreateTablet for tablet fced5b5c63a34eb98772f253854ec95b (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:39.687703 22139 tablet_bootstrap.cc:492] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15: Bootstrap starting.
I20260709 13:05:39.688546 21932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fced5b5c63a34eb98772f253854ec95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.694687 21931 tablet_service.cc:1511] Processing CreateTablet for tablet 2174580a94f34eba9474a803566a10c1 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:39.696110 21931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2174580a94f34eba9474a803566a10c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.701654 22013 tablet_service.cc:1511] Processing CreateTablet for tablet fced5b5c63a34eb98772f253854ec95b (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:39.702950 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fced5b5c63a34eb98772f253854ec95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.703116 22012 tablet_service.cc:1511] Processing CreateTablet for tablet 2174580a94f34eba9474a803566a10c1 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:39.711645 22088 tablet_service.cc:1511] Processing CreateTablet for tablet 4a50de642a0044cda051e93ed9d4d66f (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:39.713024 22088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a50de642a0044cda051e93ed9d4d66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.713804 22089 tablet_service.cc:1511] Processing CreateTablet for tablet 27b5cba35d084b678a85ce9d6ea1ef1e (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:39.715579 22089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b5cba35d084b678a85ce9d6ea1ef1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.717537 22085 tablet_service.cc:1511] Processing CreateTablet for tablet 55c001d0afc34556b3b2d3913060d925 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:39.717664 22082 tablet_service.cc:1511] Processing CreateTablet for tablet ba68ec8226af4cc0b9dc3eb584418fd6 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:39.718979 22085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c001d0afc34556b3b2d3913060d925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.719579 22083 tablet_service.cc:1511] Processing CreateTablet for tablet 1445a2d3dd0f4b2fb79c2a8ab748ba23 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:39.721645 22086 tablet_service.cc:1511] Processing CreateTablet for tablet 8094ed2465f84b6caa1d51d92eb2c9c6 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:39.723611 22084 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2ef699d7334c4a830e657fbf6abbdc (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:39.716219 22087 tablet_service.cc:1511] Processing CreateTablet for tablet ce202f928598437c8bf300c5d31915cc (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:39.725871 22083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1445a2d3dd0f4b2fb79c2a8ab748ba23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.729189 22086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8094ed2465f84b6caa1d51d92eb2c9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.729120 22081 tablet_service.cc:1511] Processing CreateTablet for tablet fced5b5c63a34eb98772f253854ec95b (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:39.730579 22081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fced5b5c63a34eb98772f253854ec95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.733173 22084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2ef699d7334c4a830e657fbf6abbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.733785 22080 tablet_service.cc:1511] Processing CreateTablet for tablet 2174580a94f34eba9474a803566a10c1 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:39.735152 22080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2174580a94f34eba9474a803566a10c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.735569 22015 tablet_service.cc:1511] Processing CreateTablet for tablet 1445a2d3dd0f4b2fb79c2a8ab748ba23 (DEFAULT_TABLE table=test-workload [id=0dacb35a35a049209bd4333a9eb75445]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:39.736815 22087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce202f928598437c8bf300c5d31915cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.739049 22082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba68ec8226af4cc0b9dc3eb584418fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.708328 22012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2174580a94f34eba9474a803566a10c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.766412 22139 tablet_bootstrap.cc:654] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.776080 22015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1445a2d3dd0f4b2fb79c2a8ab748ba23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.785249 22140 tablet_bootstrap.cc:492] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2: Bootstrap starting.
I20260709 13:05:39.804718 22140 tablet_bootstrap.cc:654] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.807775 22139 tablet_bootstrap.cc:492] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15: No bootstrap required, opened a new log
I20260709 13:05:39.808266 22139 ts_tablet_manager.cc:1403] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15: Time spent bootstrapping tablet: real 0.121s	user 0.028s	sys 0.011s
I20260709 13:05:39.811197 22139 raft_consensus.cc:359] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.811959 22139 raft_consensus.cc:385] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.812280 22139 raft_consensus.cc:740] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.813400 22139 consensus_queue.cc:260] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.813851 22140 tablet_bootstrap.cc:492] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2: No bootstrap required, opened a new log
I20260709 13:05:39.815676 22140 ts_tablet_manager.cc:1403] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2: Time spent bootstrapping tablet: real 0.031s	user 0.002s	sys 0.013s
I20260709 13:05:39.819890 22140 raft_consensus.cc:359] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.820449 22140 raft_consensus.cc:385] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.820816 22140 raft_consensus.cc:740] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.821704 22140 consensus_queue.cc:260] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.813498 22141 tablet_bootstrap.cc:492] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd: Bootstrap starting.
I20260709 13:05:39.824180 22139 ts_tablet_manager.cc:1434] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:05:39.826193 22050 heartbeater.cc:499] Master 127.20.208.62:37955 was elected leader, sending a full tablet report...
I20260709 13:05:39.830699 22139 tablet_bootstrap.cc:492] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15: Bootstrap starting.
I20260709 13:05:39.833914 21975 heartbeater.cc:499] Master 127.20.208.62:37955 was elected leader, sending a full tablet report...
I20260709 13:05:39.837261 22141 tablet_bootstrap.cc:654] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.839423 22139 tablet_bootstrap.cc:654] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.845367 22141 tablet_bootstrap.cc:492] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd: No bootstrap required, opened a new log
I20260709 13:05:39.845893 22141 ts_tablet_manager.cc:1403] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.005s
I20260709 13:05:39.849119 22140 ts_tablet_manager.cc:1434] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.003s
I20260709 13:05:39.849119 22141 raft_consensus.cc:359] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.850031 22141 raft_consensus.cc:385] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.850310 22140 tablet_bootstrap.cc:492] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2: Bootstrap starting.
I20260709 13:05:39.850360 22141 raft_consensus.cc:740] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.851246 22141 consensus_queue.cc:260] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.857975 22140 tablet_bootstrap.cc:654] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.863632 22139 tablet_bootstrap.cc:492] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15: No bootstrap required, opened a new log
I20260709 13:05:39.864266 22139 ts_tablet_manager.cc:1403] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.017s
I20260709 13:05:39.866750 22141 ts_tablet_manager.cc:1434] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd: Time spent starting tablet: real 0.021s	user 0.018s	sys 0.003s
I20260709 13:05:39.867065 22124 heartbeater.cc:499] Master 127.20.208.62:37955 was elected leader, sending a full tablet report...
I20260709 13:05:39.867796 22141 tablet_bootstrap.cc:492] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd: Bootstrap starting.
I20260709 13:05:39.867388 22139 raft_consensus.cc:359] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:39.868177 22139 raft_consensus.cc:385] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.868528 22139 raft_consensus.cc:740] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.869311 22139 consensus_queue.cc:260] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:39.871518 22139 ts_tablet_manager.cc:1434] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:05:39.872522 22139 tablet_bootstrap.cc:492] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15: Bootstrap starting.
I20260709 13:05:39.874652 22141 tablet_bootstrap.cc:654] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.878945 22139 tablet_bootstrap.cc:654] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.891275 22139 tablet_bootstrap.cc:492] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15: No bootstrap required, opened a new log
I20260709 13:05:39.891857 22139 ts_tablet_manager.cc:1403] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:05:39.895165 22139 raft_consensus.cc:359] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.895991 22139 raft_consensus.cc:385] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.896319 22139 raft_consensus.cc:740] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.897186 22139 consensus_queue.cc:260] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.899960 22140 tablet_bootstrap.cc:492] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2: No bootstrap required, opened a new log
I20260709 13:05:39.900508 22140 ts_tablet_manager.cc:1403] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2: Time spent bootstrapping tablet: real 0.050s	user 0.024s	sys 0.018s
I20260709 13:05:39.903422 22140 raft_consensus.cc:359] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.904127 22140 raft_consensus.cc:385] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.904412 22140 raft_consensus.cc:740] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.906685 22139 ts_tablet_manager.cc:1434] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:05:39.906574 22140 consensus_queue.cc:260] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.908701 22140 ts_tablet_manager.cc:1434] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:05:39.909637 22140 tablet_bootstrap.cc:492] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2: Bootstrap starting.
I20260709 13:05:39.910538 22144 raft_consensus.cc:493] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.910758 22139 tablet_bootstrap.cc:492] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15: Bootstrap starting.
I20260709 13:05:39.911011 22144 raft_consensus.cc:515] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:39.918147 22139 tablet_bootstrap.cc:654] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.925679 22144 leader_election.cc:290] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233), 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495)
I20260709 13:05:39.927321 22141 tablet_bootstrap.cc:492] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd: No bootstrap required, opened a new log
I20260709 13:05:39.927970 22141 ts_tablet_manager.cc:1403] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.037s
I20260709 13:05:39.928370 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
W20260709 13:05:39.930076 21990 leader_election.cc:343] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.931401 22141 raft_consensus.cc:359] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.932153 22141 raft_consensus.cc:385] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.932447 22141 raft_consensus.cc:740] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.933238 22141 consensus_queue.cc:260] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.938696 22139 tablet_bootstrap.cc:492] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15: No bootstrap required, opened a new log
I20260709 13:05:39.939249 22139 ts_tablet_manager.cc:1403] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.005s
I20260709 13:05:39.940361 22140 tablet_bootstrap.cc:654] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.940892 22141 ts_tablet_manager.cc:1434] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:05:39.942052 22141 tablet_bootstrap.cc:492] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd: Bootstrap starting.
I20260709 13:05:39.944088 22139 raft_consensus.cc:359] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.944983 22139 raft_consensus.cc:385] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.944406 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
I20260709 13:05:39.945315 22139 raft_consensus.cc:740] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Initialized, Role: FOLLOWER
W20260709 13:05:39.946583 21989 leader_election.cc:343] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.946333 22139 consensus_queue.cc:260] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.947052 21989 leader_election.cc:304] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd27a2d35b9e4722825b35bba658dc15; no voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd
I20260709 13:05:39.948185 22144 raft_consensus.cc:2749] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:39.949271 22141 tablet_bootstrap.cc:654] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.952772 22139 ts_tablet_manager.cc:1434] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:05:39.953833 22139 tablet_bootstrap.cc:492] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15: Bootstrap starting.
I20260709 13:05:39.959949 22139 tablet_bootstrap.cc:654] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.964283 22144 raft_consensus.cc:493] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.964920 22144 raft_consensus.cc:515] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.965662 22140 tablet_bootstrap.cc:492] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2: No bootstrap required, opened a new log
I20260709 13:05:39.966390 22140 ts_tablet_manager.cc:1403] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.010s
I20260709 13:05:39.967286 22144 leader_election.cc:290] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:39.968164 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
I20260709 13:05:39.968931 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
I20260709 13:05:39.969565 22099 raft_consensus.cc:2468] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 0.
W20260709 13:05:39.969691 21990 leader_election.cc:343] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.970204 22140 raft_consensus.cc:359] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.971124 22140 raft_consensus.cc:385] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.970971 21989 leader_election.cc:304] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:39.972361 22144 raft_consensus.cc:2804] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.972576 22140 raft_consensus.cc:740] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.972802 22144 raft_consensus.cc:493] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.973279 22144 raft_consensus.cc:3060] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.973385 22140 consensus_queue.cc:260] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.974035 22141 tablet_bootstrap.cc:492] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd: No bootstrap required, opened a new log
I20260709 13:05:39.974821 22141 ts_tablet_manager.cc:1403] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.012s
I20260709 13:05:39.975430 22140 ts_tablet_manager.cc:1434] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:39.976445 22140 tablet_bootstrap.cc:492] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2: Bootstrap starting.
I20260709 13:05:39.977823 22141 raft_consensus.cc:359] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.978559 22141 raft_consensus.cc:385] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.978858 22141 raft_consensus.cc:740] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.980222 22141 consensus_queue.cc:260] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.980424 22144 raft_consensus.cc:515] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:39.983312 22140 tablet_bootstrap.cc:654] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.983330 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
W20260709 13:05:39.984760 21990 leader_election.cc:343] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.987056 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:39.987656 22099 raft_consensus.cc:3060] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.988170 22141 ts_tablet_manager.cc:1434] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:39.989253 22141 tablet_bootstrap.cc:492] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd: Bootstrap starting.
I20260709 13:05:39.994787 22139 tablet_bootstrap.cc:492] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15: No bootstrap required, opened a new log
I20260709 13:05:39.995515 22139 ts_tablet_manager.cc:1403] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.005s
I20260709 13:05:39.995823 22141 tablet_bootstrap.cc:654] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.000892 22139 raft_consensus.cc:359] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.001621 22099 raft_consensus.cc:2468] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 1.
I20260709 13:05:40.001952 22139 raft_consensus.cc:385] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.002522 22139 raft_consensus.cc:740] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.003278 21989 leader_election.cc:304] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:40.003490 22139 consensus_queue.cc:260] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.005553 22160 raft_consensus.cc:493] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.006141 22160 raft_consensus.cc:515] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.009394 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8094ed2465f84b6caa1d51d92eb2c9c6" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
I20260709 13:05:40.010108 21950 raft_consensus.cc:2468] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 0.
I20260709 13:05:40.011531 21990 leader_election.cc:304] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:40.013149 22144 leader_election.cc:290] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.013943 22139 ts_tablet_manager.cc:1434] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 13:05:40.014207 22144 raft_consensus.cc:2804] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.014801 22144 raft_consensus.cc:697] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Becoming Leader. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:40.018918 22161 raft_consensus.cc:2804] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.019519 22161 raft_consensus.cc:493] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.021260 22161 raft_consensus.cc:3060] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.020874 22139 tablet_bootstrap.cc:492] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15: Bootstrap starting.
I20260709 13:05:40.015782 22144 consensus_queue.cc:237] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.027287 22141 tablet_bootstrap.cc:492] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd: No bootstrap required, opened a new log
I20260709 13:05:40.027833 22141 ts_tablet_manager.cc:1403] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.004s
I20260709 13:05:40.029454 22160 leader_election.cc:290] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.029798 22145 raft_consensus.cc:493] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.030120 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8094ed2465f84b6caa1d51d92eb2c9c6" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
I20260709 13:05:40.030398 22145 raft_consensus.cc:515] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.030817 22099 raft_consensus.cc:2468] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 0.
I20260709 13:05:40.032655 22141 raft_consensus.cc:359] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:40.033494 22141 raft_consensus.cc:385] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.033824 22141 raft_consensus.cc:740] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.034674 22141 consensus_queue.cc:260] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:40.035553 22140 tablet_bootstrap.cc:492] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2: No bootstrap required, opened a new log
I20260709 13:05:40.036092 22140 ts_tablet_manager.cc:1403] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.035s
I20260709 13:05:40.036769 22145 leader_election.cc:290] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.039410 22141 ts_tablet_manager.cc:1434] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:05:40.040657 22141 tablet_bootstrap.cc:492] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd: Bootstrap starting.
I20260709 13:05:40.043311 22140 raft_consensus.cc:359] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.044183 22140 raft_consensus.cc:385] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.044512 22140 raft_consensus.cc:740] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.045300 22140 consensus_queue.cc:260] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.047539 22141 tablet_bootstrap.cc:654] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.047744 22140 ts_tablet_manager.cc:1434] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:40.043361 22139 tablet_bootstrap.cc:654] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.048789 22140 tablet_bootstrap.cc:492] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2: Bootstrap starting.
I20260709 13:05:40.055852 22140 tablet_bootstrap.cc:654] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.048228 22161 raft_consensus.cc:515] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.066681 22139 tablet_bootstrap.cc:492] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15: No bootstrap required, opened a new log
I20260709 13:05:40.067164 22139 ts_tablet_manager.cc:1403] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.005s
I20260709 13:05:40.070875 21847 catalog_manager.cc:5697] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "bd27a2d35b9e4722825b35bba658dc15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.072849 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8094ed2465f84b6caa1d51d92eb2c9c6" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:40.073724 22099 raft_consensus.cc:3060] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.074615 22161 leader_election.cc:290] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.078373 22139 raft_consensus.cc:359] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.079110 22139 raft_consensus.cc:385] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.079416 22139 raft_consensus.cc:740] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.082526 22099 raft_consensus.cc:2468] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 1.
I20260709 13:05:40.083678 21989 leader_election.cc:304] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:40.085601 22161 raft_consensus.cc:2804] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.086143 22161 raft_consensus.cc:697] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Becoming Leader. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:40.086947 22161 consensus_queue.cc:237] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.090890 22148 raft_consensus.cc:493] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.091374 22148 raft_consensus.cc:515] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.091934 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.092720 22025 raft_consensus.cc:2468] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 0.
I20260709 13:05:40.094316 21914 leader_election.cc:304] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:40.097699 22148 leader_election.cc:290] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:40.090914 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8094ed2465f84b6caa1d51d92eb2c9c6" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:40.080165 22139 consensus_queue.cc:260] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.099946 21950 raft_consensus.cc:3060] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.101527 22139 ts_tablet_manager.cc:1434] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:05:40.102551 22139 tablet_bootstrap.cc:492] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15: Bootstrap starting.
I20260709 13:05:40.110117 22145 raft_consensus.cc:2804] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.110675 22145 raft_consensus.cc:493] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.111088 22145 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.113292 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
W20260709 13:05:40.114542 21914 leader_election.cc:343] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.122915 22139 tablet_bootstrap.cc:654] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.131174 21950 raft_consensus.cc:2468] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 1.
I20260709 13:05:40.147575 22144 raft_consensus.cc:493] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.148238 22144 raft_consensus.cc:515] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.149971 22145 raft_consensus.cc:515] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.150790 22144 leader_election.cc:290] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
W20260709 13:05:40.147631 21896 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:40.152951 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
W20260709 13:05:40.160580 21989 leader_election.cc:343] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.163270 22174 raft_consensus.cc:493] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.165197 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:40.165983 22025 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.165442 22174 raft_consensus.cc:515] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.169229 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fced5b5c63a34eb98772f253854ec95b" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.165198 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
W20260709 13:05:40.178090 21990 leader_election.cc:343] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.176297 22025 raft_consensus.cc:2468] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 1.
I20260709 13:05:40.178625 21990 leader_election.cc:304] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd27a2d35b9e4722825b35bba658dc15; no voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd
W20260709 13:05:40.178193 21914 leader_election.cc:343] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.179435 22161 raft_consensus.cc:2749] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.179677 22145 leader_election.cc:290] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.181191 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:40.183007 21914 leader_election.cc:304] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
W20260709 13:05:40.184177 21914 leader_election.cc:343] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.184353 22145 raft_consensus.cc:2804] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.190359 22174 leader_election.cc:290] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.191401 22140 tablet_bootstrap.cc:492] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2: No bootstrap required, opened a new log
I20260709 13:05:40.191905 22140 ts_tablet_manager.cc:1403] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2: Time spent bootstrapping tablet: real 0.143s	user 0.018s	sys 0.098s
I20260709 13:05:40.193336 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fced5b5c63a34eb98772f253854ec95b" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
I20260709 13:05:40.194931 22140 raft_consensus.cc:359] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.195729 22140 raft_consensus.cc:385] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.196063 22148 raft_consensus.cc:493] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:40.194955 21914 leader_election.cc:343] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.197154 21914 leader_election.cc:304] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2; no voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15
I20260709 13:05:40.198372 22174 raft_consensus.cc:2749] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.200060 22141 tablet_bootstrap.cc:492] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd: No bootstrap required, opened a new log
I20260709 13:05:40.200734 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
I20260709 13:05:40.199878 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.196825 22148 raft_consensus.cc:515] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:40.201529 22141 ts_tablet_manager.cc:1403] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd: Time spent bootstrapping tablet: real 0.161s	user 0.045s	sys 0.073s
I20260709 13:05:40.201953 22025 raft_consensus.cc:2468] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 0.
I20260709 13:05:40.203907 22148 leader_election.cc:290] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495)
I20260709 13:05:40.196146 22140 raft_consensus.cc:740] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.204639 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.205367 22025 raft_consensus.cc:2468] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 0.
I20260709 13:05:40.205524 22140 consensus_queue.cc:260] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.207470 22139 tablet_bootstrap.cc:492] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15: No bootstrap required, opened a new log
I20260709 13:05:40.207638 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
I20260709 13:05:40.210848 22139 ts_tablet_manager.cc:1403] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15: Time spent bootstrapping tablet: real 0.109s	user 0.033s	sys 0.009s
I20260709 13:05:40.208616 22140 ts_tablet_manager.cc:1434] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 13:05:40.208966 22063 leader_election.cc:304] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:40.212075 22148 raft_consensus.cc:2804] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.212209 22063 leader_election.cc:304] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:40.212621 22148 raft_consensus.cc:493] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.213073 22148 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.213940 22140 tablet_bootstrap.cc:492] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2: Bootstrap starting.
I20260709 13:05:40.213758 22139 raft_consensus.cc:359] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.214501 22139 raft_consensus.cc:385] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.214792 22139 raft_consensus.cc:740] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.219285 22139 consensus_queue.cc:260] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
W20260709 13:05:40.220330 22064 leader_election.cc:343] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.209226 22141 raft_consensus.cc:359] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.222505 22139 ts_tablet_manager.cc:1434] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:05:40.223706 22139 tablet_bootstrap.cc:492] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15: Bootstrap starting.
I20260709 13:05:40.222510 22141 raft_consensus.cc:385] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.225104 22141 raft_consensus.cc:740] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.226920 22145 raft_consensus.cc:697] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:40.227324 22140 tablet_bootstrap.cc:654] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.227380 22175 raft_consensus.cc:493] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:40.227828 22064 leader_election.cc:343] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.228015 22145 consensus_queue.cc:237] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.226953 22148 raft_consensus.cc:515] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.228950 22141 consensus_queue.cc:260] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.227926 22175 raft_consensus.cc:515] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.232188 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
W20260709 13:05:40.234270 22064 leader_election.cc:343] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.235677 22148 leader_election.cc:290] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:40.236568 22148 raft_consensus.cc:2804] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.238595 22148 raft_consensus.cc:493] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.239450 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
I20260709 13:05:40.238654 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.241665 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:40.247882 22024 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:40.249256 21914 leader_election.cc:343] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:40.250113 21914 leader_election.cc:343] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.248026 22148 raft_consensus.cc:3060] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.250584 21914 leader_election.cc:304] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2; no voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15
I20260709 13:05:40.251683 22174 raft_consensus.cc:2749] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.251490 21846 catalog_manager.cc:5697] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "bd27a2d35b9e4722825b35bba658dc15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.236977 22175 leader_election.cc:290] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.244683 22139 tablet_bootstrap.cc:654] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.258723 22024 raft_consensus.cc:2468] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 1.
I20260709 13:05:40.260222 22063 leader_election.cc:304] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:40.261035 22141 ts_tablet_manager.cc:1434] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.007s
I20260709 13:05:40.261848 22179 raft_consensus.cc:2804] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.262646 22179 raft_consensus.cc:697] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Becoming Leader. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:40.263602 22179 consensus_queue.cc:237] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.268329 22141 tablet_bootstrap.cc:492] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd: Bootstrap starting.
I20260709 13:05:40.269743 21845 catalog_manager.cc:5697] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.289287 22141 tablet_bootstrap.cc:654] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.291802 22148 raft_consensus.cc:515] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:40.294548 22148 leader_election.cc:290] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495)
I20260709 13:05:40.296034 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:40.296797 22024 raft_consensus.cc:3060] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.298897 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:40.300324 22161 raft_consensus.cc:493] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.300935 22161 raft_consensus.cc:515] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
W20260709 13:05:40.301831 22064 leader_election.cc:343] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.303052 22161 leader_election.cc:290] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.305546 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fced5b5c63a34eb98772f253854ec95b" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
I20260709 13:05:40.307650 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fced5b5c63a34eb98772f253854ec95b" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
W20260709 13:05:40.307806 21989 leader_election.cc:343] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.308357 21950 raft_consensus.cc:2468] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 0.
I20260709 13:05:40.309723 21990 leader_election.cc:304] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: b20008ad779b4b8f93a2bc33f137e2cd
I20260709 13:05:40.310971 22161 raft_consensus.cc:2804] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.311405 22161 raft_consensus.cc:493] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.311764 22161 raft_consensus.cc:3060] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.311578 21845 catalog_manager.cc:5697] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3). New cstate: current_term: 1 leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.320814 22024 raft_consensus.cc:2468] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 1.
I20260709 13:05:40.322145 22063 leader_election.cc:304] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:40.322997 22148 raft_consensus.cc:2804] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.323571 22148 raft_consensus.cc:697] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Becoming Leader. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:40.324947 22148 consensus_queue.cc:237] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:40.326637 22140 tablet_bootstrap.cc:492] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2: No bootstrap required, opened a new log
I20260709 13:05:40.327369 22140 ts_tablet_manager.cc:1403] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.060s
I20260709 13:05:40.330658 22140 raft_consensus.cc:359] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.331389 22140 raft_consensus.cc:385] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.324195 22161 raft_consensus.cc:515] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.331733 22140 raft_consensus.cc:740] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.332552 22140 consensus_queue.cc:260] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.334584 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fced5b5c63a34eb98772f253854ec95b" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:40.335216 21950 raft_consensus.cc:3060] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.337297 22140 ts_tablet_manager.cc:1434] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:05:40.338384 22140 tablet_bootstrap.cc:492] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2: Bootstrap starting.
I20260709 13:05:40.336756 22141 tablet_bootstrap.cc:492] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd: No bootstrap required, opened a new log
I20260709 13:05:40.340905 22141 ts_tablet_manager.cc:1403] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.003s
I20260709 13:05:40.345781 22140 tablet_bootstrap.cc:654] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.347647 22141 raft_consensus.cc:359] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.349439 22141 raft_consensus.cc:385] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.350301 22141 raft_consensus.cc:740] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.351675 22140 tablet_bootstrap.cc:492] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2: No bootstrap required, opened a new log
I20260709 13:05:40.352213 22140 ts_tablet_manager.cc:1403] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:05:40.352252 22141 consensus_queue.cc:260] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.355307 22140 raft_consensus.cc:359] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.356067 22140 raft_consensus.cc:385] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.356503 22140 raft_consensus.cc:740] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.357283 22140 consensus_queue.cc:260] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.357697 22141 ts_tablet_manager.cc:1434] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:05:40.359601 22141 tablet_bootstrap.cc:492] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd: Bootstrap starting.
I20260709 13:05:40.360792 21950 raft_consensus.cc:2468] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 1.
I20260709 13:05:40.362066 21990 leader_election.cc:304] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:40.362989 22144 raft_consensus.cc:2804] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.363461 22144 raft_consensus.cc:697] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Becoming Leader. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:40.364300 22144 consensus_queue.cc:237] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.359830 22140 ts_tablet_manager.cc:1434] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:40.366171 22140 tablet_bootstrap.cc:492] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2: Bootstrap starting.
I20260709 13:05:40.371196 22141 tablet_bootstrap.cc:654] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.378621 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fced5b5c63a34eb98772f253854ec95b" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
W20260709 13:05:40.380113 21989 leader_election.cc:343] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.379395 21846 catalog_manager.cc:5697] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "bd27a2d35b9e4722825b35bba658dc15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.372931 22140 tablet_bootstrap.cc:654] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.380610 22161 leader_election.cc:290] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.385177 22141 tablet_bootstrap.cc:492] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd: No bootstrap required, opened a new log
I20260709 13:05:40.386197 22140 tablet_bootstrap.cc:492] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2: No bootstrap required, opened a new log
I20260709 13:05:40.390075 22140 ts_tablet_manager.cc:1403] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.002s
I20260709 13:05:40.392458 22141 ts_tablet_manager.cc:1403] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd: Time spent bootstrapping tablet: real 0.033s	user 0.003s	sys 0.010s
I20260709 13:05:40.392710 22140 raft_consensus.cc:359] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.392170 21845 catalog_manager.cc:5697] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3). New cstate: current_term: 1 leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.393370 22140 raft_consensus.cc:385] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.393653 22140 raft_consensus.cc:740] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.394428 22140 consensus_queue.cc:260] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.394955 22145 raft_consensus.cc:493] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.395459 22141 raft_consensus.cc:359] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.395582 22145 raft_consensus.cc:515] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.396216 22141 raft_consensus.cc:385] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.396384 22140 ts_tablet_manager.cc:1434] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:05:40.396590 22141 raft_consensus.cc:740] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.397374 22140 tablet_bootstrap.cc:492] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2: Bootstrap starting.
I20260709 13:05:40.397770 22145 leader_election.cc:290] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.397413 22141 consensus_queue.cc:260] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.400029 22141 ts_tablet_manager.cc:1434] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:40.401113 22141 tablet_bootstrap.cc:492] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd: Bootstrap starting.
I20260709 13:05:40.401221 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
I20260709 13:05:40.401871 22099 raft_consensus.cc:2468] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 0.
I20260709 13:05:40.403628 22140 tablet_bootstrap.cc:654] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.403496 21914 leader_election.cc:304] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:40.404421 22175 raft_consensus.cc:2804] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.404853 22175 raft_consensus.cc:493] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.405193 22175 raft_consensus.cc:3060] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.400115 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.407756 22024 raft_consensus.cc:2468] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 0.
I20260709 13:05:40.408264 22141 tablet_bootstrap.cc:654] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.428196 22139 tablet_bootstrap.cc:492] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15: No bootstrap required, opened a new log
I20260709 13:05:40.428762 22139 ts_tablet_manager.cc:1403] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15: Time spent bootstrapping tablet: real 0.205s	user 0.029s	sys 0.017s
I20260709 13:05:40.426304 22175 raft_consensus.cc:515] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.432801 22140 tablet_bootstrap.cc:492] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2: No bootstrap required, opened a new log
I20260709 13:05:40.433293 22140 ts_tablet_manager.cc:1403] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.007s
I20260709 13:05:40.433820 22139 raft_consensus.cc:359] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.434037 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:40.434691 22139 raft_consensus.cc:385] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.434829 22024 raft_consensus.cc:3060] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.434778 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:40.435060 22139 raft_consensus.cc:740] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.435480 22099 raft_consensus.cc:3060] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.435935 22140 raft_consensus.cc:359] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:40.435985 22139 consensus_queue.cc:260] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.436705 22140 raft_consensus.cc:385] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.437000 22140 raft_consensus.cc:740] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.438145 22139 ts_tablet_manager.cc:1434] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:40.433302 22161 consensus_queue.cc:1048] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:40.439848 22139 tablet_bootstrap.cc:492] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15: Bootstrap starting.
I20260709 13:05:40.439095 22140 consensus_queue.cc:260] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:40.441710 22140 ts_tablet_manager.cc:1434] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:40.443460 22140 tablet_bootstrap.cc:492] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2: Bootstrap starting.
I20260709 13:05:40.444227 22141 tablet_bootstrap.cc:492] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd: No bootstrap required, opened a new log
I20260709 13:05:40.434166 22175 leader_election.cc:290] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.444725 22141 ts_tablet_manager.cc:1403] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.002s
I20260709 13:05:40.447471 22141 raft_consensus.cc:359] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.448170 22141 raft_consensus.cc:385] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.448439 22141 raft_consensus.cc:740] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.449113 22141 consensus_queue.cc:260] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.449939 22140 tablet_bootstrap.cc:654] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.451074 22141 ts_tablet_manager.cc:1434] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:40.451992 22141 tablet_bootstrap.cc:492] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd: Bootstrap starting.
I20260709 13:05:40.453401 22139 tablet_bootstrap.cc:654] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.457969 22141 tablet_bootstrap.cc:654] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.459749 22024 raft_consensus.cc:2468] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 1.
I20260709 13:05:40.462162 21914 leader_election.cc:304] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:40.462810 22099 raft_consensus.cc:2468] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 1.
I20260709 13:05:40.463310 22175 raft_consensus.cc:2804] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.463886 22175 raft_consensus.cc:697] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:40.464804 22175 consensus_queue.cc:237] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.489722 22141 tablet_bootstrap.cc:492] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd: No bootstrap required, opened a new log
I20260709 13:05:40.490272 22141 ts_tablet_manager.cc:1403] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.015s
I20260709 13:05:40.493095 22141 raft_consensus.cc:359] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.493837 22141 raft_consensus.cc:385] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.494103 22141 raft_consensus.cc:740] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.494791 22141 consensus_queue.cc:260] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.496922 22141 ts_tablet_manager.cc:1434] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:40.497962 22141 tablet_bootstrap.cc:492] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd: Bootstrap starting.
I20260709 13:05:40.504256 21950 raft_consensus.cc:3060] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.506444 21846 catalog_manager.cc:5697] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.507684 22141 tablet_bootstrap.cc:654] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.515799 22139 tablet_bootstrap.cc:492] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15: No bootstrap required, opened a new log
I20260709 13:05:40.516314 22139 ts_tablet_manager.cc:1403] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.001s
I20260709 13:05:40.517715 22144 consensus_queue.cc:1048] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.519388 22139 raft_consensus.cc:359] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.520093 22139 raft_consensus.cc:385] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.520375 22139 raft_consensus.cc:740] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.521169 22139 consensus_queue.cc:260] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.524325 22141 tablet_bootstrap.cc:492] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd: No bootstrap required, opened a new log
I20260709 13:05:40.524945 22141 ts_tablet_manager.cc:1403] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:05:40.527994 22141 raft_consensus.cc:359] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.528787 22141 raft_consensus.cc:385] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.529105 22141 raft_consensus.cc:740] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.529990 22141 consensus_queue.cc:260] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.530810 22139 ts_tablet_manager.cc:1434] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:05:40.531852 22139 tablet_bootstrap.cc:492] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15: Bootstrap starting.
I20260709 13:05:40.532361 22141 ts_tablet_manager.cc:1434] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:40.535953 22175 raft_consensus.cc:493] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.536616 22175 raft_consensus.cc:515] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.537212 22145 raft_consensus.cc:493] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.537885 22145 raft_consensus.cc:515] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.538985 22175 leader_election.cc:290] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.539805 22145 leader_election.cc:290] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.541275 22140 tablet_bootstrap.cc:492] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2: No bootstrap required, opened a new log
I20260709 13:05:40.541731 22140 ts_tablet_manager.cc:1403] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2: Time spent bootstrapping tablet: real 0.098s	user 0.055s	sys 0.028s
I20260709 13:05:40.541884 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
I20260709 13:05:40.543005 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2174580a94f34eba9474a803566a10c1" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
I20260709 13:05:40.543637 22097 raft_consensus.cc:2468] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 0.
I20260709 13:05:40.544001 22148 raft_consensus.cc:493] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.544446 22148 raft_consensus.cc:515] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.544937 22140 raft_consensus.cc:359] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.545651 22140 raft_consensus.cc:385] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.545915 22140 raft_consensus.cc:740] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.546609 22140 consensus_queue.cc:260] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.548149 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
I20260709 13:05:40.549234 21949 raft_consensus.cc:2468] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 0.
I20260709 13:05:40.550212 22148 leader_election.cc:290] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:40.548707 22140 ts_tablet_manager.cc:1434] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:05:40.550534 22064 leader_election.cc:304] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:40.550345 22139 tablet_bootstrap.cc:654] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.551019 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.551519 22148 raft_consensus.cc:2804] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.551666 22023 raft_consensus.cc:2468] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 0.
I20260709 13:05:40.551909 22148 raft_consensus.cc:493] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.552294 22148 raft_consensus.cc:3060] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.541543 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.553989 22024 raft_consensus.cc:2393] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 150d714edd0d4abd9846b82908a3f9d2 in current term 1: Already voted for candidate b20008ad779b4b8f93a2bc33f137e2cd in this term.
I20260709 13:05:40.554692 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2174580a94f34eba9474a803566a10c1" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.559125 22148 raft_consensus.cc:515] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.560218 21914 leader_election.cc:304] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:40.561437 22179 raft_consensus.cc:493] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.561645 22175 raft_consensus.cc:2804] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.562098 22175 raft_consensus.cc:493] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.561931 22179 raft_consensus.cc:515] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.562497 22175 raft_consensus.cc:3060] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.563392 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:40.564000 21949 raft_consensus.cc:3060] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.570863 21914 leader_election.cc:304] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2; no voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15
W20260709 13:05:40.572079 21914 leader_election.cc:343] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.570911 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
I20260709 13:05:40.573352 21948 raft_consensus.cc:2468] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 0.
I20260709 13:05:40.573374 22145 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.574941 22064 leader_election.cc:304] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:40.575897 22177 raft_consensus.cc:2804] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.576257 22177 raft_consensus.cc:493] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.576604 22177 raft_consensus.cc:3060] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.577250 22175 raft_consensus.cc:515] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.577996 22179 leader_election.cc:290] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:40.580123 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2174580a94f34eba9474a803566a10c1" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:40.582782 22145 raft_consensus.cc:2749] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.580194 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.583842 22025 raft_consensus.cc:2468] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 0.
I20260709 13:05:40.584846 22148 leader_election.cc:290] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:40.585183 21949 raft_consensus.cc:2468] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 1.
I20260709 13:05:40.586351 22064 leader_election.cc:304] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:40.586429 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:40.587138 22025 raft_consensus.cc:3060] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.587469 22139 tablet_bootstrap.cc:492] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15: No bootstrap required, opened a new log
I20260709 13:05:40.587924 22139 ts_tablet_manager.cc:1403] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.007s
I20260709 13:05:40.587375 22148 raft_consensus.cc:2804] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.588784 22175 leader_election.cc:290] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.589221 22148 raft_consensus.cc:697] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Becoming Leader. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:40.590402 22177 raft_consensus.cc:515] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.590420 22148 consensus_queue.cc:237] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.590672 22139 raft_consensus.cc:359] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.591379 22139 raft_consensus.cc:385] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.591662 22139 raft_consensus.cc:740] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Initialized, Role: FOLLOWER
W20260709 13:05:40.592496 21914 leader_election.cc:343] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.593480 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:40.594084 21949 raft_consensus.cc:3060] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.594923 22025 raft_consensus.cc:2468] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 1.
I20260709 13:05:40.595038 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2174580a94f34eba9474a803566a10c1" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:40.592285 22139 consensus_queue.cc:260] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.595611 22099 raft_consensus.cc:3060] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.597208 22139 ts_tablet_manager.cc:1434] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:40.600805 22160 raft_consensus.cc:493] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.601315 22160 raft_consensus.cc:515] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.602317 22099 raft_consensus.cc:2468] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 1.
I20260709 13:05:40.603382 22160 leader_election.cc:290] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.603530 21914 leader_election.cc:304] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: bd27a2d35b9e4722825b35bba658dc15
I20260709 13:05:40.605170 22175 raft_consensus.cc:2804] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.605103 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:40.605980 22025 raft_consensus.cc:3060] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.606171 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2174580a94f34eba9474a803566a10c1" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
I20260709 13:05:40.607118 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2174580a94f34eba9474a803566a10c1" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" is_pre_election: true
I20260709 13:05:40.606381 22177 leader_election.cc:290] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:40.607887 22097 raft_consensus.cc:2393] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd27a2d35b9e4722825b35bba658dc15 in current term 1: Already voted for candidate 150d714edd0d4abd9846b82908a3f9d2 in this term.
I20260709 13:05:40.610211 21949 raft_consensus.cc:2468] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 1.
I20260709 13:05:40.609859 21846 catalog_manager.cc:5697] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3). New cstate: current_term: 1 leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.611263 22160 consensus_queue.cc:1048] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.611616 22064 leader_election.cc:304] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:40.610846 22175 raft_consensus.cc:697] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:40.613533 22175 consensus_queue.cc:237] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.614356 22025 raft_consensus.cc:2468] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 1.
I20260709 13:05:40.614998 22177 raft_consensus.cc:2804] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.616190 22177 raft_consensus.cc:697] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Becoming Leader. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:40.617051 22177 consensus_queue.cc:237] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.635234 21990 leader_election.cc:304] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd27a2d35b9e4722825b35bba658dc15; no voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd
I20260709 13:05:40.636525 22161 raft_consensus.cc:3060] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.636971 21846 catalog_manager.cc:5697] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.642522 22160 consensus_queue.cc:1048] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.642088 21845 catalog_manager.cc:5697] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3). New cstate: current_term: 1 leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.644181 22161 raft_consensus.cc:2749] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.657462 22177 consensus_queue.cc:1048] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.661193 22175 consensus_queue.cc:1048] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.669931 22148 consensus_queue.cc:1048] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.678697 22097 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.686709 22174 consensus_queue.cc:1048] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.688292 22148 raft_consensus.cc:493] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.688787 22148 raft_consensus.cc:515] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.690703 22148 leader_election.cc:290] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:40.692199 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.691457 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
I20260709 13:05:40.694710 22064 leader_election.cc:304] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd; no voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15
I20260709 13:05:40.699690 22148 raft_consensus.cc:2749] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:40.718564 22148 consensus_queue.cc:1048] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.727100 21948 raft_consensus.cc:3060] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.735409 22213 consensus_queue.cc:1048] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:40.752250 22097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
mode: GRACEFUL
new_leader_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:42454
I20260709 13:05:40.752827 22097 raft_consensus.cc:606] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Received request to transfer leadership to TS 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:40.765497 22025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f"
dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
mode: GRACEFUL
new_leader_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:57750
I20260709 13:05:40.766003 22025 raft_consensus.cc:606] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Received request to transfer leadership to TS 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:40.766296 22213 raft_consensus.cc:493] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.766767 22213 raft_consensus.cc:515] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.768528 22213 leader_election.cc:290] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:40.769179 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fced5b5c63a34eb98772f253854ec95b" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d714edd0d4abd9846b82908a3f9d2" is_pre_election: true
I20260709 13:05:40.769932 21948 raft_consensus.cc:2393] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b20008ad779b4b8f93a2bc33f137e2cd in current term 1: Already voted for candidate bd27a2d35b9e4722825b35bba658dc15 in this term.
I20260709 13:05:40.769896 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fced5b5c63a34eb98772f253854ec95b" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd27a2d35b9e4722825b35bba658dc15" is_pre_election: true
I20260709 13:05:40.771260 22063 leader_election.cc:304] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd; no voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15
I20260709 13:05:40.771993 22213 raft_consensus.cc:3060] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.774348 22025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8094ed2465f84b6caa1d51d92eb2c9c6"
dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
mode: GRACEFUL
new_leader_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:57750
I20260709 13:05:40.774979 22025 raft_consensus.cc:606] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Received request to transfer leadership to TS 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:40.778257 22213 raft_consensus.cc:2749] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.782842 22097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
mode: GRACEFUL
new_leader_uuid: "bd27a2d35b9e4722825b35bba658dc15"
 from {username='slave'} at 127.0.0.1:42454
I20260709 13:05:40.783386 22097 raft_consensus.cc:606] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Received request to transfer leadership to TS bd27a2d35b9e4722825b35bba658dc15
I20260709 13:05:40.788793 22097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
mode: GRACEFUL
new_leader_uuid: "bd27a2d35b9e4722825b35bba658dc15"
 from {username='slave'} at 127.0.0.1:42454
I20260709 13:05:40.789315 22097 raft_consensus.cc:606] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Received request to transfer leadership to TS bd27a2d35b9e4722825b35bba658dc15
I20260709 13:05:40.794305 22097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
mode: GRACEFUL
new_leader_uuid: "bd27a2d35b9e4722825b35bba658dc15"
 from {username='slave'} at 127.0.0.1:42454
I20260709 13:05:40.794790 22097 raft_consensus.cc:606] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Received request to transfer leadership to TS bd27a2d35b9e4722825b35bba658dc15
I20260709 13:05:40.810940 21948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2174580a94f34eba9474a803566a10c1"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
mode: GRACEFUL
new_leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
 from {username='slave'} at 127.0.0.1:46052
I20260709 13:05:40.811484 21948 raft_consensus.cc:606] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Received request to transfer leadership to TS b20008ad779b4b8f93a2bc33f137e2cd
I20260709 13:05:40.816723 22160 consensus_queue.cc:1048] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.819164 22160 consensus_queue.cc:1048] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.855710 22174 consensus_queue.cc:1048] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.866374 22174 consensus_queue.cc:1048] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.975800 22160 raft_consensus.cc:993] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15: : Instructing follower 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:40.976227 22144 raft_consensus.cc:1081] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Signalling peer 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:40.977658 21948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:46032
I20260709 13:05:40.978153 21948 raft_consensus.cc:493] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:40.978500 21948 raft_consensus.cc:3060] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.982820 21948 raft_consensus.cc:515] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.984500 21948 leader_election.cc:290] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 2 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:40.985265 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:40.985646 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:40.985883 22025 raft_consensus.cc:3055] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:40.986176 22097 raft_consensus.cc:3060] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.986212 22025 raft_consensus.cc:740] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:40.987095 22025 consensus_queue.cc:260] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.988400 22025 raft_consensus.cc:3060] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.993010 22097 raft_consensus.cc:2468] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 2.
I20260709 13:05:40.994237 21914 leader_election.cc:304] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:40.994618 22025 raft_consensus.cc:2468] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 2.
I20260709 13:05:40.995115 22174 raft_consensus.cc:2804] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:40.995546 22174 raft_consensus.cc:697] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:40.996277 22174 consensus_queue.cc:237] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:40.999255 22213 consensus_queue.cc:1048] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.003547 21845 catalog_manager.cc:5697] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 1 to 2, leader changed from bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2) to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.006273 22179 raft_consensus.cc:993] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd: : Instructing follower bd27a2d35b9e4722825b35bba658dc15 to start an election
I20260709 13:05:41.007459 22179 raft_consensus.cc:1081] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Signalling peer bd27a2d35b9e4722825b35bba658dc15 to start an election
I20260709 13:05:41.010106 22174 consensus_queue.cc:1048] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.011852 22024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23"
dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
 from {username='slave'} at 127.0.0.1:57736
I20260709 13:05:41.012423 22024 raft_consensus.cc:493] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.012842 22024 raft_consensus.cc:3060] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.012423 22148 consensus_queue.cc:1048] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.026523 22024 raft_consensus.cc:515] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.026845 22175 consensus_queue.cc:1048] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.027760 22025 raft_consensus.cc:1240] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Rejecting Update request from peer b20008ad779b4b8f93a2bc33f137e2cd for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:41.030437 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:41.031138 22099 raft_consensus.cc:3055] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.031467 22099 raft_consensus.cc:740] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:41.032063 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:41.032737 21948 raft_consensus.cc:3060] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.032253 22099 consensus_queue.cc:260] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.034096 22148 consensus_queue.cc:1059] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.034241 22024 leader_election.cc:290] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 2 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:41.037771 22099 raft_consensus.cc:3060] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.041241 22175 raft_consensus.cc:993] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2: : Instructing follower b20008ad779b4b8f93a2bc33f137e2cd to start an election
I20260709 13:05:41.041782 22145 raft_consensus.cc:1081] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Signalling peer b20008ad779b4b8f93a2bc33f137e2cd to start an election
I20260709 13:05:41.043587 22097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2174580a94f34eba9474a803566a10c1"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:05:41.044204 22097 raft_consensus.cc:493] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.044632 22097 raft_consensus.cc:3060] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.047924 21948 raft_consensus.cc:2468] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 2.
I20260709 13:05:41.049113 21990 leader_election.cc:304] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:41.049976 22144 raft_consensus.cc:2804] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.050482 22144 raft_consensus.cc:697] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Becoming Leader. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:41.051564 22099 raft_consensus.cc:2468] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 2.
I20260709 13:05:41.051294 22144 consensus_queue.cc:237] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.053699 22097 raft_consensus.cc:515] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.055706 22177 consensus_queue.cc:1048] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.056371 22097 leader_election.cc:290] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 2 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:41.059640 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2174580a94f34eba9474a803566a10c1" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:41.059751 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2174580a94f34eba9474a803566a10c1" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:41.060443 22024 raft_consensus.cc:3060] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.060286 21948 raft_consensus.cc:3055] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.063055 21948 raft_consensus.cc:740] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:41.063983 21948 consensus_queue.cc:260] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.063910 21847 catalog_manager.cc:5697] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 reported cstate change: term changed from 1 to 2, leader changed from b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3) to bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "bd27a2d35b9e4722825b35bba658dc15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.065361 21948 raft_consensus.cc:3060] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.071485 22024 raft_consensus.cc:2468] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 2.
I20260709 13:05:41.072743 22063 leader_election.cc:304] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:41.073616 22177 raft_consensus.cc:2804] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.074102 22177 raft_consensus.cc:697] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Becoming Leader. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:41.074941 22177 consensus_queue.cc:237] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.076638 21948 raft_consensus.cc:2468] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 2.
I20260709 13:05:41.078827 22148 raft_consensus.cc:993] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd: : Instructing follower bd27a2d35b9e4722825b35bba658dc15 to start an election
I20260709 13:05:41.079339 22148 raft_consensus.cc:1081] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Signalling peer bd27a2d35b9e4722825b35bba658dc15 to start an election
I20260709 13:05:41.081729 22023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc"
dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
 from {username='slave'} at 127.0.0.1:57736
I20260709 13:05:41.085675 22023 raft_consensus.cc:493] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.086133 22023 raft_consensus.cc:3060] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.087529 21845 catalog_manager.cc:5697] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd reported cstate change: term changed from 1 to 2, leader changed from 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1) to b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3). New cstate: current_term: 2 leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.093613 22023 raft_consensus.cc:515] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.097196 22179 consensus_queue.cc:1048] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.102944 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:41.103560 22097 raft_consensus.cc:3055] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.103868 22097 raft_consensus.cc:740] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:41.104771 22097 consensus_queue.cc:260] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.105618 22023 leader_election.cc:290] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 2 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:41.106166 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:41.106834 21948 raft_consensus.cc:3060] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.108103 22097 raft_consensus.cc:3060] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.112293 21948 raft_consensus.cc:2468] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 2.
I20260709 13:05:41.113063 21949 raft_consensus.cc:1240] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Rejecting Update request from peer b20008ad779b4b8f93a2bc33f137e2cd for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:05:41.113684 21990 leader_election.cc:304] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:41.114663 22160 raft_consensus.cc:2804] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.115164 22160 raft_consensus.cc:697] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Becoming Leader. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:41.115976 22160 consensus_queue.cc:237] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.114632 22097 raft_consensus.cc:2468] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 2.
I20260709 13:05:41.123853 21847 catalog_manager.cc:5697] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 reported cstate change: term changed from 1 to 2, leader changed from b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3) to bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "bd27a2d35b9e4722825b35bba658dc15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.150486 22160 raft_consensus.cc:993] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15: : Instructing follower 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:41.150914 22144 raft_consensus.cc:1081] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Signalling peer 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:41.152516 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8094ed2465f84b6caa1d51d92eb2c9c6"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:46032
I20260709 13:05:41.153018 21949 raft_consensus.cc:493] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.153312 21949 raft_consensus.cc:3060] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.158255 21949 raft_consensus.cc:515] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.159997 21949 leader_election.cc:290] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 2 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:41.160856 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8094ed2465f84b6caa1d51d92eb2c9c6" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:41.161145 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8094ed2465f84b6caa1d51d92eb2c9c6" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:41.161476 22023 raft_consensus.cc:3055] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.161706 22097 raft_consensus.cc:3060] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.161890 22023 raft_consensus.cc:740] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:41.162801 22023 consensus_queue.cc:260] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.164065 22023 raft_consensus.cc:3060] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.166639 22097 raft_consensus.cc:2468] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 2.
I20260709 13:05:41.168128 21914 leader_election.cc:304] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:41.170107 22174 raft_consensus.cc:2804] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.170626 22174 raft_consensus.cc:697] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:41.171439 22174 consensus_queue.cc:237] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.173153 22023 raft_consensus.cc:2468] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 2.
I20260709 13:05:41.179055 21847 catalog_manager.cc:5697] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 1 to 2, leader changed from bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2) to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.190146 22213 raft_consensus.cc:993] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd: : Instructing follower 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:41.190562 22179 raft_consensus.cc:1081] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Signalling peer 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:41.192080 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:46040
I20260709 13:05:41.192718 21949 raft_consensus.cc:493] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.193095 21949 raft_consensus.cc:3060] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.197772 21949 raft_consensus.cc:515] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:41.199447 21949 leader_election.cc:290] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 2 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:41.200296 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:41.200621 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:41.200938 22023 raft_consensus.cc:3060] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.201143 22097 raft_consensus.cc:3055] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.201462 22097 raft_consensus.cc:740] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:41.202083 22097 consensus_queue.cc:260] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:41.202940 22097 raft_consensus.cc:3060] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.205742 22023 raft_consensus.cc:2468] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 2.
I20260709 13:05:41.206817 21914 leader_election.cc:304] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:41.207469 22174 raft_consensus.cc:2804] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.207459 22097 raft_consensus.cc:2468] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 2.
I20260709 13:05:41.208117 22174 raft_consensus.cc:697] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:41.208932 22174 consensus_queue.cc:237] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:41.215502 21847 catalog_manager.cc:5697] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 1 to 2, leader changed from b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3) to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.256459 22213 raft_consensus.cc:993] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd: : Instructing follower bd27a2d35b9e4722825b35bba658dc15 to start an election
I20260709 13:05:41.256948 22179 raft_consensus.cc:1081] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Signalling peer bd27a2d35b9e4722825b35bba658dc15 to start an election
I20260709 13:05:41.258456 22023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6"
dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
 from {username='slave'} at 127.0.0.1:57736
I20260709 13:05:41.258929 22023 raft_consensus.cc:493] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.259284 22023 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.264151 22023 raft_consensus.cc:515] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.265976 22023 leader_election.cc:290] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 2 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:41.266861 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:41.267124 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:41.267517 21949 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.267689 22097 raft_consensus.cc:3055] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.268060 22097 raft_consensus.cc:740] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:41.268786 22097 consensus_queue.cc:260] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.269703 22097 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.272764 21949 raft_consensus.cc:2468] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 2.
I20260709 13:05:41.274092 21990 leader_election.cc:304] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:41.274968 22144 raft_consensus.cc:2804] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.275449 22144 raft_consensus.cc:697] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Becoming Leader. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:41.276273 22144 consensus_queue.cc:237] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:41.277127 22097 raft_consensus.cc:2468] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 2.
I20260709 13:05:41.283627 21847 catalog_manager.cc:5697] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 reported cstate change: term changed from 1 to 2, leader changed from b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3) to bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "bd27a2d35b9e4722825b35bba658dc15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.420266 22023 raft_consensus.cc:1275] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.421576 22174 consensus_queue.cc:1048] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.429281 22099 raft_consensus.cc:1275] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.431744 22175 consensus_queue.cc:1048] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.488971 21949 raft_consensus.cc:1275] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Refusing update from remote peer bd27a2d35b9e4722825b35bba658dc15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.490291 22144 consensus_queue.cc:1048] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.498100 22099 raft_consensus.cc:1275] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Refusing update from remote peer bd27a2d35b9e4722825b35bba658dc15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.499837 22144 consensus_queue.cc:1048] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.553131 22023 raft_consensus.cc:1275] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.554275 22175 consensus_queue.cc:1048] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.561372 22099 raft_consensus.cc:1275] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.563016 22174 consensus_queue.cc:1048] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.596333 21949 raft_consensus.cc:1275] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Refusing update from remote peer b20008ad779b4b8f93a2bc33f137e2cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.597801 22179 consensus_queue.cc:1048] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.604967 22023 raft_consensus.cc:1275] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Refusing update from remote peer b20008ad779b4b8f93a2bc33f137e2cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.606745 22177 consensus_queue.cc:1048] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.706013 21949 raft_consensus.cc:1275] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Refusing update from remote peer bd27a2d35b9e4722825b35bba658dc15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.707300 22144 consensus_queue.cc:1048] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.717558 22099 raft_consensus.cc:1275] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Refusing update from remote peer bd27a2d35b9e4722825b35bba658dc15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.718883 22160 consensus_queue.cc:1048] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.724534 22097 raft_consensus.cc:1275] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Refusing update from remote peer bd27a2d35b9e4722825b35bba658dc15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.725770 22160 consensus_queue.cc:1048] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.736181 21949 raft_consensus.cc:1275] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Refusing update from remote peer bd27a2d35b9e4722825b35bba658dc15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.737361 22229 consensus_queue.cc:1048] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.755784 22097 raft_consensus.cc:1275] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.756954 22174 consensus_queue.cc:1048] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.765228 22023 raft_consensus.cc:1275] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.767045 22145 consensus_queue.cc:1048] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.844633 21312 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:43.845403 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:43.861730 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
mode: GRACEFUL
new_leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
 from {username='slave'} at 127.0.0.1:46068
I20260709 13:05:43.862227 21949 raft_consensus.cc:606] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Received request to transfer leadership to TS b20008ad779b4b8f93a2bc33f137e2cd
I20260709 13:05:43.864992 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
mode: GRACEFUL
new_leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
 from {username='slave'} at 127.0.0.1:46068
I20260709 13:05:43.865617 21949 raft_consensus.cc:606] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Received request to transfer leadership to TS b20008ad779b4b8f93a2bc33f137e2cd
I20260709 13:05:43.867712 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:43.868389 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:43.903512 22237 raft_consensus.cc:993] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2: : Instructing follower b20008ad779b4b8f93a2bc33f137e2cd to start an election
I20260709 13:05:43.903913 22145 raft_consensus.cc:1081] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Signalling peer b20008ad779b4b8f93a2bc33f137e2cd to start an election
I20260709 13:05:43.905409 22097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:05:43.905887 22097 raft_consensus.cc:493] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.906167 22097 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.910408 22097 raft_consensus.cc:515] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:43.911880 22097 leader_election.cc:290] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 2 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:43.912734 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:43.912864 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:43.913285 21949 raft_consensus.cc:3055] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.913347 22023 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.913661 21949 raft_consensus.cc:740] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:43.914326 21949 consensus_queue.cc:260] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:43.915251 21949 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.918143 22023 raft_consensus.cc:2468] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 2.
I20260709 13:05:43.919279 22063 leader_election.cc:304] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:43.919806 21949 raft_consensus.cc:2468] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 2.
I20260709 13:05:43.919950 22236 raft_consensus.cc:2804] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.921061 22236 raft_consensus.cc:697] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Becoming Leader. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:43.921787 22236 consensus_queue.cc:237] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:43.928857 21845 catalog_manager.cc:5697] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd reported cstate change: term changed from 1 to 2, leader changed from 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1) to b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3). New cstate: current_term: 2 leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.081957 22237 raft_consensus.cc:993] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2: : Instructing follower b20008ad779b4b8f93a2bc33f137e2cd to start an election
I20260709 13:05:44.082367 22145 raft_consensus.cc:1081] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Signalling peer b20008ad779b4b8f93a2bc33f137e2cd to start an election
I20260709 13:05:44.083941 22097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:05:44.084539 22097 raft_consensus.cc:493] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.084818 22097 raft_consensus.cc:3060] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:44.088745 22097 raft_consensus.cc:515] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.090291 22097 leader_election.cc:290] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 2 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:44.091132 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:44.091325 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:44.091627 21949 raft_consensus.cc:3055] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:44.091799 22023 raft_consensus.cc:3060] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:44.091931 21949 raft_consensus.cc:740] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:44.092724 21949 consensus_queue.cc:260] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.093626 21949 raft_consensus.cc:3060] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:44.096454 22023 raft_consensus.cc:2468] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 2.
I20260709 13:05:44.097607 22063 leader_election.cc:304] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:44.098438 22236 raft_consensus.cc:2804] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:44.098837 22236 raft_consensus.cc:697] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Becoming Leader. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:44.099117 21949 raft_consensus.cc:2468] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 2.
I20260709 13:05:44.099555 22236 consensus_queue.cc:237] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.106178 21845 catalog_manager.cc:5697] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd reported cstate change: term changed from 1 to 2, leader changed from 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1) to b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3). New cstate: current_term: 2 leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.456444 21949 raft_consensus.cc:1275] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Refusing update from remote peer b20008ad779b4b8f93a2bc33f137e2cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:44.457690 22236 consensus_queue.cc:1048] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.466789 22023 raft_consensus.cc:1275] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Refusing update from remote peer b20008ad779b4b8f93a2bc33f137e2cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:44.468509 22249 consensus_queue.cc:1048] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:44.503031 21949 raft_consensus.cc:1275] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Refusing update from remote peer b20008ad779b4b8f93a2bc33f137e2cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:44.504230 22249 consensus_queue.cc:1048] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.513450 22023 raft_consensus.cc:1275] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Refusing update from remote peer b20008ad779b4b8f93a2bc33f137e2cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:44.515239 22240 consensus_queue.cc:1048] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.869290 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:44.884778 22097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
mode: GRACEFUL
new_leader_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:42454
I20260709 13:05:44.885279 22097 raft_consensus.cc:606] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Received request to transfer leadership to TS 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:44.893193 22097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
mode: GRACEFUL
new_leader_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:42454
I20260709 13:05:44.893656 22097 raft_consensus.cc:606] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Received request to transfer leadership to TS 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:44.898262 22023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc"
dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
mode: GRACEFUL
new_leader_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:57750
I20260709 13:05:44.898744 22023 raft_consensus.cc:606] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Received request to transfer leadership to TS 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:44.903570 22023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23"
dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
mode: GRACEFUL
new_leader_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:57750
I20260709 13:05:44.904039 22023 raft_consensus.cc:606] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Received request to transfer leadership to TS 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:44.908794 22023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6"
dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
mode: GRACEFUL
new_leader_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:57750
I20260709 13:05:44.909289 22023 raft_consensus.cc:606] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Received request to transfer leadership to TS 150d714edd0d4abd9846b82908a3f9d2
I20260709 13:05:44.916231 22256 raft_consensus.cc:993] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15: : Instructing follower 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:44.916711 22229 raft_consensus.cc:1081] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Signalling peer 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:44.918171 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:46032
I20260709 13:05:44.918648 21949 raft_consensus.cc:493] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.918939 21949 raft_consensus.cc:3060] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.923460 21949 raft_consensus.cc:515] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.925055 21949 leader_election.cc:290] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 3 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:44.925940 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:44.925997 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef699d7334c4a830e657fbf6abbdc" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:44.926599 22023 raft_consensus.cc:3055] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.926649 22097 raft_consensus.cc:3060] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.926890 22023 raft_consensus.cc:740] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:44.927573 22023 consensus_queue.cc:260] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.928421 22023 raft_consensus.cc:3060] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.931237 22097 raft_consensus.cc:2468] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 3.
I20260709 13:05:44.933092 21914 leader_election.cc:304] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:44.933836 22145 raft_consensus.cc:2804] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.934118 22023 raft_consensus.cc:2468] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 3.
I20260709 13:05:44.934885 22229 raft_consensus.cc:993] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15: : Instructing follower 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:44.935297 22145 raft_consensus.cc:697] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:44.936348 22229 raft_consensus.cc:1081] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Signalling peer 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:44.936240 22145 consensus_queue.cc:237] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.937934 21948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:46032
I20260709 13:05:44.938396 21948 raft_consensus.cc:493] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.938705 21948 raft_consensus.cc:3060] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.943506 21847 catalog_manager.cc:5697] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 2 to 3, leader changed from bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2) to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:44.944334 21948 raft_consensus.cc:515] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.946182 21948 leader_election.cc:290] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 3 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:44.947345 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:44.947661 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1445a2d3dd0f4b2fb79c2a8ab748ba23" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:44.947947 22023 raft_consensus.cc:3055] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.948113 22097 raft_consensus.cc:3060] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.952592 22023 raft_consensus.cc:740] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:44.954177 22254 raft_consensus.cc:993] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd: : Instructing follower 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:44.954034 22097 raft_consensus.cc:2468] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 3.
I20260709 13:05:44.954710 22254 raft_consensus.cc:1081] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Signalling peer 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:44.953997 22023 consensus_queue.cc:260] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.955705 22023 raft_consensus.cc:3060] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.955572 21914 leader_election.cc:304] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:44.956574 22145 raft_consensus.cc:2804] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.956730 21948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:46040
I20260709 13:05:44.957124 22145 raft_consensus.cc:697] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:44.957387 21948 raft_consensus.cc:493] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.957809 21948 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.958005 22145 consensus_queue.cc:237] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.964502 21948 raft_consensus.cc:515] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.967533 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:44.968112 22023 raft_consensus.cc:2468] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 3.
I20260709 13:05:44.968173 22025 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.968732 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:44.969228 22097 raft_consensus.cc:3055] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.969410 21948 leader_election.cc:290] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 3 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:44.969511 22097 raft_consensus.cc:740] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:44.969635 21847 catalog_manager.cc:5697] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 2 to 3, leader changed from bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2) to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:44.970382 22097 consensus_queue.cc:260] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.971518 22097 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.975745 22025 raft_consensus.cc:2468] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 3.
I20260709 13:05:44.977046 21914 leader_election.cc:304] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:44.977679 22097 raft_consensus.cc:2468] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 3.
I20260709 13:05:44.977849 22145 raft_consensus.cc:2804] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.978391 22145 raft_consensus.cc:697] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:44.979117 22145 consensus_queue.cc:237] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:44.984826 21847 catalog_manager.cc:5697] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 2 to 3, leader changed from b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3) to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.054390 22240 raft_consensus.cc:993] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd: : Instructing follower 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:45.054870 22254 raft_consensus.cc:1081] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Signalling peer 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:45.056500 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:46040
I20260709 13:05:45.057080 21949 raft_consensus.cc:493] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.057437 21949 raft_consensus.cc:3060] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.062202 21949 raft_consensus.cc:515] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:45.064663 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:45.065251 22023 raft_consensus.cc:3060] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.066509 21949 leader_election.cc:290] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 3 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:45.068892 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce202f928598437c8bf300c5d31915cc" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:45.069437 22097 raft_consensus.cc:3055] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.069732 22097 raft_consensus.cc:740] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:45.070868 22097 consensus_queue.cc:260] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:45.071542 22023 raft_consensus.cc:2468] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 3.
I20260709 13:05:45.071715 22097 raft_consensus.cc:3060] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.072365 21914 leader_election.cc:304] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:45.073029 22145 raft_consensus.cc:2804] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:45.073495 22145 raft_consensus.cc:697] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:45.074251 22145 consensus_queue.cc:237] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:45.077644 22097 raft_consensus.cc:2468] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 3.
I20260709 13:05:45.080518 21847 catalog_manager.cc:5697] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 2 to 3, leader changed from b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3) to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.119326 22256 raft_consensus.cc:993] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15: : Instructing follower 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:45.119692 22229 raft_consensus.cc:1081] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Signalling peer 150d714edd0d4abd9846b82908a3f9d2 to start an election
I20260709 13:05:45.121177 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
 from {username='slave'} at 127.0.0.1:46032
I20260709 13:05:45.121610 21949 raft_consensus.cc:493] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.121863 21949 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.125905 21949 raft_consensus.cc:515] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:45.127388 21949 leader_election.cc:290] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 3 election: Requested vote from peers bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:45.128175 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:45.128399 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "150d714edd0d4abd9846b82908a3f9d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:45.128665 22023 raft_consensus.cc:3055] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.128993 22097 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.128995 22023 raft_consensus.cc:740] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:45.129894 22023 consensus_queue.cc:260] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:45.130815 22023 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.133461 22097 raft_consensus.cc:2468] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 3.
I20260709 13:05:45.134445 21914 leader_election.cc:304] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150d714edd0d4abd9846b82908a3f9d2, b20008ad779b4b8f93a2bc33f137e2cd; no voters: 
I20260709 13:05:45.135157 22145 raft_consensus.cc:2804] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:45.135625 22145 raft_consensus.cc:697] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Becoming Leader. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:45.136684 22023 raft_consensus.cc:2468] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150d714edd0d4abd9846b82908a3f9d2 in term 3.
I20260709 13:05:45.136391 22145 consensus_queue.cc:237] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:45.143092 21847 catalog_manager.cc:5697] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 reported cstate change: term changed from 2 to 3, leader changed from bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2) to 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "150d714edd0d4abd9846b82908a3f9d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.350082 22097 raft_consensus.cc:1275] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.351290 22145 consensus_queue.cc:1048] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.361151 22023 raft_consensus.cc:1275] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.362396 22268 consensus_queue.cc:1048] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.370949 22097 raft_consensus.cc:1275] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.372124 22268 consensus_queue.cc:1048] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.381511 22023 raft_consensus.cc:1275] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.383066 22257 consensus_queue.cc:1048] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.464244 22023 raft_consensus.cc:1275] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.465497 22257 consensus_queue.cc:1048] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.472891 22097 raft_consensus.cc:1275] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.474785 22145 consensus_queue.cc:1048] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.541054 22023 raft_consensus.cc:1275] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.542188 22145 consensus_queue.cc:1048] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.551641 22097 raft_consensus.cc:1275] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.552830 22257 consensus_queue.cc:1048] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.577615 22097 raft_consensus.cc:1275] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.578733 22257 consensus_queue.cc:1048] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.587653 22023 raft_consensus.cc:1275] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Refusing update from remote peer 150d714edd0d4abd9846b82908a3f9d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.589690 22145 consensus_queue.cc:1048] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.917270 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:47.925328 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
mode: GRACEFUL
new_leader_uuid: "bd27a2d35b9e4722825b35bba658dc15"
 from {username='slave'} at 127.0.0.1:46068
I20260709 13:05:47.925977 21949 raft_consensus.cc:606] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Received request to transfer leadership to TS bd27a2d35b9e4722825b35bba658dc15
I20260709 13:05:47.928431 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
mode: GRACEFUL
new_leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
 from {username='slave'} at 127.0.0.1:46068
I20260709 13:05:47.928884 21949 raft_consensus.cc:606] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Received request to transfer leadership to TS b20008ad779b4b8f93a2bc33f137e2cd
I20260709 13:05:47.931097 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
mode: GRACEFUL
new_leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
 from {username='slave'} at 127.0.0.1:46068
I20260709 13:05:47.931514 21949 raft_consensus.cc:606] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Received request to transfer leadership to TS b20008ad779b4b8f93a2bc33f137e2cd
I20260709 13:05:47.933815 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6"
dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
mode: GRACEFUL
new_leader_uuid: "bd27a2d35b9e4722825b35bba658dc15"
 from {username='slave'} at 127.0.0.1:46068
I20260709 13:05:47.934283 21949 raft_consensus.cc:606] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Received request to transfer leadership to TS bd27a2d35b9e4722825b35bba658dc15
I20260709 13:05:47.935324 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:47.935815 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:48.008183 22281 raft_consensus.cc:993] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2: : Instructing follower b20008ad779b4b8f93a2bc33f137e2cd to start an election
I20260709 13:05:48.008630 22281 raft_consensus.cc:1081] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Signalling peer b20008ad779b4b8f93a2bc33f137e2cd to start an election
I20260709 13:05:48.010169 22099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:05:48.010684 22099 raft_consensus.cc:493] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.011051 22099 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.017581 22099 raft_consensus.cc:515] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:48.019485 22099 leader_election.cc:290] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 4 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:48.020712 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:48.020615 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c001d0afc34556b3b2d3913060d925" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:48.021486 22023 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.021526 21949 raft_consensus.cc:3055] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:48.021982 21949 raft_consensus.cc:740] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:48.022845 21949 consensus_queue.cc:260] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:48.024024 21949 raft_consensus.cc:3060] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.028358 22023 raft_consensus.cc:2468] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 4.
I20260709 13:05:48.029739 22063 leader_election.cc:304] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:48.030347 21949 raft_consensus.cc:2468] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 4.
I20260709 13:05:48.030602 22254 raft_consensus.cc:2804] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:48.031599 22254 raft_consensus.cc:697] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 4 LEADER]: Becoming Leader. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:48.032506 22254 consensus_queue.cc:237] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:48.039280 21846 catalog_manager.cc:5697] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd reported cstate change: term changed from 3 to 4, leader changed from 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1) to b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3). New cstate: current_term: 4 leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.096213 22282 raft_consensus.cc:993] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2: : Instructing follower bd27a2d35b9e4722825b35bba658dc15 to start an election
I20260709 13:05:48.096657 22281 raft_consensus.cc:1081] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Signalling peer bd27a2d35b9e4722825b35bba658dc15 to start an election
I20260709 13:05:48.098183 22025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e"
dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:05:48.098667 22025 raft_consensus.cc:493] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.099011 22025 raft_consensus.cc:3060] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.104616 22025 raft_consensus.cc:515] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:48.106554 22025 leader_election.cc:290] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 3 election: Requested vote from peers b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233), 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495)
I20260709 13:05:48.107653 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:48.107735 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b5cba35d084b678a85ce9d6ea1ef1e" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:48.108383 22099 raft_consensus.cc:3060] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.108536 21949 raft_consensus.cc:3055] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:48.108878 21949 raft_consensus.cc:740] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:48.109755 21949 consensus_queue.cc:260] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:48.110991 21949 raft_consensus.cc:3060] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.115602 22099 raft_consensus.cc:2468] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 3.
I20260709 13:05:48.117152 21989 leader_election.cc:304] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:48.117300 21949 raft_consensus.cc:2468] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 3.
I20260709 13:05:48.118148 22229 raft_consensus.cc:2804] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.119187 22229 raft_consensus.cc:697] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 3 LEADER]: Becoming Leader. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:48.119928 22229 consensus_queue.cc:237] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } }
I20260709 13:05:48.127300 21846 catalog_manager.cc:5697] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 reported cstate change: term changed from 2 to 3, leader changed from 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1) to bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "bd27a2d35b9e4722825b35bba658dc15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.362530 22282 raft_consensus.cc:993] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2: : Instructing follower bd27a2d35b9e4722825b35bba658dc15 to start an election
I20260709 13:05:48.362993 22281 raft_consensus.cc:1081] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Signalling peer bd27a2d35b9e4722825b35bba658dc15 to start an election
I20260709 13:05:48.364568 22025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6"
dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:05:48.365051 22025 raft_consensus.cc:493] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.365342 22025 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.370085 22025 raft_consensus.cc:515] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:48.371739 22025 leader_election.cc:290] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 4 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3:42233)
I20260709 13:05:48.372659 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:48.373170 21949 raft_consensus.cc:3055] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:48.373124 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68ec8226af4cc0b9dc3eb584418fd6" candidate_uuid: "bd27a2d35b9e4722825b35bba658dc15" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
I20260709 13:05:48.373478 21949 raft_consensus.cc:740] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:48.373680 22099 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.374171 21949 consensus_queue.cc:260] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:48.375012 21949 raft_consensus.cc:3060] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.378465 22099 raft_consensus.cc:2468] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 4.
I20260709 13:05:48.379060 21949 raft_consensus.cc:2468] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd27a2d35b9e4722825b35bba658dc15 in term 4.
I20260709 13:05:48.379524 21989 leader_election.cc:304] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:48.380275 22229 raft_consensus.cc:2804] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:48.380676 22229 raft_consensus.cc:697] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 4 LEADER]: Becoming Leader. State: Replica: bd27a2d35b9e4722825b35bba658dc15, State: Running, Role: LEADER
I20260709 13:05:48.381443 22229 consensus_queue.cc:237] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:48.387847 21846 catalog_manager.cc:5697] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 reported cstate change: term changed from 3 to 4, leader changed from 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1) to bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2). New cstate: current_term: 4 leader_uuid: "bd27a2d35b9e4722825b35bba658dc15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.394850 22282 raft_consensus.cc:993] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2: : Instructing follower b20008ad779b4b8f93a2bc33f137e2cd to start an election
I20260709 13:05:48.395358 22282 raft_consensus.cc:1081] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Signalling peer b20008ad779b4b8f93a2bc33f137e2cd to start an election
I20260709 13:05:48.396867 22099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f"
dest_uuid: "b20008ad779b4b8f93a2bc33f137e2cd"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:05:48.397342 22099 raft_consensus.cc:493] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.397620 22099 raft_consensus.cc:3060] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.402446 22099 raft_consensus.cc:515] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:48.404166 22099 leader_election.cc:290] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 3 election: Requested vote from peers 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1:46495), bd27a2d35b9e4722825b35bba658dc15 (127.20.208.2:35623)
I20260709 13:05:48.405040 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "150d714edd0d4abd9846b82908a3f9d2"
I20260709 13:05:48.405313 22025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a50de642a0044cda051e93ed9d4d66f" candidate_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd27a2d35b9e4722825b35bba658dc15"
I20260709 13:05:48.405567 21949 raft_consensus.cc:3055] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:48.405827 22025 raft_consensus.cc:3060] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.405859 21949 raft_consensus.cc:740] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 150d714edd0d4abd9846b82908a3f9d2, State: Running, Role: LEADER
I20260709 13:05:48.406688 21949 consensus_queue.cc:260] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:48.407577 21949 raft_consensus.cc:3060] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.410789 22025 raft_consensus.cc:2468] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 3.
I20260709 13:05:48.412000 21949 raft_consensus.cc:2468] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b20008ad779b4b8f93a2bc33f137e2cd in term 3.
I20260709 13:05:48.411891 22063 leader_election.cc:304] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b20008ad779b4b8f93a2bc33f137e2cd, bd27a2d35b9e4722825b35bba658dc15; no voters: 
I20260709 13:05:48.412926 22254 raft_consensus.cc:2804] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.413370 22254 raft_consensus.cc:697] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 3 LEADER]: Becoming Leader. State: Replica: b20008ad779b4b8f93a2bc33f137e2cd, State: Running, Role: LEADER
I20260709 13:05:48.414124 22254 consensus_queue.cc:237] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } }
I20260709 13:05:48.420797 21846 catalog_manager.cc:5697] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd reported cstate change: term changed from 2 to 3, leader changed from 150d714edd0d4abd9846b82908a3f9d2 (127.20.208.1) to b20008ad779b4b8f93a2bc33f137e2cd (127.20.208.3). New cstate: current_term: 3 leader_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.499064 22025 raft_consensus.cc:1275] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 4 FOLLOWER]: Refusing update from remote peer b20008ad779b4b8f93a2bc33f137e2cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:48.500406 22254 consensus_queue.cc:1048] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.512490 21949 raft_consensus.cc:1275] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 4 FOLLOWER]: Refusing update from remote peer b20008ad779b4b8f93a2bc33f137e2cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:48.514407 22283 consensus_queue.cc:1048] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:48.686856 21949 raft_consensus.cc:1275] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Refusing update from remote peer bd27a2d35b9e4722825b35bba658dc15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.688127 22229 consensus_queue.cc:1048] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.698302 22099 raft_consensus.cc:1275] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Refusing update from remote peer bd27a2d35b9e4722825b35bba658dc15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.699796 22229 consensus_queue.cc:1048] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.815158 22025 raft_consensus.cc:1275] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Refusing update from remote peer b20008ad779b4b8f93a2bc33f137e2cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.817206 22283 consensus_queue.cc:1048] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd27a2d35b9e4722825b35bba658dc15" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:48.821862 21949 raft_consensus.cc:1275] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 4 FOLLOWER]: Refusing update from remote peer bd27a2d35b9e4722825b35bba658dc15: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:48.824074 22229 consensus_queue.cc:1048] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:48.832000 21948 raft_consensus.cc:1275] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Refusing update from remote peer b20008ad779b4b8f93a2bc33f137e2cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.834614 22254 consensus_queue.cc:1048] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d714edd0d4abd9846b82908a3f9d2" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.838069 22099 raft_consensus.cc:1275] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 4 FOLLOWER]: Refusing update from remote peer bd27a2d35b9e4722825b35bba658dc15: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:48.839660 22289 consensus_queue.cc:1048] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b20008ad779b4b8f93a2bc33f137e2cd" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.936589 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:48.942811 21312 tablet_server.cc:179] TabletServer@127.20.208.1:0 shutting down...
I20260709 13:05:48.960642 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:48.961383 21312 tablet_replica.cc:333] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2: stopping tablet replica
I20260709 13:05:48.961971 21312 raft_consensus.cc:2243] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:48.962406 21312 raft_consensus.cc:2272] T 27b5cba35d084b678a85ce9d6ea1ef1e P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.964694 21312 tablet_replica.cc:333] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2: stopping tablet replica
I20260709 13:05:48.965178 21312 raft_consensus.cc:2243] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:48.965564 21312 raft_consensus.cc:2272] T 4a50de642a0044cda051e93ed9d4d66f P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.968045 21312 tablet_replica.cc:333] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2: stopping tablet replica
I20260709 13:05:48.968668 21312 raft_consensus.cc:2243] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:48.969179 21312 raft_consensus.cc:2272] T ba68ec8226af4cc0b9dc3eb584418fd6 P 150d714edd0d4abd9846b82908a3f9d2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.971107 21312 tablet_replica.cc:333] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2: stopping tablet replica
I20260709 13:05:48.971587 21312 raft_consensus.cc:2243] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:48.972255 21312 raft_consensus.cc:2272] T ce202f928598437c8bf300c5d31915cc P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.973896 21312 tablet_replica.cc:333] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2: stopping tablet replica
I20260709 13:05:48.974370 21312 raft_consensus.cc:2243] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:48.974783 21312 raft_consensus.cc:2272] T 2174580a94f34eba9474a803566a10c1 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.976533 21312 tablet_replica.cc:333] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2: stopping tablet replica
I20260709 13:05:48.977032 21312 raft_consensus.cc:2243] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:48.977725 21312 raft_consensus.cc:2272] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.979449 21312 tablet_replica.cc:333] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2: stopping tablet replica
I20260709 13:05:48.979924 21312 raft_consensus.cc:2243] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:48.980670 21312 raft_consensus.cc:2272] T 9d2ef699d7334c4a830e657fbf6abbdc P 150d714edd0d4abd9846b82908a3f9d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.982381 21312 tablet_replica.cc:333] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2: stopping tablet replica
I20260709 13:05:48.982831 21312 raft_consensus.cc:2243] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:48.983204 21312 raft_consensus.cc:2272] T fced5b5c63a34eb98772f253854ec95b P 150d714edd0d4abd9846b82908a3f9d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.985009 21312 tablet_replica.cc:333] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2: stopping tablet replica
I20260709 13:05:48.985482 21312 raft_consensus.cc:2243] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:48.986202 21312 raft_consensus.cc:2272] T 8094ed2465f84b6caa1d51d92eb2c9c6 P 150d714edd0d4abd9846b82908a3f9d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.988147 21312 tablet_replica.cc:333] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2: stopping tablet replica
I20260709 13:05:48.988637 21312 raft_consensus.cc:2243] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:48.989015 21312 raft_consensus.cc:2272] T 55c001d0afc34556b3b2d3913060d925 P 150d714edd0d4abd9846b82908a3f9d2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.019037 21312 tablet_server.cc:196] TabletServer@127.20.208.1:0 shutdown complete.
I20260709 13:05:49.039801 21312 tablet_server.cc:179] TabletServer@127.20.208.2:0 shutting down...
I20260709 13:05:49.068209 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.068964 21312 tablet_replica.cc:333] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15: stopping tablet replica
I20260709 13:05:49.069561 21312 raft_consensus.cc:2243] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.070034 21312 raft_consensus.cc:2272] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.071892 21312 tablet_replica.cc:333] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15: stopping tablet replica
I20260709 13:05:49.072546 21312 raft_consensus.cc:2243] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.073036 21312 raft_consensus.cc:2272] T 9d2ef699d7334c4a830e657fbf6abbdc P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.074715 21312 tablet_replica.cc:333] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15: stopping tablet replica
I20260709 13:05:49.075202 21312 raft_consensus.cc:2243] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.075914 21312 raft_consensus.cc:2272] T fced5b5c63a34eb98772f253854ec95b P bd27a2d35b9e4722825b35bba658dc15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.077714 21312 tablet_replica.cc:333] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15: stopping tablet replica
I20260709 13:05:49.078202 21312 raft_consensus.cc:2243] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.078616 21312 raft_consensus.cc:2272] T 8094ed2465f84b6caa1d51d92eb2c9c6 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.080392 21312 tablet_replica.cc:333] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15: stopping tablet replica
I20260709 13:05:49.080930 21312 raft_consensus.cc:2243] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.081653 21312 raft_consensus.cc:2272] T 27b5cba35d084b678a85ce9d6ea1ef1e P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.083686 21312 tablet_replica.cc:333] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15: stopping tablet replica
I20260709 13:05:49.084192 21312 raft_consensus.cc:2243] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.084713 21312 raft_consensus.cc:2272] T 2174580a94f34eba9474a803566a10c1 P bd27a2d35b9e4722825b35bba658dc15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.086323 21312 tablet_replica.cc:333] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15: stopping tablet replica
I20260709 13:05:49.086812 21312 raft_consensus.cc:2243] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.087507 21312 raft_consensus.cc:2272] T ba68ec8226af4cc0b9dc3eb584418fd6 P bd27a2d35b9e4722825b35bba658dc15 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.089422 21312 tablet_replica.cc:333] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15: stopping tablet replica
I20260709 13:05:49.089900 21312 raft_consensus.cc:2243] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.090317 21312 raft_consensus.cc:2272] T ce202f928598437c8bf300c5d31915cc P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.091924 21312 tablet_replica.cc:333] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15: stopping tablet replica
I20260709 13:05:49.092355 21312 raft_consensus.cc:2243] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.092775 21312 raft_consensus.cc:2272] T 55c001d0afc34556b3b2d3913060d925 P bd27a2d35b9e4722825b35bba658dc15 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.094813 21312 tablet_replica.cc:333] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15: stopping tablet replica
I20260709 13:05:49.095242 21312 raft_consensus.cc:2243] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.095655 21312 raft_consensus.cc:2272] T 4a50de642a0044cda051e93ed9d4d66f P bd27a2d35b9e4722825b35bba658dc15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.124533 21312 tablet_server.cc:196] TabletServer@127.20.208.2:0 shutdown complete.
I20260709 13:05:49.143038 21312 tablet_server.cc:179] TabletServer@127.20.208.3:0 shutting down...
I20260709 13:05:49.164606 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.165293 21312 tablet_replica.cc:333] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd: stopping tablet replica
I20260709 13:05:49.165864 21312 raft_consensus.cc:2243] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.166399 21312 raft_consensus.cc:2272] T 9d2ef699d7334c4a830e657fbf6abbdc P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.168215 21312 tablet_replica.cc:333] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd: stopping tablet replica
I20260709 13:05:49.168773 21312 raft_consensus.cc:2243] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.169179 21312 raft_consensus.cc:2272] T fced5b5c63a34eb98772f253854ec95b P b20008ad779b4b8f93a2bc33f137e2cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.170892 21312 tablet_replica.cc:333] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd: stopping tablet replica
I20260709 13:05:49.171355 21312 raft_consensus.cc:2243] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.171793 21312 raft_consensus.cc:2272] T 1445a2d3dd0f4b2fb79c2a8ab748ba23 P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.173461 21312 tablet_replica.cc:333] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd: stopping tablet replica
I20260709 13:05:49.173936 21312 raft_consensus.cc:2243] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.174657 21312 raft_consensus.cc:2272] T 2174580a94f34eba9474a803566a10c1 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.176245 21312 tablet_replica.cc:333] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd: stopping tablet replica
I20260709 13:05:49.176746 21312 raft_consensus.cc:2243] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.177134 21312 raft_consensus.cc:2272] T ce202f928598437c8bf300c5d31915cc P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.178649 21312 tablet_replica.cc:333] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd: stopping tablet replica
I20260709 13:05:49.179096 21312 raft_consensus.cc:2243] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.179498 21312 raft_consensus.cc:2272] T ba68ec8226af4cc0b9dc3eb584418fd6 P b20008ad779b4b8f93a2bc33f137e2cd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.181540 21312 tablet_replica.cc:333] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd: stopping tablet replica
I20260709 13:05:49.182027 21312 raft_consensus.cc:2243] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.182426 21312 raft_consensus.cc:2272] T 27b5cba35d084b678a85ce9d6ea1ef1e P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.184512 21312 tablet_replica.cc:333] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd: stopping tablet replica
I20260709 13:05:49.185000 21312 raft_consensus.cc:2243] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.185393 21312 raft_consensus.cc:2272] T 8094ed2465f84b6caa1d51d92eb2c9c6 P b20008ad779b4b8f93a2bc33f137e2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.186950 21312 tablet_replica.cc:333] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd: stopping tablet replica
I20260709 13:05:49.187382 21312 raft_consensus.cc:2243] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.188086 21312 raft_consensus.cc:2272] T 55c001d0afc34556b3b2d3913060d925 P b20008ad779b4b8f93a2bc33f137e2cd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.189965 21312 tablet_replica.cc:333] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd: stopping tablet replica
I20260709 13:05:49.190430 21312 raft_consensus.cc:2243] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.191169 21312 raft_consensus.cc:2272] T 4a50de642a0044cda051e93ed9d4d66f P b20008ad779b4b8f93a2bc33f137e2cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.209438 21312 tablet_server.cc:196] TabletServer@127.20.208.3:0 shutdown complete.
I20260709 13:05:49.226958 21312 master.cc:562] Master@127.20.208.62:37955 shutting down...
I20260709 13:05:49.245656 21312 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.246205 21312 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.246541 21312 tablet_replica.cc:333] T 00000000000000000000000000000000 P 77ad3b4116ad4d46bfb9f09646879145: stopping tablet replica
I20260709 13:05:49.265980 21312 master.cc:584] Master@127.20.208.62:37955 shutdown complete.
150d714edd0d4abd9846b82908a3f9d2  5
b20008ad779b4b8f93a2bc33f137e2cd  1
bd27a2d35b9e4722825b35bba658dc15  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10288 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:05:49.304171 21312 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.208.62:33169
I20260709 13:05:49.305344 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:49.310778 22306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:49.312083 22307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:49.312274 22309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.312377 21312 server_base.cc:1061] running on GCE node
I20260709 13:05:49.313452 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:49.313661 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:49.313814 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602349313796 us; error 0 us; skew 500 ppm
I20260709 13:05:49.314321 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:49.316848 21312 webserver.cc:533] Webserver started at http://127.20.208.62:40249/ using document root <none> and password file <none>
I20260709 13:05:49.317323 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:49.317509 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:49.317773 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:49.318878 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/master-0-root/instance:
uuid: "71b24ec4eeaf4affa54fd8c740a7795b"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-6j4g"
I20260709 13:05:49.323853 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:49.327368 22314 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.328281 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:49.328624 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/master-0-root
uuid: "71b24ec4eeaf4affa54fd8c740a7795b"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-6j4g"
I20260709 13:05:49.328909 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:49.346819 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:49.348117 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:49.386122 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.62:33169
I20260709 13:05:49.386219 22365 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.62:33169 every 8 connection(s)
I20260709 13:05:49.389846 22366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.399720 22366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Bootstrap starting.
I20260709 13:05:49.404371 22366 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.408533 22366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: No bootstrap required, opened a new log
I20260709 13:05:49.410667 22366 raft_consensus.cc:359] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b24ec4eeaf4affa54fd8c740a7795b" member_type: VOTER }
I20260709 13:05:49.411046 22366 raft_consensus.cc:385] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.411283 22366 raft_consensus.cc:740] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b24ec4eeaf4affa54fd8c740a7795b, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.411825 22366 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b24ec4eeaf4affa54fd8c740a7795b" member_type: VOTER }
I20260709 13:05:49.412283 22366 raft_consensus.cc:399] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:49.412528 22366 raft_consensus.cc:493] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:49.412787 22366 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.417063 22366 raft_consensus.cc:515] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b24ec4eeaf4affa54fd8c740a7795b" member_type: VOTER }
I20260709 13:05:49.417599 22366 leader_election.cc:304] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71b24ec4eeaf4affa54fd8c740a7795b; no voters: 
I20260709 13:05:49.418749 22366 leader_election.cc:290] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:49.419121 22369 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.420379 22369 raft_consensus.cc:697] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 1 LEADER]: Becoming Leader. State: Replica: 71b24ec4eeaf4affa54fd8c740a7795b, State: Running, Role: LEADER
I20260709 13:05:49.421072 22369 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b24ec4eeaf4affa54fd8c740a7795b" member_type: VOTER }
I20260709 13:05:49.421662 22366 sys_catalog.cc:565] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:49.425225 22370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71b24ec4eeaf4affa54fd8c740a7795b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b24ec4eeaf4affa54fd8c740a7795b" member_type: VOTER } }
I20260709 13:05:49.425866 22370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:49.426316 22371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71b24ec4eeaf4affa54fd8c740a7795b. Latest consensus state: current_term: 1 leader_uuid: "71b24ec4eeaf4affa54fd8c740a7795b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b24ec4eeaf4affa54fd8c740a7795b" member_type: VOTER } }
I20260709 13:05:49.427007 22371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:49.429941 22376 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:49.437110 22376 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:49.438006 21312 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:49.445551 22376 catalog_manager.cc:1383] Generated new cluster ID: 22781f87faac426e8d1eb1eef43a917d
I20260709 13:05:49.445809 22376 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:49.474690 22376 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:49.475901 22376 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:49.498298 22376 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Generated new TSK 0
I20260709 13:05:49.498852 22376 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:49.504684 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:49.510488 22387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:49.510960 22388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:49.513489 22390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.513969 21312 server_base.cc:1061] running on GCE node
I20260709 13:05:49.514729 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:49.514919 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:49.515075 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602349515056 us; error 0 us; skew 500 ppm
I20260709 13:05:49.515600 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:49.517864 21312 webserver.cc:533] Webserver started at http://127.20.208.1:33609/ using document root <none> and password file <none>
I20260709 13:05:49.518312 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:49.518482 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:49.518734 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:49.519770 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/instance:
uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-6j4g"
I20260709 13:05:49.524461 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:05:49.527683 22395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.528379 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:49.528712 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root
uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-6j4g"
I20260709 13:05:49.528982 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:49.552996 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:49.554261 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:49.555745 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:49.558043 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:49.558267 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.558497 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:49.558681 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.606215 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.1:43859
I20260709 13:05:49.606319 22457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.1:43859 every 8 connection(s)
I20260709 13:05:49.610975 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:49.617844 22462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:49.619702 22463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.620695 21312 server_base.cc:1061] running on GCE node
W20260709 13:05:49.622241 22466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.623239 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:49.623435 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:49.623621 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602349623600 us; error 0 us; skew 500 ppm
I20260709 13:05:49.624121 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:49.626708 21312 webserver.cc:533] Webserver started at http://127.20.208.2:34415/ using document root <none> and password file <none>
I20260709 13:05:49.627327 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:49.627584 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:49.627856 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:49.628289 22458 heartbeater.cc:344] Connected to a master server at 127.20.208.62:33169
I20260709 13:05:49.628651 22458 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:49.629128 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/instance:
uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-6j4g"
I20260709 13:05:49.629351 22458 heartbeater.cc:507] Master 127.20.208.62:33169 requested a full tablet report, sending...
I20260709 13:05:49.631567 22331 ts_manager.cc:194] Registered new tserver with Master: e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
I20260709 13:05:49.633448 22331 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33162
I20260709 13:05:49.634378 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.002s
I20260709 13:05:49.637867 22470 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.638624 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:49.638906 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root
uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-6j4g"
I20260709 13:05:49.639182 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:49.657677 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:49.658875 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:49.660316 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:49.662598 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:49.662783 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.663022 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:49.663164 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.701820 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.2:42819
I20260709 13:05:49.701932 22532 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.2:42819 every 8 connection(s)
I20260709 13:05:49.706444 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:49.713295 22536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:49.714102 22537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:49.716382 22539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.716602 21312 server_base.cc:1061] running on GCE node
I20260709 13:05:49.717509 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:49.717697 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:49.717901 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602349717881 us; error 0 us; skew 500 ppm
I20260709 13:05:49.718547 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:49.721141 22533 heartbeater.cc:344] Connected to a master server at 127.20.208.62:33169
I20260709 13:05:49.721338 21312 webserver.cc:533] Webserver started at http://127.20.208.3:34413/ using document root <none> and password file <none>
I20260709 13:05:49.721578 22533 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:49.721925 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:49.722150 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:49.722393 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:49.722353 22533 heartbeater.cc:507] Master 127.20.208.62:33169 requested a full tablet report, sending...
I20260709 13:05:49.723826 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/instance:
uuid: "10c2f471167442c0b75d8cd50ed8c40c"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-6j4g"
I20260709 13:05:49.724577 22331 ts_manager.cc:194] Registered new tserver with Master: e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:49.726051 22331 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33176
I20260709 13:05:49.728705 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:49.732271 22544 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.733024 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:49.733304 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root
uuid: "10c2f471167442c0b75d8cd50ed8c40c"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-6j4g"
I20260709 13:05:49.733594 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:49.748526 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:49.749748 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:49.751349 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:49.987995 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:49.988293 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.988584 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:49.989459 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:05:50.050343 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.3:40903
I20260709 13:05:50.050433 22606 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.3:40903 every 8 connection(s)
I20260709 13:05:50.069550 22607 heartbeater.cc:344] Connected to a master server at 127.20.208.62:33169
I20260709 13:05:50.069969 22607 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:50.070755 22607 heartbeater.cc:507] Master 127.20.208.62:33169 requested a full tablet report, sending...
I20260709 13:05:50.072883 22331 ts_manager.cc:194] Registered new tserver with Master: 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:50.072979 21312 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018610333s
I20260709 13:05:50.074251 22331 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43174
I20260709 13:05:50.099054 22331 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43182:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:50.105238 22331 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:50.299171 22423 tablet_service.cc:1511] Processing CreateTablet for tablet 54dce6002cc94eb7ae9be630281c202c (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:50.300176 22421 tablet_service.cc:1511] Processing CreateTablet for tablet e0a2c1c9e9dd4272a78e7cd3da913fad (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:50.300840 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dce6002cc94eb7ae9be630281c202c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.301478 22421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a2c1c9e9dd4272a78e7cd3da913fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.302796 22419 tablet_service.cc:1511] Processing CreateTablet for tablet 572a8927b7f349538a2b1f1300d659d2 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:50.302832 22420 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccaa43d7e2044a2b30eb79a52d79b64 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:50.299293 22422 tablet_service.cc:1511] Processing CreateTablet for tablet 07e24d8dba0542d7a1428819c63159f5 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:50.304338 22419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572a8927b7f349538a2b1f1300d659d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.311857 22418 tablet_service.cc:1511] Processing CreateTablet for tablet c9a63a987ca645719f59f026b5d252c9 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:50.314204 22418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a63a987ca645719f59f026b5d252c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.315477 22422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e24d8dba0542d7a1428819c63159f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.317349 22420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccaa43d7e2044a2b30eb79a52d79b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.318555 22417 tablet_service.cc:1511] Processing CreateTablet for tablet ff0a64e3152c4ccbbff4e78b6e82db2a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:50.319983 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0a64e3152c4ccbbff4e78b6e82db2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.326241 22492 tablet_service.cc:1511] Processing CreateTablet for tablet ff0a64e3152c4ccbbff4e78b6e82db2a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:50.327940 22492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0a64e3152c4ccbbff4e78b6e82db2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.341677 22416 tablet_service.cc:1511] Processing CreateTablet for tablet bdd4b2c523374ff98c16360fa254608c (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:50.343365 22416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd4b2c523374ff98c16360fa254608c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.320461 22497 tablet_service.cc:1511] Processing CreateTablet for tablet 07e24d8dba0542d7a1428819c63159f5 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:50.321600 22495 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccaa43d7e2044a2b30eb79a52d79b64 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:50.347030 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e24d8dba0542d7a1428819c63159f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.321611 22496 tablet_service.cc:1511] Processing CreateTablet for tablet e0a2c1c9e9dd4272a78e7cd3da913fad (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:50.322695 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 572a8927b7f349538a2b1f1300d659d2 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:50.322705 22493 tablet_service.cc:1511] Processing CreateTablet for tablet c9a63a987ca645719f59f026b5d252c9 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:50.323439 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 54dce6002cc94eb7ae9be630281c202c (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:50.352125 22496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a2c1c9e9dd4272a78e7cd3da913fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.354019 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dce6002cc94eb7ae9be630281c202c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.356822 22493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a63a987ca645719f59f026b5d252c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.360843 22495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccaa43d7e2044a2b30eb79a52d79b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.364857 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572a8927b7f349538a2b1f1300d659d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.369369 22491 tablet_service.cc:1511] Processing CreateTablet for tablet bdd4b2c523374ff98c16360fa254608c (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:50.371004 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd4b2c523374ff98c16360fa254608c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.393986 22572 tablet_service.cc:1511] Processing CreateTablet for tablet 54dce6002cc94eb7ae9be630281c202c (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:50.395411 22572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dce6002cc94eb7ae9be630281c202c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.396059 22570 tablet_service.cc:1511] Processing CreateTablet for tablet e0a2c1c9e9dd4272a78e7cd3da913fad (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:50.397567 22571 tablet_service.cc:1511] Processing CreateTablet for tablet 07e24d8dba0542d7a1428819c63159f5 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:50.398748 22569 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccaa43d7e2044a2b30eb79a52d79b64 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:50.401083 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 572a8927b7f349538a2b1f1300d659d2 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:50.402949 22565 tablet_service.cc:1511] Processing CreateTablet for tablet bdd4b2c523374ff98c16360fa254608c (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:50.403396 22567 tablet_service.cc:1511] Processing CreateTablet for tablet c9a63a987ca645719f59f026b5d252c9 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:50.405535 22566 tablet_service.cc:1511] Processing CreateTablet for tablet ff0a64e3152c4ccbbff4e78b6e82db2a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:50.397478 22570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a2c1c9e9dd4272a78e7cd3da913fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.407830 22571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e24d8dba0542d7a1428819c63159f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.409993 22490 tablet_service.cc:1511] Processing CreateTablet for tablet 64165ef33c5441ef8b91a67653951961 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:50.411018 22565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd4b2c523374ff98c16360fa254608c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.411392 22490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64165ef33c5441ef8b91a67653951961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.416846 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccaa43d7e2044a2b30eb79a52d79b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.420853 22566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0a64e3152c4ccbbff4e78b6e82db2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.423164 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a63a987ca645719f59f026b5d252c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.425769 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572a8927b7f349538a2b1f1300d659d2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:50.433382 22379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:50.436434 22564 tablet_service.cc:1511] Processing CreateTablet for tablet 64165ef33c5441ef8b91a67653951961 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:50.437949 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64165ef33c5441ef8b91a67653951961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.445770 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 0960e28f558c46c9bce238b59dea96f6 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:50.447420 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0960e28f558c46c9bce238b59dea96f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.457899 22418 tablet_service.cc:1511] Processing CreateTablet for tablet 0960e28f558c46c9bce238b59dea96f6 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:50.459630 22418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0960e28f558c46c9bce238b59dea96f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.461886 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 0960e28f558c46c9bce238b59dea96f6 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:50.464201 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0960e28f558c46c9bce238b59dea96f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.436506 22625 tablet_bootstrap.cc:492] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:50.477844 22420 tablet_service.cc:1511] Processing CreateTablet for tablet 64165ef33c5441ef8b91a67653951961 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:50.479730 22420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64165ef33c5441ef8b91a67653951961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.498438 22627 tablet_bootstrap.cc:492] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:50.499732 22626 tablet_bootstrap.cc:492] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:50.505120 22416 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3eb92518c7460abd36818ae39be5a0 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:50.506536 22416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3eb92518c7460abd36818ae39be5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.507010 22626 tablet_bootstrap.cc:654] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.512430 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3eb92518c7460abd36818ae39be5a0 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:50.513787 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3eb92518c7460abd36818ae39be5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.514271 22572 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3eb92518c7460abd36818ae39be5a0 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:50.515538 22421 tablet_service.cc:1511] Processing CreateTablet for tablet 73e134e5a00e463595325b431f07a3bd (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:50.515563 22572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3eb92518c7460abd36818ae39be5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.517668 22496 tablet_service.cc:1511] Processing CreateTablet for tablet 73e134e5a00e463595325b431f07a3bd (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:50.519007 22496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e134e5a00e463595325b431f07a3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.522631 22421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e134e5a00e463595325b431f07a3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.512207 22625 tablet_bootstrap.cc:654] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.533983 22627 tablet_bootstrap.cc:654] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.536077 22571 tablet_service.cc:1511] Processing CreateTablet for tablet 73e134e5a00e463595325b431f07a3bd (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:50.537712 22571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e134e5a00e463595325b431f07a3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.545876 22417 tablet_service.cc:1511] Processing CreateTablet for tablet 69f070e8e9ed4c95b36baa7f987d1fba (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:50.547242 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f070e8e9ed4c95b36baa7f987d1fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.549934 22626 tablet_bootstrap.cc:492] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:50.550575 22626 ts_tablet_manager.cc:1403] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.009s
I20260709 13:05:50.558761 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 69f070e8e9ed4c95b36baa7f987d1fba (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:50.560210 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f070e8e9ed4c95b36baa7f987d1fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.555841 22626 raft_consensus.cc:359] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.561657 22626 raft_consensus.cc:385] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.564077 22626 raft_consensus.cc:740] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.564424 22423 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac5249f314546e6a563fe498ff87f21 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:50.572801 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac5249f314546e6a563fe498ff87f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.565488 22491 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac5249f314546e6a563fe498ff87f21 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:50.575327 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac5249f314546e6a563fe498ff87f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.576815 22626 consensus_queue.cc:260] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.579082 22627 tablet_bootstrap.cc:492] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:50.579583 22627 ts_tablet_manager.cc:1403] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.004s
I20260709 13:05:50.581460 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac5249f314546e6a563fe498ff87f21 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:50.583396 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac5249f314546e6a563fe498ff87f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.586263 22418 tablet_service.cc:1511] Processing CreateTablet for tablet 06de1406fed544b39bf6d0ab441df770 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:50.587559 22418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06de1406fed544b39bf6d0ab441df770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.589284 22496 tablet_service.cc:1511] Processing CreateTablet for tablet 06de1406fed544b39bf6d0ab441df770 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:50.589277 22567 tablet_service.cc:1511] Processing CreateTablet for tablet 69f070e8e9ed4c95b36baa7f987d1fba (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:50.594158 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f070e8e9ed4c95b36baa7f987d1fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.595541 22422 tablet_service.cc:1511] Processing CreateTablet for tablet bcb965aeed0142a28f51999a91b1eb44 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:50.596855 22422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb965aeed0142a28f51999a91b1eb44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.601155 22496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06de1406fed544b39bf6d0ab441df770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.605286 22533 heartbeater.cc:499] Master 127.20.208.62:33169 was elected leader, sending a full tablet report...
I20260709 13:05:50.612164 22497 tablet_service.cc:1511] Processing CreateTablet for tablet bcb965aeed0142a28f51999a91b1eb44 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:50.613612 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb965aeed0142a28f51999a91b1eb44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.614346 22627 raft_consensus.cc:359] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.615120 22627 raft_consensus.cc:385] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.615423 22627 raft_consensus.cc:740] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.592794 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 06de1406fed544b39bf6d0ab441df770 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:50.629599 22572 tablet_service.cc:1511] Processing CreateTablet for tablet bcb965aeed0142a28f51999a91b1eb44 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:50.631120 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06de1406fed544b39bf6d0ab441df770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.631841 22626 ts_tablet_manager.cc:1434] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.012s
I20260709 13:05:50.616240 22627 consensus_queue.cc:260] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.633719 22572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb965aeed0142a28f51999a91b1eb44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.636159 22458 heartbeater.cc:499] Master 127.20.208.62:33169 was elected leader, sending a full tablet report...
I20260709 13:05:50.636973 22625 tablet_bootstrap.cc:492] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:50.637476 22625 ts_tablet_manager.cc:1403] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.201s	user 0.006s	sys 0.008s
I20260709 13:05:50.643268 22421 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe7e8d85f3b4703b850c99a435d1d29 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:50.644654 22421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe7e8d85f3b4703b850c99a435d1d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.653584 22496 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe7e8d85f3b4703b850c99a435d1d29 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:50.655395 22496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe7e8d85f3b4703b850c99a435d1d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.657582 22569 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe7e8d85f3b4703b850c99a435d1d29 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:50.659109 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe7e8d85f3b4703b850c99a435d1d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.660003 22626 tablet_bootstrap.cc:492] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:50.669533 22625 raft_consensus.cc:359] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.670291 22625 raft_consensus.cc:385] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.670593 22625 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.674995 22626 tablet_bootstrap.cc:654] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.690286 22625 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.694837 22607 heartbeater.cc:499] Master 127.20.208.62:33169 was elected leader, sending a full tablet report...
I20260709 13:05:50.695264 22626 tablet_bootstrap.cc:492] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:50.696841 22626 ts_tablet_manager.cc:1403] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.007s
I20260709 13:05:50.696964 22421 tablet_service.cc:1511] Processing CreateTablet for tablet 94be7e6c95554db88c30fee7a3db405f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:50.698474 22627 ts_tablet_manager.cc:1434] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.119s	user 0.010s	sys 0.003s
I20260709 13:05:50.700352 22626 raft_consensus.cc:359] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.701108 22626 raft_consensus.cc:385] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.701397 22626 raft_consensus.cc:740] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.703670 22567 tablet_service.cc:1511] Processing CreateTablet for tablet 94be7e6c95554db88c30fee7a3db405f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:50.705017 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94be7e6c95554db88c30fee7a3db405f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.708211 22497 tablet_service.cc:1511] Processing CreateTablet for tablet 78e6dd3ee498418ab0eeb27b3289cdc5 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:50.708567 22420 tablet_service.cc:1511] Processing CreateTablet for tablet 78e6dd3ee498418ab0eeb27b3289cdc5 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:50.709086 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 78e6dd3ee498418ab0eeb27b3289cdc5 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:50.709594 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e6dd3ee498418ab0eeb27b3289cdc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.710391 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e6dd3ee498418ab0eeb27b3289cdc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.702135 22626 consensus_queue.cc:260] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.718219 22625 ts_tablet_manager.cc:1434] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.004s
I20260709 13:05:50.718771 22496 tablet_service.cc:1511] Processing CreateTablet for tablet 94be7e6c95554db88c30fee7a3db405f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:50.720189 22496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94be7e6c95554db88c30fee7a3db405f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.720242 22627 tablet_bootstrap.cc:492] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:50.720697 22421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94be7e6c95554db88c30fee7a3db405f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.721560 22631 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.722038 22631 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.723078 22625 tablet_bootstrap.cc:492] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:50.724750 22631 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:50.730793 22420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e6dd3ee498418ab0eeb27b3289cdc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.740798 22625 tablet_bootstrap.cc:654] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.750219 22626 ts_tablet_manager.cc:1434] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 13:05:50.752346 22626 tablet_bootstrap.cc:492] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:50.760298 22422 tablet_service.cc:1511] Processing CreateTablet for tablet 5ceea8b6b718469c8d899d7f03824359 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:50.761411 22627 tablet_bootstrap.cc:654] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.761794 22422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ceea8b6b718469c8d899d7f03824359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.762754 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:50.765575 22472 leader_election.cc:343] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.785202 22572 tablet_service.cc:1511] Processing CreateTablet for tablet 5ceea8b6b718469c8d899d7f03824359 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:50.785387 22423 tablet_service.cc:1511] Processing CreateTablet for tablet c7bfc975f9f54ea59fbab64cd3362a0d (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:50.786698 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bfc975f9f54ea59fbab64cd3362a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.788436 22634 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.788376 22491 tablet_service.cc:1511] Processing CreateTablet for tablet 5ceea8b6b718469c8d899d7f03824359 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:50.789059 22634 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.790210 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ceea8b6b718469c8d899d7f03824359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.786711 22572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ceea8b6b718469c8d899d7f03824359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.793529 22634 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:50.802110 22489 tablet_service.cc:1511] Processing CreateTablet for tablet c7bfc975f9f54ea59fbab64cd3362a0d (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:50.803673 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bfc975f9f54ea59fbab64cd3362a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.824699 22625 tablet_bootstrap.cc:492] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:50.825251 22625 ts_tablet_manager.cc:1403] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.102s	user 0.016s	sys 0.015s
I20260709 13:05:50.830739 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 2647750dc34142bf8dd2c7a3bd334fc4 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:50.832160 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2647750dc34142bf8dd2c7a3bd334fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.837600 22490 tablet_service.cc:1511] Processing CreateTablet for tablet 314cf48b748f4bcd8768227cd02627af (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:50.838984 22490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314cf48b748f4bcd8768227cd02627af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.828157 22625 raft_consensus.cc:359] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.839478 22625 raft_consensus.cc:385] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.839778 22625 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.840669 22625 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.842888 22625 ts_tablet_manager.cc:1434] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:05:50.843907 22625 tablet_bootstrap.cc:492] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:50.868423 22632 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.869280 22625 tablet_bootstrap.cc:654] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.868999 22632 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:50.869635 22567 tablet_service.cc:1511] Processing CreateTablet for tablet c7bfc975f9f54ea59fbab64cd3362a0d (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:50.873176 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bfc975f9f54ea59fbab64cd3362a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.875165 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:50.878872 22632 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:50.883333 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 93a148d1e8b84ad7815dcaf111f422a7 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:50.896414 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a148d1e8b84ad7815dcaf111f422a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.901072 22497 tablet_service.cc:1511] Processing CreateTablet for tablet 109ad37fc4fb45618b11eb81e3b2c7d2 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:50.902772 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109ad37fc4fb45618b11eb81e3b2c7d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.906237 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 2647750dc34142bf8dd2c7a3bd334fc4 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:50.907820 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2647750dc34142bf8dd2c7a3bd334fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.922307 22422 tablet_service.cc:1511] Processing CreateTablet for tablet 2647750dc34142bf8dd2c7a3bd334fc4 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:50.923775 22422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2647750dc34142bf8dd2c7a3bd334fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.922475 22420 tablet_service.cc:1511] Processing CreateTablet for tablet 314cf48b748f4bcd8768227cd02627af (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:50.924368 22421 tablet_service.cc:1511] Processing CreateTablet for tablet 109ad37fc4fb45618b11eb81e3b2c7d2 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:50.924777 22417 tablet_service.cc:1511] Processing CreateTablet for tablet 93a148d1e8b84ad7815dcaf111f422a7 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:50.925278 22420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314cf48b748f4bcd8768227cd02627af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.924371 22572 tablet_service.cc:1511] Processing CreateTablet for tablet 314cf48b748f4bcd8768227cd02627af (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:50.902691 22626 tablet_bootstrap.cc:654] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.926939 22569 tablet_service.cc:1511] Processing CreateTablet for tablet 109ad37fc4fb45618b11eb81e3b2c7d2 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:50.927323 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:50.929338 22396 leader_election.cc:343] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.926048 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a148d1e8b84ad7815dcaf111f422a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.936852 22572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314cf48b748f4bcd8768227cd02627af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.942003 22421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109ad37fc4fb45618b11eb81e3b2c7d2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:50.942919 22474 leader_election.cc:343] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.943405 22474 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:50.945397 22631 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:50.949807 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 93a148d1e8b84ad7815dcaf111f422a7 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:50.953524 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109ad37fc4fb45618b11eb81e3b2c7d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.963856 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a148d1e8b84ad7815dcaf111f422a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.965571 22627 tablet_bootstrap.cc:492] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:50.966112 22627 ts_tablet_manager.cc:1403] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.246s	user 0.026s	sys 0.027s
I20260709 13:05:50.970583 22416 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcd5807b34a410c9196ed1b6e80ace3 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:50.971971 22416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcd5807b34a410c9196ed1b6e80ace3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.975576 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcd5807b34a410c9196ed1b6e80ace3 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:50.977759 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcd5807b34a410c9196ed1b6e80ace3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.981885 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:50.982487 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcd5807b34a410c9196ed1b6e80ace3 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
W20260709 13:05:50.983438 22399 leader_election.cc:343] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.983913 22399 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:50.984709 22634 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:50.983923 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcd5807b34a410c9196ed1b6e80ace3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:50.994566 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08000afbe0 after lost signal to thread 21315
I20260709 13:05:51.008504 22417 tablet_service.cc:1511] Processing CreateTablet for tablet 69914642ad6d43889fea43ca1c6697f4 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:51.009872 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69914642ad6d43889fea43ca1c6697f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.011998 22564 tablet_service.cc:1511] Processing CreateTablet for tablet 69914642ad6d43889fea43ca1c6697f4 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:51.013378 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69914642ad6d43889fea43ca1c6697f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.018129 22625 tablet_bootstrap.cc:492] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:51.018652 22625 ts_tablet_manager.cc:1403] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.175s	user 0.017s	sys 0.005s
I20260709 13:05:51.021703 22625 raft_consensus.cc:359] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.022457 22625 raft_consensus.cc:385] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.022749 22625 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.023583 22625 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.026116 22626 tablet_bootstrap.cc:492] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:51.026708 22626 ts_tablet_manager.cc:1403] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.275s	user 0.012s	sys 0.002s
I20260709 13:05:51.026063 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 69914642ad6d43889fea43ca1c6697f4 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:51.029213 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69914642ad6d43889fea43ca1c6697f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.029641 22626 raft_consensus.cc:359] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.030095 22631 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.037122 22631 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.038661 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 22a9d7ee5bd74642bb36af19c37bbd3f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:51.040561 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:51.041575 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:51.043076 22472 leader_election.cc:343] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.044221 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 22a9d7ee5bd74642bb36af19c37bbd3f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:51.044695 22416 tablet_service.cc:1511] Processing CreateTablet for tablet 22a9d7ee5bd74642bb36af19c37bbd3f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:51.040808 22626 raft_consensus.cc:385] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.039225 22631 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:51.046008 22626 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.046908 22626 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.030793 22627 raft_consensus.cc:359] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.049137 22627 raft_consensus.cc:385] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.049568 22627 raft_consensus.cc:740] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.045694 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a9d7ee5bd74642bb36af19c37bbd3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.034293 22625 ts_tablet_manager.cc:1434] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:05:51.052245 22625 tablet_bootstrap.cc:492] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:51.055531 22626 ts_tablet_manager.cc:1434] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:05:51.059235 22626 tablet_bootstrap.cc:492] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:51.065390 22627 consensus_queue.cc:260] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.076833 22582 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:51.078361 22423 tablet_service.cc:1511] Processing CreateTablet for tablet ee6d9e2f597948e7b4670b3606ebf448 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:51.079963 22474 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:51.080777 22627 ts_tablet_manager.cc:1434] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.114s	user 0.010s	sys 0.000s
I20260709 13:05:51.045985 22416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a9d7ee5bd74642bb36af19c37bbd3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.068041 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:51.081234 22631 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.081593 22631 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.081933 22631 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.070983 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a9d7ee5bd74642bb36af19c37bbd3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.075333 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:51.084316 22545 leader_election.cc:343] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.090793 22625 tablet_bootstrap.cc:654] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:51.091557 22546 leader_election.cc:343] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.096771 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:51.098053 22632 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.098490 22626 tablet_bootstrap.cc:654] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.100837 22631 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.095973 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6d9e2f597948e7b4670b3606ebf448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.103854 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:51.104234 22497 tablet_service.cc:1511] Processing CreateTablet for tablet ee6d9e2f597948e7b4670b3606ebf448 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 13:05:51.105541 22472 leader_election.cc:343] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.105829 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6d9e2f597948e7b4670b3606ebf448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.107216 22627 tablet_bootstrap.cc:492] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:51.110587 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:51.111222 22582 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.126482 22582 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:51.126729 22564 tablet_service.cc:1511] Processing CreateTablet for tablet ee6d9e2f597948e7b4670b3606ebf448 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:51.130471 22474 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:51.112339 22631 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:51.140884 22631 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.141373 22631 raft_consensus.cc:697] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:51.142146 22631 consensus_queue.cc:237] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.149045 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 61ec0e67ff314a57bb23fd055736385a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:51.150363 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ec0e67ff314a57bb23fd055736385a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.151750 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6d9e2f597948e7b4670b3606ebf448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.154696 22417 tablet_service.cc:1511] Processing CreateTablet for tablet 61ec0e67ff314a57bb23fd055736385a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:51.155119 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 61ec0e67ff314a57bb23fd055736385a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:51.156252 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ec0e67ff314a57bb23fd055736385a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.156252 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ec0e67ff314a57bb23fd055736385a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.160943 22421 tablet_service.cc:1511] Processing CreateTablet for tablet bd39ff0031394113b2b75f15cd7c44a4 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:51.163378 22627 tablet_bootstrap.cc:654] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.164647 22625 tablet_bootstrap.cc:492] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:51.165185 22625 ts_tablet_manager.cc:1403] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.031s
I20260709 13:05:51.167703 22626 tablet_bootstrap.cc:492] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:51.168206 22626 ts_tablet_manager.cc:1403] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.019s
I20260709 13:05:51.171973 22494 tablet_service.cc:1511] Processing CreateTablet for tablet bd39ff0031394113b2b75f15cd7c44a4 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:51.173573 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd39ff0031394113b2b75f15cd7c44a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.174166 22569 tablet_service.cc:1511] Processing CreateTablet for tablet bd39ff0031394113b2b75f15cd7c44a4 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:51.182657 22634 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.183460 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd39ff0031394113b2b75f15cd7c44a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.183137 22634 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.180184 22567 tablet_service.cc:1511] Processing CreateTablet for tablet cba81aa4ed494a6c81cc0cf660d6d818 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:51.185513 22634 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:51.181213 22498 tablet_service.cc:1511] Processing CreateTablet for tablet cba81aa4ed494a6c81cc0cf660d6d818 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:51.178580 22420 tablet_service.cc:1511] Processing CreateTablet for tablet cba81aa4ed494a6c81cc0cf660d6d818 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:51.187830 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:51.188558 22420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba81aa4ed494a6c81cc0cf660d6d818. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:51.189409 22399 leader_election.cc:343] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.190900 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:51.192556 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba81aa4ed494a6c81cc0cf660d6d818. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:51.192673 22396 leader_election.cc:343] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.193121 22396 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:51.193318 22421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd39ff0031394113b2b75f15cd7c44a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.194281 22634 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.198637 22422 tablet_service.cc:1511] Processing CreateTablet for tablet 3cb0890d5a7741bd8793d654027263a2 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:51.200089 22422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb0890d5a7741bd8793d654027263a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.205969 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba81aa4ed494a6c81cc0cf660d6d818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.213070 22497 tablet_service.cc:1511] Processing CreateTablet for tablet 3cb0890d5a7741bd8793d654027263a2 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:51.214443 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb0890d5a7741bd8793d654027263a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.212960 22626 raft_consensus.cc:359] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.221280 22626 raft_consensus.cc:385] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.221621 22626 raft_consensus.cc:740] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.222393 22626 consensus_queue.cc:260] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.222991 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 3cb0890d5a7741bd8793d654027263a2 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:51.224340 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb0890d5a7741bd8793d654027263a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.168118 22625 raft_consensus.cc:359] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.225045 22625 raft_consensus.cc:385] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.225350 22625 raft_consensus.cc:740] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.226131 22625 consensus_queue.cc:260] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.233698 22626 ts_tablet_manager.cc:1434] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.001s
I20260709 13:05:51.234769 22626 tablet_bootstrap.cc:492] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:51.253278 22423 tablet_service.cc:1511] Processing CreateTablet for tablet 0b920299a38a48b1a5c349b6f109fa9f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:51.254961 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b920299a38a48b1a5c349b6f109fa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.228379 22625 ts_tablet_manager.cc:1434] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.063s	user 0.003s	sys 0.001s
I20260709 13:05:51.269220 22491 tablet_service.cc:1511] Processing CreateTablet for tablet 0b920299a38a48b1a5c349b6f109fa9f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:51.270716 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b920299a38a48b1a5c349b6f109fa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.274757 22649 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.275381 22649 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.277842 22649 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:51.282068 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:51.283923 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:05:51.285205 22472 leader_election.cc:343] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:51.286798 22474 leader_election.cc:343] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.287274 22474 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:51.288460 22649 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.303586 22564 tablet_service.cc:1511] Processing CreateTablet for tablet 0b920299a38a48b1a5c349b6f109fa9f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:51.304040 22625 tablet_bootstrap.cc:492] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:51.305020 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b920299a38a48b1a5c349b6f109fa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.306620 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 063ac6dfc4614afb9ca68efa49225bf7 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:51.307968 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063ac6dfc4614afb9ca68efa49225bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.310283 22627 tablet_bootstrap.cc:492] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:51.310798 22627 ts_tablet_manager.cc:1403] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.204s	user 0.035s	sys 0.035s
I20260709 13:05:51.313619 22625 tablet_bootstrap.cc:654] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.319114 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 063ac6dfc4614afb9ca68efa49225bf7 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:51.319742 22490 tablet_service.cc:1511] Processing CreateTablet for tablet 28e7a53997c5479d8edfb755d887f72a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:51.320889 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063ac6dfc4614afb9ca68efa49225bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.325516 22631 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.326146 22631 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.329442 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:51.329787 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:05:51.331489 22472 leader_election.cc:343] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.331924 22631 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:05:51.332434 22474 leader_election.cc:343] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.333026 22474 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:51.303634 22416 tablet_service.cc:1511] Processing CreateTablet for tablet 063ac6dfc4614afb9ca68efa49225bf7 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:51.320227 22330 catalog_manager.cc:5697] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.333777 22417 tablet_service.cc:1511] Processing CreateTablet for tablet 28e7a53997c5479d8edfb755d887f72a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:51.334169 22631 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.340895 22490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e7a53997c5479d8edfb755d887f72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.334770 22416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063ac6dfc4614afb9ca68efa49225bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.345366 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e7a53997c5479d8edfb755d887f72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.352665 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2c58309c5440b19fa96cbeb5491c79 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:51.354498 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2c58309c5440b19fa96cbeb5491c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.352721 22627 raft_consensus.cc:359] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.356609 22627 raft_consensus.cc:385] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.356987 22627 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.359016 22634 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.359678 22634 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.356020 22421 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2c58309c5440b19fa96cbeb5491c79 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:51.364717 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:51.365485 22421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2c58309c5440b19fa96cbeb5491c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.362775 22634 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:51.363584 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:05:51.366847 22396 leader_election.cc:343] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.358655 22567 tablet_service.cc:1511] Processing CreateTablet for tablet 28e7a53997c5479d8edfb755d887f72a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:51.359712 22627 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.368891 22582 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:51.370836 22399 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:51.372021 22634 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.375592 22572 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2c58309c5440b19fa96cbeb5491c79 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:51.372677 22634 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.377714 22634 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.377579 22420 tablet_service.cc:1511] Processing CreateTablet for tablet add2d1ead99b44f6b4c0bb7f2fa9857a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:51.382505 22627 ts_tablet_manager.cc:1434] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.001s
I20260709 13:05:51.388535 22627 tablet_bootstrap.cc:492] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:51.368575 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e7a53997c5479d8edfb755d887f72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.380458 22497 tablet_service.cc:1511] Processing CreateTablet for tablet add2d1ead99b44f6b4c0bb7f2fa9857a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:51.393181 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add2d1ead99b44f6b4c0bb7f2fa9857a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.396937 22572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2c58309c5440b19fa96cbeb5491c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.394505 22626 tablet_bootstrap.cc:654] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.407039 22420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add2d1ead99b44f6b4c0bb7f2fa9857a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.406618 22422 tablet_service.cc:1511] Processing CreateTablet for tablet c96fcf9d065e46528b502778fede0f1f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:51.410223 22625 tablet_bootstrap.cc:492] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:51.410740 22625 ts_tablet_manager.cc:1403] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.002s
I20260709 13:05:51.411906 22627 tablet_bootstrap.cc:654] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.413746 22625 raft_consensus.cc:359] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.419382 22625 raft_consensus.cc:385] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.419795 22625 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.414593 22491 tablet_service.cc:1511] Processing CreateTablet for tablet c96fcf9d065e46528b502778fede0f1f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:51.421331 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96fcf9d065e46528b502778fede0f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.423089 22634 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.433566 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:51.433786 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:51.434391 22582 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.436113 22423 tablet_service.cc:1511] Processing CreateTablet for tablet 764f8dc47e2c49648f870ba9bd1b55fc (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:51.438271 22568 tablet_service.cc:1511] Processing CreateTablet for tablet add2d1ead99b44f6b4c0bb7f2fa9857a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:51.439658 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add2d1ead99b44f6b4c0bb7f2fa9857a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.421824 22625 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.424130 22422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96fcf9d065e46528b502778fede0f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.427294 22563 tablet_service.cc:1511] Processing CreateTablet for tablet c96fcf9d065e46528b502778fede0f1f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 13:05:51.449028 22396 leader_election.cc:343] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.451686 22634 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:51.461089 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 764f8dc47e2c49648f870ba9bd1b55fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.462149 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 764f8dc47e2c49648f870ba9bd1b55fc (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:51.464251 22634 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.476184 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96fcf9d065e46528b502778fede0f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.477401 22416 tablet_service.cc:1511] Processing CreateTablet for tablet 2c88522d64a9464ea79df0c6a6aa9652 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:51.478821 22416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c88522d64a9464ea79df0c6a6aa9652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.480729 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 764f8dc47e2c49648f870ba9bd1b55fc (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:51.472558 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 764f8dc47e2c49648f870ba9bd1b55fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.482095 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 764f8dc47e2c49648f870ba9bd1b55fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.477352 22625 ts_tablet_manager.cc:1434] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.007s
I20260709 13:05:51.487143 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 2c88522d64a9464ea79df0c6a6aa9652 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:51.487602 22627 tablet_bootstrap.cc:492] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:51.488116 22627 ts_tablet_manager.cc:1403] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.005s
I20260709 13:05:51.488528 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c88522d64a9464ea79df0c6a6aa9652. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:51.489228 22379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:51.491101 22567 tablet_service.cc:1511] Processing CreateTablet for tablet 2c88522d64a9464ea79df0c6a6aa9652 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:51.491968 22418 tablet_service.cc:1511] Processing CreateTablet for tablet f4d35c45e33c4336b33461cdbe7f7b6f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:51.492393 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c88522d64a9464ea79df0c6a6aa9652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.494218 22418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d35c45e33c4336b33461cdbe7f7b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.495826 22572 tablet_service.cc:1511] Processing CreateTablet for tablet f4d35c45e33c4336b33461cdbe7f7b6f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:51.497159 22572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d35c45e33c4336b33461cdbe7f7b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.498140 22626 tablet_bootstrap.cc:492] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:51.498622 22626 ts_tablet_manager.cc:1403] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.264s	user 0.018s	sys 0.004s
I20260709 13:05:51.500643 22627 raft_consensus.cc:359] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.501410 22627 raft_consensus.cc:385] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.501737 22627 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.502512 22627 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.513162 22625 tablet_bootstrap.cc:492] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:51.511860 22582 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:51.522960 22489 tablet_service.cc:1511] Processing CreateTablet for tablet f4d35c45e33c4336b33461cdbe7f7b6f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:51.524305 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d35c45e33c4336b33461cdbe7f7b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.525907 22625 tablet_bootstrap.cc:654] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.527709 22627 ts_tablet_manager.cc:1434] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:05:51.527585 22626 raft_consensus.cc:359] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.528350 22626 raft_consensus.cc:385] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.528704 22626 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.531451 22627 tablet_bootstrap.cc:492] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:51.482600 22634 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.542647 22634 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:51.543401 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:51.548306 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:51.549057 22581 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:51.550221 22399 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:51.550051 22417 tablet_service.cc:1511] Processing CreateTablet for tablet 4d46675566504843a14e59e2035629c3 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 13:05:51.551151 22396 leader_election.cc:343] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.551106 22634 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.552800 22634 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.553197 22634 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.554411 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d46675566504843a14e59e2035629c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.560335 22627 tablet_bootstrap.cc:654] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.560736 22634 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.565330 22399 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:51.571895 22626 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.579146 22564 tablet_service.cc:1511] Processing CreateTablet for tablet 4d46675566504843a14e59e2035629c3 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:51.579717 22626 ts_tablet_manager.cc:1434] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:05:51.580562 22658 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.581144 22658 raft_consensus.cc:697] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:51.582118 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 4d46675566504843a14e59e2035629c3 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:51.582005 22658 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:51.584118 22472 consensus_peers.cc:597] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.580581 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d46675566504843a14e59e2035629c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.586495 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d46675566504843a14e59e2035629c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.601382 22649 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:51.607692 22416 tablet_service.cc:1511] Processing CreateTablet for tablet 03bee4af77fb4bccad7991b1429bba72 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:51.608858 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 03bee4af77fb4bccad7991b1429bba72 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:51.609769 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bee4af77fb4bccad7991b1429bba72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.616652 22626 tablet_bootstrap.cc:492] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:51.622313 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 03bee4af77fb4bccad7991b1429bba72 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:51.623705 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bee4af77fb4bccad7991b1429bba72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.626242 22634 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:51.627470 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:51.628122 22581 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.629642 22422 tablet_service.cc:1511] Processing CreateTablet for tablet ac2656d4dbbd4ca1a10c904a0a12fc6f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:51.632258 22625 tablet_bootstrap.cc:492] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:51.632803 22625 ts_tablet_manager.cc:1403] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.001s
I20260709 13:05:51.633410 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:05:51.644899 22396 leader_election.cc:343] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.647332 22581 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:51.648797 22399 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:51.649698 22634 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.650303 22634 raft_consensus.cc:697] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:51.651228 22634 consensus_queue.cc:237] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.653261 22416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bee4af77fb4bccad7991b1429bba72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.660670 22422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2656d4dbbd4ca1a10c904a0a12fc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.668358 22489 tablet_service.cc:1511] Processing CreateTablet for tablet ac2656d4dbbd4ca1a10c904a0a12fc6f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:51.669932 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2656d4dbbd4ca1a10c904a0a12fc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.677982 22625 raft_consensus.cc:359] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.678988 22625 raft_consensus.cc:385] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.679302 22625 raft_consensus.cc:740] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.684139 22626 tablet_bootstrap.cc:654] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.688884 22625 consensus_queue.cc:260] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.698406 22625 ts_tablet_manager.cc:1434] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 13:05:51.699720 22625 tablet_bootstrap.cc:492] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:51.711483 22568 tablet_service.cc:1511] Processing CreateTablet for tablet ac2656d4dbbd4ca1a10c904a0a12fc6f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:51.712428 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2656d4dbbd4ca1a10c904a0a12fc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.725391 22423 tablet_service.cc:1511] Processing CreateTablet for tablet fdfa7f3695964682a28952992553f739 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:51.726725 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdfa7f3695964682a28952992553f739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.729054 22329 catalog_manager.cc:5697] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.736858 22489 tablet_service.cc:1511] Processing CreateTablet for tablet fdfa7f3695964682a28952992553f739 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:51.738005 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdfa7f3695964682a28952992553f739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.744516 22625 tablet_bootstrap.cc:654] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.747749 22627 tablet_bootstrap.cc:492] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:51.748271 22627 ts_tablet_manager.cc:1403] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.217s	user 0.035s	sys 0.025s
I20260709 13:05:51.751235 22627 raft_consensus.cc:359] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.755996 22421 tablet_service.cc:1511] Processing CreateTablet for tablet 4293c025258b4f61abd2346d38a2752b (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:51.757485 22421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4293c025258b4f61abd2346d38a2752b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.758702 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 4293c025258b4f61abd2346d38a2752b (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:51.760035 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4293c025258b4f61abd2346d38a2752b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.751991 22627 raft_consensus.cc:385] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.767398 22627 raft_consensus.cc:740] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.766453 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 4293c025258b4f61abd2346d38a2752b (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:51.764751 22568 tablet_service.cc:1511] Processing CreateTablet for tablet fdfa7f3695964682a28952992553f739 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:51.768980 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdfa7f3695964682a28952992553f739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.776243 22497 tablet_service.cc:1511] Processing CreateTablet for tablet 5964cb0c6d2046d4b63d976e33ff0d84 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:51.777997 22418 tablet_service.cc:1511] Processing CreateTablet for tablet 5964cb0c6d2046d4b63d976e33ff0d84 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:51.779345 22418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5964cb0c6d2046d4b63d976e33ff0d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.779963 22417 tablet_service.cc:1511] Processing CreateTablet for tablet 6089498054d24ce99c46fe9be74f8589 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:51.781231 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6089498054d24ce99c46fe9be74f8589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.786087 22567 tablet_service.cc:1511] Processing CreateTablet for tablet 5964cb0c6d2046d4b63d976e33ff0d84 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:51.787540 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5964cb0c6d2046d4b63d976e33ff0d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.796984 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4293c025258b4f61abd2346d38a2752b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.797709 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5964cb0c6d2046d4b63d976e33ff0d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.807547 22331 catalog_manager.cc:5697] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.822762 22626 tablet_bootstrap.cc:492] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:51.823293 22626 ts_tablet_manager.cc:1403] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.223s	user 0.012s	sys 0.004s
I20260709 13:05:51.824349 22627 consensus_queue.cc:260] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.830382 22627 ts_tablet_manager.cc:1434] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.000s
I20260709 13:05:51.831365 22627 tablet_bootstrap.cc:492] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:51.844696 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 6089498054d24ce99c46fe9be74f8589 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:51.845894 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6089498054d24ce99c46fe9be74f8589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.846725 22417 tablet_service.cc:1511] Processing CreateTablet for tablet c04b0ff4c7da4211acec428ae776775a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:51.847900 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04b0ff4c7da4211acec428ae776775a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.851291 22627 tablet_bootstrap.cc:654] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.847133 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 6089498054d24ce99c46fe9be74f8589 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:51.852972 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6089498054d24ce99c46fe9be74f8589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.857983 22625 tablet_bootstrap.cc:492] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:51.858484 22625 ts_tablet_manager.cc:1403] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.159s	user 0.016s	sys 0.022s
I20260709 13:05:51.861961 22625 raft_consensus.cc:359] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.862787 22489 tablet_service.cc:1511] Processing CreateTablet for tablet c04b0ff4c7da4211acec428ae776775a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:51.863982 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04b0ff4c7da4211acec428ae776775a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.863795 22568 tablet_service.cc:1511] Processing CreateTablet for tablet c04b0ff4c7da4211acec428ae776775a (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:51.866144 22497 tablet_service.cc:1511] Processing CreateTablet for tablet 87cca3dfe6984b21bf5701f6f3b21b83 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:51.867255 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cca3dfe6984b21bf5701f6f3b21b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.864954 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04b0ff4c7da4211acec428ae776775a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.869827 22626 raft_consensus.cc:359] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.870595 22626 raft_consensus.cc:385] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.870893 22626 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.871268 22423 tablet_service.cc:1511] Processing CreateTablet for tablet 87cca3dfe6984b21bf5701f6f3b21b83 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:51.871657 22626 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.877063 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cca3dfe6984b21bf5701f6f3b21b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.878832 22626 ts_tablet_manager.cc:1434] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:05:51.862763 22625 raft_consensus.cc:385] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.880445 22625 raft_consensus.cc:740] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.881999 22627 tablet_bootstrap.cc:492] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:51.882498 22627 ts_tablet_manager.cc:1403] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.002s
I20260709 13:05:51.882521 22625 consensus_queue.cc:260] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.886010 22627 raft_consensus.cc:359] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.887049 22627 raft_consensus.cc:385] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.887440 22627 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.887882 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 87cca3dfe6984b21bf5701f6f3b21b83 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:51.879895 22626 tablet_bootstrap.cc:492] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:51.893090 22417 tablet_service.cc:1511] Processing CreateTablet for tablet 634877efa82d48ea9055feb74030391f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:51.894984 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 634877efa82d48ea9055feb74030391f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:51.911727 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634877efa82d48ea9055feb74030391f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.912211 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634877efa82d48ea9055feb74030391f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.913051 22418 tablet_service.cc:1511] Processing CreateTablet for tablet 55dc1d250bfe4f2c9c577323b3736521 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:51.914745 22418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55dc1d250bfe4f2c9c577323b3736521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.917738 22567 tablet_service.cc:1511] Processing CreateTablet for tablet a98509b657f84336bb26dd231a3124f1 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:51.899152 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cca3dfe6984b21bf5701f6f3b21b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.888424 22627 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.900563 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 634877efa82d48ea9055feb74030391f (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:51.925210 22627 ts_tablet_manager.cc:1434] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.003s
I20260709 13:05:51.926005 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634877efa82d48ea9055feb74030391f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.910141 22634 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.905047 22421 tablet_service.cc:1511] Processing CreateTablet for tablet a98509b657f84336bb26dd231a3124f1 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:51.928939 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98509b657f84336bb26dd231a3124f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.929134 22634 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.929378 22626 tablet_bootstrap.cc:654] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.931370 22634 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:51.900756 22625 ts_tablet_manager.cc:1434] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.004s
I20260709 13:05:51.932687 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:51.933009 22625 tablet_bootstrap.cc:492] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:51.934034 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:51.934665 22508 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:51.937052 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:51.938633 22634 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.939020 22634 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.939343 22634 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.931463 22421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98509b657f84336bb26dd231a3124f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.942904 22582 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:51.946830 22625 tablet_bootstrap.cc:654] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.953254 22626 tablet_bootstrap.cc:492] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:51.953787 22626 ts_tablet_manager.cc:1403] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.074s	user 0.004s	sys 0.008s
I20260709 13:05:51.956784 22634 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.958422 22497 tablet_service.cc:1511] Processing CreateTablet for tablet a98509b657f84336bb26dd231a3124f1 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:51.970407 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98509b657f84336bb26dd231a3124f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.959774 22634 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:51.961125 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:51.974097 22582 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.959830 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:51.976812 22508 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.956768 22626 raft_consensus.cc:359] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.980749 22626 raft_consensus.cc:385] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.981078 22626 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.981824 22626 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.984068 22626 ts_tablet_manager.cc:1434] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:05:51.964208 22625 tablet_bootstrap.cc:492] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:51.966336 22632 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.984678 22632 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.986824 22632 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:51.969396 22627 tablet_bootstrap.cc:492] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:51.987991 22626 tablet_bootstrap.cc:492] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:51.988169 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:51.988910 22507 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:51.990360 22506 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.993070 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:51.984678 22625 ts_tablet_manager.cc:1403] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.002s
I20260709 13:05:51.993655 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:51.994439 22433 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:51.996613 22625 raft_consensus.cc:359] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.997372 22625 raft_consensus.cc:385] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.997619 22634 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.998720 22627 tablet_bootstrap.cc:654] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.994721 22632 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.999270 22632 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.997660 22625 raft_consensus.cc:740] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.000171 22625 consensus_queue.cc:260] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:51.999652 22632 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.002621 22626 tablet_bootstrap.cc:654] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.006040 22625 ts_tablet_manager.cc:1434] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:05:52.006953 22625 tablet_bootstrap.cc:492] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:52.012001 22649 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.012575 22649 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.014659 22649 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.015163 22631 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.015642 22631 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.016589 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.016829 22634 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.017432 22634 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.019207 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.019555 22634 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.019838 22433 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:52.021373 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.019465 22631 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.022032 22580 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:52.022209 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:52.023125 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:05:52.023684 22474 leader_election.cc:343] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.024554 22649 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.024617 22474 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.025023 22649 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.025369 22649 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.025681 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.026342 22433 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:52.027276 22631 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.027644 22631 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.027972 22631 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.028024 22582 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:52.031246 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 55dc1d250bfe4f2c9c577323b3736521 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:52.032508 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55dc1d250bfe4f2c9c577323b3736521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.034183 22649 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.036242 22508 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:52.040074 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.040457 22632 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.041039 22658 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.042434 22658 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.042873 22658 raft_consensus.cc:697] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:52.043862 22632 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:52.043653 22658 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.048938 22627 tablet_bootstrap.cc:492] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:52.043704 22649 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.050652 22627 ts_tablet_manager.cc:1403] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.013s
I20260709 13:05:52.050806 22649 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.049388 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 55dc1d250bfe4f2c9c577323b3736521 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:52.051508 22649 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.053194 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55dc1d250bfe4f2c9c577323b3736521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.049961 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:52.053728 22627 raft_consensus.cc:359] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.054564 22508 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.056300 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.056967 22580 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:52.057365 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 78cbb90e435d471fa07712145d0b9faa (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:52.058004 22418 tablet_service.cc:1511] Processing CreateTablet for tablet 78cbb90e435d471fa07712145d0b9faa (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:52.058637 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cbb90e435d471fa07712145d0b9faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.059409 22418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cbb90e435d471fa07712145d0b9faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.060364 22474 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.054525 22627 raft_consensus.cc:385] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.061038 22627 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.061956 22627 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.064363 22627 ts_tablet_manager.cc:1434] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:05:52.065768 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:52.066334 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.066533 22432 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.044513 22632 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.069948 22632 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.048636 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:52.073241 22433 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.074662 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.075325 22431 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:52.075738 22627 tablet_bootstrap.cc:492] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:52.076785 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.078105 22546 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:52.078972 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:52.079583 22582 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.079969 22674 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.080399 22674 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.085621 22432 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:52.087626 22399 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:52.088917 22564 tablet_service.cc:1511] Processing CreateTablet for tablet 78cbb90e435d471fa07712145d0b9faa (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:52.089499 22657 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.089824 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:52.090343 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cbb90e435d471fa07712145d0b9faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.090224 22657 consensus_queue.cc:1048] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.080785 22674 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.093269 22632 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:52.094292 22649 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.097153 22626 tablet_bootstrap.cc:492] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:52.097641 22626 ts_tablet_manager.cc:1403] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.110s	user 0.007s	sys 0.005s
I20260709 13:05:52.098212 22627 tablet_bootstrap.cc:654] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.099237 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.103966 22508 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:52.104820 22631 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.107703 22626 raft_consensus.cc:359] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.109036 22626 raft_consensus.cc:385] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.109359 22626 raft_consensus.cc:740] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.110848 22625 tablet_bootstrap.cc:654] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.111362 22626 consensus_queue.cc:260] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.106870 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.116140 22632 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.122423 22626 ts_tablet_manager.cc:1434] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:05:52.124658 22626 tablet_bootstrap.cc:492] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:52.119987 22649 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:52.134682 22507 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:52.125458 22632 raft_consensus.cc:697] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:52.136346 22632 consensus_queue.cc:237] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.140036 22567 tablet_service.cc:1511] Processing CreateTablet for tablet 8fecad4f2f3d49ea8a691075b31e1f96 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:52.141273 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fecad4f2f3d49ea8a691075b31e1f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.141886 22631 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.136253 22421 tablet_service.cc:1511] Processing CreateTablet for tablet 8fecad4f2f3d49ea8a691075b31e1f96 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:52.143278 22417 tablet_service.cc:1511] Processing CreateTablet for tablet 7dae4a3a8e0e4e2e97b920c88a3fb020 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:52.143929 22421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fecad4f2f3d49ea8a691075b31e1f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.144389 22417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dae4a3a8e0e4e2e97b920c88a3fb020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.148099 22677 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.148317 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:52.148933 22432 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.152698 22433 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:52.155368 22677 raft_consensus.cc:697] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:52.157305 22677 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.157814 22582 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
W20260709 13:05:52.128624 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 68324.4us
I20260709 13:05:52.159722 22627 tablet_bootstrap.cc:492] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:52.160126 22627 ts_tablet_manager.cc:1403] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.001s
I20260709 13:05:52.159476 22658 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.161365 22658 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.162923 22626 tablet_bootstrap.cc:654] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.162927 22658 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.169031 22564 tablet_service.cc:1511] Processing CreateTablet for tablet 7dae4a3a8e0e4e2e97b920c88a3fb020 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:52.170027 22649 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:05:52.170717 22649 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.171188 22627 raft_consensus.cc:359] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.171859 22627 raft_consensus.cc:385] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.172101 22627 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.172317 22498 tablet_service.cc:1511] Processing CreateTablet for tablet 7dae4a3a8e0e4e2e97b920c88a3fb020 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:52.173413 22498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dae4a3a8e0e4e2e97b920c88a3fb020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.176573 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 17ed109556234df2aeba1d6118cc0a95 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:52.178046 22627 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.183086 22497 tablet_service.cc:1511] Processing CreateTablet for tablet 17ed109556234df2aeba1d6118cc0a95 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:52.184674 22497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ed109556234df2aeba1d6118cc0a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.182886 22649 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.187304 22627 ts_tablet_manager.cc:1434] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 13:05:52.182677 22433 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.178634 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.181588 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 8fecad4f2f3d49ea8a691075b31e1f96 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:52.198005 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fecad4f2f3d49ea8a691075b31e1f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.201538 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:52.201327 22330 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.204360 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc53a10833c40d7b01be713f425dfcc (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:52.209949 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc53a10833c40d7b01be713f425dfcc (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:52.211323 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc53a10833c40d7b01be713f425dfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.213217 22649 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.214490 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ed109556234df2aeba1d6118cc0a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.214872 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:52.215579 22507 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:52.220221 22506 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.238237 22423 tablet_service.cc:1511] Processing CreateTablet for tablet 17ed109556234df2aeba1d6118cc0a95 (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:52.239481 22423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ed109556234df2aeba1d6118cc0a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.240653 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:52.196952 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:52.229413 22674 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.244702 22422 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc53a10833c40d7b01be713f425dfcc (DEFAULT_TABLE table=test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:52.245786 22474 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:52.246232 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:52.246079 22422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc53a10833c40d7b01be713f425dfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.245048 22674 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:52.270303 22625 tablet_bootstrap.cc:492] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:52.246724 22649 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.270615 22506 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:05:52.229822 22399 leader_election.cc:343] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.272447 22625 ts_tablet_manager.cc:1403] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.266s	user 0.013s	sys 0.023s
I20260709 13:05:52.244724 22579 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 1: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:05:52.280050 22396 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:05:52.281090 22627 tablet_bootstrap.cc:492] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:52.281780 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc53a10833c40d7b01be713f425dfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.291507 22626 tablet_bootstrap.cc:492] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:52.291920 22626 ts_tablet_manager.cc:1403] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.168s	user 0.011s	sys 0.016s
I20260709 13:05:52.293745 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dae4a3a8e0e4e2e97b920c88a3fb020. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:52.294335 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 50810.6us
I20260709 13:05:52.320806 22687 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.321252 22687 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.321606 22687 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.327109 22625 raft_consensus.cc:359] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.327829 22625 raft_consensus.cc:385] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.328110 22625 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.339282 22625 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:52.344374 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 116398us
I20260709 13:05:52.347206 22687 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.337400 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:52.314445 22658 consensus_queue.cc:1059] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:05:52.350867 22506 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.352753 22627 tablet_bootstrap.cc:654] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.356813 22658 raft_consensus.cc:3055] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.357195 22658 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:52.357972 22658 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.359310 22687 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.360148 22626 raft_consensus.cc:359] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.361119 22626 raft_consensus.cc:385] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.361675 22546 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:52.359165 22658 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.362782 22674 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.364912 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:05:52.366516 22399 leader_election.cc:343] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.367594 22432 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:52.368865 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:52.369410 22507 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.361523 22626 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.372093 22626 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.374125 22626 ts_tablet_manager.cc:1434] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.001s
I20260709 13:05:52.375067 22626 tablet_bootstrap.cc:492] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:52.368654 22472 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:05:52.378139 22649 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.378671 22649 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:52.379549 22649 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.380751 22626 tablet_bootstrap.cc:654] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.393771 22625 ts_tablet_manager.cc:1434] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.118s	user 0.001s	sys 0.005s
I20260709 13:05:52.395088 22625 tablet_bootstrap.cc:492] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:52.396198 22626 tablet_bootstrap.cc:492] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:52.396687 22626 ts_tablet_manager.cc:1403] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.012s
I20260709 13:05:52.397351 22627 tablet_bootstrap.cc:492] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:52.397812 22627 ts_tablet_manager.cc:1403] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.000s
I20260709 13:05:52.399466 22626 raft_consensus.cc:359] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.400158 22626 raft_consensus.cc:385] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.400544 22626 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.400209 22627 raft_consensus.cc:359] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.401038 22627 raft_consensus.cc:385] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.401312 22627 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.401480 22626 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.401964 22627 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.403503 22626 ts_tablet_manager.cc:1434] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:52.403807 22627 ts_tablet_manager.cc:1434] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:52.404417 22626 tablet_bootstrap.cc:492] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:52.404659 22627 tablet_bootstrap.cc:492] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:52.406352 22677 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.406912 22677 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.410595 22626 tablet_bootstrap.cc:654] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.410595 22627 tablet_bootstrap.cc:654] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.413528 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.415668 22677 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.417132 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.418982 22472 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:52.420701 22677 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.421729 22626 tablet_bootstrap.cc:492] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:52.421993 22627 tablet_bootstrap.cc:492] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:52.422199 22626 ts_tablet_manager.cc:1403] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:05:52.422392 22627 ts_tablet_manager.cc:1403] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.002s
I20260709 13:05:52.388144 22329 catalog_manager.cc:5697] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.424964 22627 raft_consensus.cc:359] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.425660 22627 raft_consensus.cc:385] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.425930 22627 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.427692 22626 raft_consensus.cc:359] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.428399 22626 raft_consensus.cc:385] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.428763 22626 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.429368 22507 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:52.429598 22627 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.430656 22396 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:05:52.431707 22627 ts_tablet_manager.cc:1434] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:05:52.431813 22658 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.432312 22658 raft_consensus.cc:697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:52.432760 22627 tablet_bootstrap.cc:492] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:52.433158 22658 consensus_queue.cc:237] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.435212 22626 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.437431 22626 ts_tablet_manager.cc:1434] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:05:52.437230 22331 catalog_manager.cc:5697] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.438414 22626 tablet_bootstrap.cc:492] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:52.442740 22687 consensus_queue.cc:1048] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.444280 22626 tablet_bootstrap.cc:654] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.455250 22627 tablet_bootstrap.cc:654] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.461293 22625 tablet_bootstrap.cc:654] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.465258 22674 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.465860 22674 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.468123 22674 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:52.469806 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.474359 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:52.475204 22507 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:52.472832 22432 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:52.476743 22545 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.478195 22674 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.478609 22674 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.478935 22674 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.484001 22626 tablet_bootstrap.cc:492] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:52.484584 22626 ts_tablet_manager.cc:1403] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.046s	user 0.030s	sys 0.015s
I20260709 13:05:52.487387 22626 raft_consensus.cc:359] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.488095 22626 raft_consensus.cc:385] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.488358 22626 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.489212 22626 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.486966 22674 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.490639 22658 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.491920 22626 ts_tablet_manager.cc:1434] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:52.492911 22626 tablet_bootstrap.cc:492] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
W20260709 13:05:52.493534 22379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:52.496825 22677 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.497327 22677 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.498673 22626 tablet_bootstrap.cc:654] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.500010 22627 tablet_bootstrap.cc:492] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:52.502980 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.503710 22579 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:52.503784 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:52.505016 22472 leader_election.cc:343] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.505812 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:52.506374 22432 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.508860 22474 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:52.499393 22677 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.509212 22674 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:52.510639 22677 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.510826 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:52.511133 22677 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.511595 22677 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.511530 22506 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.523698 22506 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:52.500569 22627 ts_tablet_manager.cc:1403] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.010s
I20260709 13:05:52.525205 22545 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.526871 22674 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.527406 22674 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:52.528257 22627 raft_consensus.cc:359] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.529631 22627 raft_consensus.cc:385] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.530004 22627 raft_consensus.cc:740] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.528272 22674 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.530916 22627 consensus_queue.cc:260] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.529070 22677 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.536375 22627 ts_tablet_manager.cc:1434] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:52.537441 22627 tablet_bootstrap.cc:492] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:52.539037 22677 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.538079 22432 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:52.540166 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:52.540769 22579 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.541855 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:52.545611 22625 tablet_bootstrap.cc:492] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:52.546092 22625 ts_tablet_manager.cc:1403] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.151s	user 0.015s	sys 0.001s
I20260709 13:05:52.547278 22331 catalog_manager.cc:5697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.549047 22625 raft_consensus.cc:359] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.549782 22625 raft_consensus.cc:385] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.550143 22625 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.550985 22625 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:52.550172 22472 leader_election.cc:343] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.553438 22632 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.565125 22625 ts_tablet_manager.cc:1434] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:05:52.565294 22626 tablet_bootstrap.cc:492] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:52.565759 22626 ts_tablet_manager.cc:1403] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.013s
I20260709 13:05:52.566277 22625 tablet_bootstrap.cc:492] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:52.565521 22329 catalog_manager.cc:5697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.563103 22632 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.572403 22579 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:52.574888 22658 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.576618 22658 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.579157 22626 raft_consensus.cc:359] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.580120 22626 raft_consensus.cc:385] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.580425 22626 raft_consensus.cc:740] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.582046 22626 consensus_queue.cc:260] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.584371 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:52.581364 22658 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.585491 22506 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:52.584335 22474 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:52.586817 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.587785 22582 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:52.588124 22674 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.591442 22396 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:52.592875 22634 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.594717 22634 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.617908 22627 tablet_bootstrap.cc:654] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.618467 22331 catalog_manager.cc:5697] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.626178 22626 ts_tablet_manager.cc:1434] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:05:52.627354 22626 tablet_bootstrap.cc:492] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:52.647367 22677 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.647877 22677 raft_consensus.cc:697] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:52.648809 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:52.648717 22677 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.649612 22506 raft_consensus.cc:2393] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 1: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:05:52.649508 22632 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:05:52.647313 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63108.4us
I20260709 13:05:52.651574 22631 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.651850 22626 tablet_bootstrap.cc:654] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.652017 22631 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.659588 22625 tablet_bootstrap.cc:654] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:52.646147 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 54834.7us
I20260709 13:05:52.661123 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.662768 22631 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.664120 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:52.665396 22472 leader_election.cc:343] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.665836 22632 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.672736 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.676581 22546 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:52.676896 22634 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.677618 22674 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.671064 22632 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:52.680302 22474 leader_election.cc:343] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.681160 22474 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:52.681965 22631 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.686544 22632 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:52.695161 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.696382 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:52.698112 22545 leader_election.cc:343] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:52.699306 22546 leader_election.cc:343] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.699762 22546 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:52.694504 22677 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:52.701134 22632 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.706107 22674 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.707787 22627 tablet_bootstrap.cc:492] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:52.708294 22627 ts_tablet_manager.cc:1403] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.171s	user 0.014s	sys 0.015s
I20260709 13:05:52.712047 22627 raft_consensus.cc:359] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.712827 22627 raft_consensus.cc:385] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.713106 22627 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.713907 22627 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.716020 22627 ts_tablet_manager.cc:1434] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:05:52.716976 22627 tablet_bootstrap.cc:492] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:52.721267 22625 tablet_bootstrap.cc:492] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:52.721738 22625 ts_tablet_manager.cc:1403] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.156s	user 0.012s	sys 0.009s
I20260709 13:05:52.722759 22627 tablet_bootstrap.cc:654] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.725534 22674 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.724989 22329 catalog_manager.cc:5697] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.730619 22626 tablet_bootstrap.cc:492] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:52.731175 22626 ts_tablet_manager.cc:1403] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.001s
I20260709 13:05:52.734160 22626 raft_consensus.cc:359] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.734995 22626 raft_consensus.cc:385] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.735306 22626 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.736161 22626 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.738480 22626 ts_tablet_manager.cc:1434] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:52.739534 22626 tablet_bootstrap.cc:492] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:52.724393 22625 raft_consensus.cc:359] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.745678 22625 raft_consensus.cc:385] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.745981 22625 raft_consensus.cc:740] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.746706 22625 consensus_queue.cc:260] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.749022 22625 ts_tablet_manager.cc:1434] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:05:52.749934 22625 tablet_bootstrap.cc:492] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:52.755218 22626 tablet_bootstrap.cc:654] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.765434 22634 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.766206 22634 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.769783 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:52.770545 22506 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:52.771976 22396 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.780570 22658 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.781065 22658 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.781410 22658 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.795964 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:05:52.798225 22399 leader_election.cc:343] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.801395 22649 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.772792 22634 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.846102 22649 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:52.850243 22627 tablet_bootstrap.cc:492] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:52.850557 22625 tablet_bootstrap.cc:654] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.850849 22627 ts_tablet_manager.cc:1403] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.134s	user 0.047s	sys 0.066s
I20260709 13:05:52.853641 22627 raft_consensus.cc:359] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.854337 22627 raft_consensus.cc:385] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.854629 22627 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.855777 22627 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.858727 22626 tablet_bootstrap.cc:492] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:52.859284 22626 ts_tablet_manager.cc:1403] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.120s	user 0.002s	sys 0.009s
I20260709 13:05:52.842494 22658 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.861989 22626 raft_consensus.cc:359] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.865340 22626 raft_consensus.cc:385] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.865657 22626 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.866338 22626 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.867525 22631 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.867990 22631 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.868821 22626 ts_tablet_manager.cc:1434] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:05:52.863909 22627 ts_tablet_manager.cc:1434] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:05:52.869875 22627 tablet_bootstrap.cc:492] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:52.870195 22631 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.871129 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.871870 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.872519 22582 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:52.872920 22658 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.873736 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:52.873955 22474 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.874363 22506 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.874836 22631 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.875207 22631 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.875509 22631 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:52.878196 22472 leader_election.cc:343] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.879654 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:05:52.881593 22399 leader_election.cc:343] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.883087 22631 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.886595 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:52.887239 22582 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.888327 22627 tablet_bootstrap.cc:654] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.893720 22625 tablet_bootstrap.cc:492] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:52.894229 22625 ts_tablet_manager.cc:1403] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.144s	user 0.069s	sys 0.045s
I20260709 13:05:52.895640 22582 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:52.895730 22677 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.896879 22625 raft_consensus.cc:359] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.899832 22625 raft_consensus.cc:385] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.900126 22625 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.900496 22506 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:52.901847 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:52.902277 22625 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.901799 22396 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:05:52.902652 22677 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.903429 22658 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.903807 22677 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.903891 22658 raft_consensus.cc:697] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:52.917472 22627 tablet_bootstrap.cc:492] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:52.918078 22627 ts_tablet_manager.cc:1403] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.003s
I20260709 13:05:52.917521 22658 consensus_queue.cc:237] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.918345 22677 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:05:52.920145 22472 leader_election.cc:343] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.921269 22627 raft_consensus.cc:359] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.921751 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.922016 22627 raft_consensus.cc:385] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.922324 22627 raft_consensus.cc:740] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.922963 22474 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:52.923020 22627 consensus_queue.cc:260] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.904354 22625 ts_tablet_manager.cc:1434] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:52.904709 22631 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.925201 22625 tablet_bootstrap.cc:492] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:52.925279 22627 ts_tablet_manager.cc:1434] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:52.926252 22627 tablet_bootstrap.cc:492] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:52.926819 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.927425 22582 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:52.908957 22626 tablet_bootstrap.cc:492] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:52.925287 22649 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.929061 22649 raft_consensus.cc:697] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:52.929914 22649 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.932695 22627 tablet_bootstrap.cc:654] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.933331 22474 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.934304 22677 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.934155 22674 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.935813 22677 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.936264 22677 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:52.936902 22472 leader_election.cc:343] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.942868 22626 tablet_bootstrap.cc:654] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.945184 22329 catalog_manager.cc:5697] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.946178 22634 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.956936 22631 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.957444 22631 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:52.959406 22631 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:52.962987 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:52.963785 22625 tablet_bootstrap.cc:654] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.963656 22581 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:52.965117 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:52.966034 22631 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.966373 22631 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.966722 22631 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.974992 22674 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.985785 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:52.986560 22433 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:52.994931 22330 catalog_manager.cc:5697] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.997188 22687 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.001820 22625 tablet_bootstrap.cc:492] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:53.002359 22625 ts_tablet_manager.cc:1403] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.000s
I20260709 13:05:53.005154 22625 raft_consensus.cc:359] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.008181 22625 raft_consensus.cc:385] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.008540 22625 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.010278 22625 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.013861 22625 ts_tablet_manager.cc:1434] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:53.013553 22677 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.014782 22625 tablet_bootstrap.cc:492] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.016366 22677 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.016866 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:53.017477 22582 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.018704 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:05:53.020748 22472 leader_election.cc:343] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.976377 22631 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.024935 22582 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:53.024895 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:53.032296 22626 tablet_bootstrap.cc:492] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:53.027289 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:53.066190 22626 ts_tablet_manager.cc:1403] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.158s	user 0.006s	sys 0.021s
I20260709 13:05:53.068943 22474 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:53.070097 22649 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.070590 22649 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:53.071357 22649 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.076553 22433 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.081535 22625 tablet_bootstrap.cc:654] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.025553 22631 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.025624 22581 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.089443 22626 raft_consensus.cc:359] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.090287 22626 raft_consensus.cc:385] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.090579 22626 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.091312 22626 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.093508 22626 ts_tablet_manager.cc:1434] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:05:53.094807 22626 tablet_bootstrap.cc:492] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:53.098295 22627 tablet_bootstrap.cc:492] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:53.098907 22627 ts_tablet_manager.cc:1403] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.173s	user 0.041s	sys 0.070s
I20260709 13:05:53.101105 22626 tablet_bootstrap.cc:654] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.109694 22627 raft_consensus.cc:359] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.110495 22627 raft_consensus.cc:385] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.110769 22627 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.111487 22627 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.113658 22627 ts_tablet_manager.cc:1434] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:05:53.114516 22627 tablet_bootstrap.cc:492] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:53.101941 22433 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:53.123423 22472 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:53.124533 22631 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.125039 22631 raft_consensus.cc:697] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:53.126852 22631 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.129935 22627 tablet_bootstrap.cc:654] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.130578 22625 tablet_bootstrap.cc:492] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:53.131047 22625 ts_tablet_manager.cc:1403] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.116s	user 0.025s	sys 0.001s
I20260709 13:05:53.137117 22581 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:53.137565 22631 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:53.140424 22330 catalog_manager.cc:5697] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.139761 22625 raft_consensus.cc:359] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.142704 22625 raft_consensus.cc:385] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.143045 22625 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.143903 22625 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.146361 22625 ts_tablet_manager.cc:1434] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:53.147518 22625 tablet_bootstrap.cc:492] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.153618 22625 tablet_bootstrap.cc:654] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.161437 22329 catalog_manager.cc:5697] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.165000 22631 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.165519 22631 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.167807 22631 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.173854 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:53.175496 22472 leader_election.cc:343] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.177346 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:53.179107 22625 tablet_bootstrap.cc:492] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
W20260709 13:05:53.178949 22474 leader_election.cc:343] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.179692 22625 ts_tablet_manager.cc:1403] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.004s
I20260709 13:05:53.179606 22474 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:53.180826 22631 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.182973 22626 tablet_bootstrap.cc:492] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:53.183463 22626 ts_tablet_manager.cc:1403] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.089s	user 0.023s	sys 0.019s
I20260709 13:05:53.188200 22625 raft_consensus.cc:359] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.188445 22631 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.189098 22625 raft_consensus.cc:385] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.189473 22625 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.190320 22625 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.192708 22625 ts_tablet_manager.cc:1434] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:53.193770 22625 tablet_bootstrap.cc:492] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.194763 22674 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.195339 22674 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.198885 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:53.199728 22507 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 1: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:05:53.200235 22625 tablet_bootstrap.cc:654] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.201570 22674 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:53.205161 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:53.187069 22626 raft_consensus.cc:359] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.206182 22626 raft_consensus.cc:385] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.206483 22626 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.207233 22546 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:53.208334 22674 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.216053 22674 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.216813 22626 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.218684 22627 tablet_bootstrap.cc:492] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:53.219228 22627 ts_tablet_manager.cc:1403] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.105s	user 0.019s	sys 0.010s
I20260709 13:05:53.222959 22627 raft_consensus.cc:359] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.223747 22627 raft_consensus.cc:385] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.224102 22627 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.225059 22627 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.232945 22627 ts_tablet_manager.cc:1434] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:53.221024 22626 ts_tablet_manager.cc:1434] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:05:53.236172 22627 tablet_bootstrap.cc:492] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:53.237340 22626 tablet_bootstrap.cc:492] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:53.242563 22625 tablet_bootstrap.cc:492] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:53.242959 22625 ts_tablet_manager.cc:1403] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.012s
I20260709 13:05:53.248318 22627 tablet_bootstrap.cc:654] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.249980 22625 raft_consensus.cc:359] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.258399 22625 raft_consensus.cc:385] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.258728 22625 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.259640 22625 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.251811 22626 tablet_bootstrap.cc:654] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.268553 22625 ts_tablet_manager.cc:1434] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:05:53.269630 22625 tablet_bootstrap.cc:492] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.275767 22625 tablet_bootstrap.cc:654] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.280318 22627 tablet_bootstrap.cc:492] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:53.280318 22626 tablet_bootstrap.cc:492] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:53.280997 22627 ts_tablet_manager.cc:1403] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.002s
I20260709 13:05:53.281055 22626 ts_tablet_manager.cc:1403] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.005s
I20260709 13:05:53.283679 22626 raft_consensus.cc:359] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.283798 22627 raft_consensus.cc:359] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.284533 22626 raft_consensus.cc:385] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.284538 22627 raft_consensus.cc:385] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.285041 22627 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.285045 22626 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.285893 22627 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.286075 22626 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.288216 22627 ts_tablet_manager.cc:1434] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:53.289355 22627 tablet_bootstrap.cc:492] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:53.289592 22657 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.290215 22657 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.293112 22657 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.293789 22626 ts_tablet_manager.cc:1434] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:53.295286 22626 tablet_bootstrap.cc:492] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:53.295485 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:53.296214 22581 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:53.296844 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:53.297762 22507 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:53.297847 22399 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:53.299134 22657 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.299782 22657 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.300694 22657 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.300464 22722 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.305099 22722 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.309366 22627 tablet_bootstrap.cc:654] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.310211 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:53.311115 22581 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:53.310587 22722 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.311798 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:53.312413 22474 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:53.313457 22625 tablet_bootstrap.cc:492] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:53.313953 22625 ts_tablet_manager.cc:1403] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.003s
I20260709 13:05:53.313692 22687 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.317868 22649 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.318288 22649 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.318653 22649 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.319950 22657 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.321378 22433 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 1: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:05:53.322427 22625 raft_consensus.cc:359] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.323158 22625 raft_consensus.cc:385] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.323421 22625 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.324095 22625 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.326159 22625 ts_tablet_manager.cc:1434] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:53.327148 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:53.329552 22626 tablet_bootstrap.cc:654] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.329871 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:53.330484 22581 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.328184 22649 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.333259 22625 tablet_bootstrap.cc:492] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.334082 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:53.334273 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:53.334875 22433 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 1: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:05:53.336083 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:53.336429 22508 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:53.336673 22674 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.337150 22674 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.337664 22631 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.339346 22674 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:53.340001 22625 tablet_bootstrap.cc:654] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.341840 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:53.342536 22433 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:53.342904 22627 tablet_bootstrap.cc:492] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:53.343349 22627 ts_tablet_manager.cc:1403] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 13:05:53.345960 22627 raft_consensus.cc:359] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.345995 22649 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.346691 22627 raft_consensus.cc:385] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.347081 22627 raft_consensus.cc:740] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.347803 22627 consensus_queue.cc:260] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.349607 22546 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:53.350734 22684 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.351148 22684 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.351483 22684 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.352003 22687 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.352550 22687 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.353961 22627 ts_tablet_manager.cc:1434] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:53.354964 22627 tablet_bootstrap.cc:492] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:53.355944 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:53.356686 22582 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:53.357677 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:53.358246 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:53.358435 22508 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:53.359293 22658 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.359684 22658 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.360061 22658 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.365082 22687 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.369381 22627 tablet_bootstrap.cc:654] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.371546 22631 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:53.378049 22687 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.380332 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:53.381202 22508 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:53.368428 22658 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.391520 22626 tablet_bootstrap.cc:492] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:53.392114 22626 ts_tablet_manager.cc:1403] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.018s
I20260709 13:05:53.394201 22658 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.395637 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:53.397862 22578 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.400282 22581 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:53.397632 22657 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.401712 22399 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:53.402786 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:53.403466 22508 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.405373 22627 tablet_bootstrap.cc:492] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:53.405846 22627 ts_tablet_manager.cc:1403] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.007s
I20260709 13:05:53.409121 22627 raft_consensus.cc:359] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.409906 22627 raft_consensus.cc:385] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.410218 22627 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.411062 22627 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.414299 22657 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.414942 22657 raft_consensus.cc:697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:53.395533 22684 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.418155 22627 ts_tablet_manager.cc:1434] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:53.419466 22627 tablet_bootstrap.cc:492] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:53.425263 22626 raft_consensus.cc:359] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.426141 22626 raft_consensus.cc:385] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.426429 22626 raft_consensus.cc:740] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.415784 22657 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.427193 22626 consensus_queue.cc:260] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.433666 22578 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:53.431841 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:53.434651 22433 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.434782 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:53.435731 22658 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.436219 22658 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:53.437086 22658 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.439374 22684 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:53.441768 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:53.442394 22507 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.446916 22627 tablet_bootstrap.cc:654] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.450186 22507 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:53.454202 22545 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:53.450681 22433 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:53.452049 22625 tablet_bootstrap.cc:492] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:53.455790 22625 ts_tablet_manager.cc:1403] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.123s	user 0.024s	sys 0.013s
I20260709 13:05:53.453130 22626 ts_tablet_manager.cc:1434] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 13:05:53.457968 22626 tablet_bootstrap.cc:492] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:53.458284 22684 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.462553 22684 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:53.463660 22684 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.466399 22649 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.467265 22625 raft_consensus.cc:359] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.469286 22625 raft_consensus.cc:385] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.469580 22433 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.469820 22625 raft_consensus.cc:740] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.470881 22625 consensus_queue.cc:260] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.473865 22625 ts_tablet_manager.cc:1434] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 13:05:53.475240 22625 tablet_bootstrap.cc:492] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.434391 22508 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:53.490470 22626 tablet_bootstrap.cc:654] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.504562 22649 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.517423 22431 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.522786 22627 tablet_bootstrap.cc:492] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:53.523447 22627 ts_tablet_manager.cc:1403] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.004s
I20260709 13:05:53.541546 22722 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.545795 22649 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.548424 22330 catalog_manager.cc:5697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.562511 22625 tablet_bootstrap.cc:654] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.546187 22657 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.566140 22657 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.568712 22657 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.571609 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:53.578667 22627 raft_consensus.cc:359] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.579691 22627 raft_consensus.cc:385] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.579962 22627 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
W20260709 13:05:53.582376 22379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:53.582167 22627 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.585727 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:53.587747 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:53.595748 22627 ts_tablet_manager.cc:1434] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.001s
I20260709 13:05:53.602276 22631 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.602475 22330 catalog_manager.cc:5697] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.605294 22627 tablet_bootstrap.cc:492] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:53.609216 22687 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.614321 22687 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.614820 22687 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.617530 22626 tablet_bootstrap.cc:492] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:53.618010 22626 ts_tablet_manager.cc:1403] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.160s	user 0.052s	sys 0.031s
I20260709 13:05:53.622311 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:53.622702 22626 raft_consensus.cc:359] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.623064 22508 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:05:53.623395 22626 raft_consensus.cc:385] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.623829 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:53.623720 22626 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.624665 22396 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:53.624816 22626 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.625474 22658 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:53.625854 22658 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.626169 22658 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.626792 22626 ts_tablet_manager.cc:1434] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:53.622232 22687 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.628042 22626 tablet_bootstrap.cc:492] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:53.633366 22658 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.634038 22626 tablet_bootstrap.cc:654] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.635934 22627 tablet_bootstrap.cc:654] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.638463 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:53.637956 22328 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.639166 22508 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.645905 22625 tablet_bootstrap.cc:492] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:53.646479 22625 ts_tablet_manager.cc:1403] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.172s	user 0.025s	sys 0.006s
I20260709 13:05:53.650368 22508 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:05:53.652702 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:53.653751 22579 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.654054 22626 tablet_bootstrap.cc:492] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:53.654515 22626 ts_tablet_manager.cc:1403] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.004s
I20260709 13:05:53.660889 22579 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:05:53.662158 22399 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:53.663378 22687 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:53.663946 22687 raft_consensus.cc:697] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:53.664799 22687 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.653180 22658 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.669420 22626 raft_consensus.cc:359] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.670397 22625 raft_consensus.cc:359] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.671121 22626 raft_consensus.cc:385] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.671200 22625 raft_consensus.cc:385] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.671468 22626 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.671670 22625 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.672737 22626 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.674835 22626 ts_tablet_manager.cc:1434] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:05:53.675506 22627 tablet_bootstrap.cc:492] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:53.676342 22627 ts_tablet_manager.cc:1403] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.004s
I20260709 13:05:53.675725 22626 tablet_bootstrap.cc:492] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:53.672955 22625 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.679333 22625 ts_tablet_manager.cc:1434] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:05:53.679944 22627 raft_consensus.cc:359] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.680508 22625 tablet_bootstrap.cc:492] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.680801 22627 raft_consensus.cc:385] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.681173 22627 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.682009 22627 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.683282 22626 tablet_bootstrap.cc:654] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.684139 22627 ts_tablet_manager.cc:1434] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:53.683954 22328 catalog_manager.cc:5697] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.685182 22627 tablet_bootstrap.cc:492] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:53.686554 22625 tablet_bootstrap.cc:654] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.690827 22627 tablet_bootstrap.cc:654] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.705965 22625 tablet_bootstrap.cc:492] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:53.706460 22625 ts_tablet_manager.cc:1403] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.003s
I20260709 13:05:53.709290 22625 raft_consensus.cc:359] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.709980 22625 raft_consensus.cc:385] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.711369 22625 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.712237 22631 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.712210 22625 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.712841 22631 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.713505 22627 tablet_bootstrap.cc:492] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:53.714008 22627 ts_tablet_manager.cc:1403] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.007s
I20260709 13:05:53.714665 22625 ts_tablet_manager.cc:1434] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:53.714926 22631 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.715960 22625 tablet_bootstrap.cc:492] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.716950 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:53.716862 22627 raft_consensus.cc:359] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.717794 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:53.717972 22627 raft_consensus.cc:385] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.718029 22579 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:53.718294 22627 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.718858 22433 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:53.719004 22627 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.719554 22474 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:53.720679 22631 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.721043 22631 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.721359 22631 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.723640 22677 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.724172 22677 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.726716 22625 tablet_bootstrap.cc:654] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.731739 22627 ts_tablet_manager.cc:1434] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:53.733485 22677 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.735167 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:53.735546 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:53.735854 22579 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:53.736191 22433 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:53.737386 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:53.738306 22677 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.739666 22627 tablet_bootstrap.cc:492] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:53.738922 22677 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.741530 22677 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.745864 22625 tablet_bootstrap.cc:492] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:53.746397 22625 ts_tablet_manager.cc:1403] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.003s
I20260709 13:05:53.746706 22626 tablet_bootstrap.cc:492] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:53.747094 22626 ts_tablet_manager.cc:1403] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.072s	user 0.005s	sys 0.007s
I20260709 13:05:53.747289 22631 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.749137 22625 raft_consensus.cc:359] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.749475 22631 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.749835 22625 raft_consensus.cc:385] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.750114 22625 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.751389 22625 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.750759 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:53.752543 22579 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.753556 22625 ts_tablet_manager.cc:1434] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:53.754058 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:53.754766 22625 tablet_bootstrap.cc:492] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.754649 22433 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.762954 22579 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:53.767120 22627 tablet_bootstrap.cc:654] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.766633 22474 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:53.769716 22649 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.770290 22649 raft_consensus.cc:697] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:53.771106 22677 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.771144 22649 consensus_queue.cc:237] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.774135 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:53.774971 22432 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.775349 22677 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.772802 22433 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:53.785612 22626 raft_consensus.cc:359] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.786448 22626 raft_consensus.cc:385] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.786746 22626 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.787559 22626 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.784623 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:53.789381 22579 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.790009 22626 ts_tablet_manager.cc:1434] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:05:53.791440 22626 tablet_bootstrap.cc:492] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:53.791445 22625 tablet_bootstrap.cc:654] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.785527 22432 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:53.795922 22627 tablet_bootstrap.cc:492] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:53.796381 22627 ts_tablet_manager.cc:1403] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.007s
I20260709 13:05:53.797442 22472 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:53.797992 22626 tablet_bootstrap.cc:654] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.799103 22627 raft_consensus.cc:359] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.799822 22627 raft_consensus.cc:385] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.800103 22627 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.800832 22627 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.799419 22677 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.804383 22677 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:53.804759 22579 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:53.806299 22328 catalog_manager.cc:5697] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.810335 22677 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.811619 22627 ts_tablet_manager.cc:1434] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:05:53.813115 22627 tablet_bootstrap.cc:492] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:53.817826 22684 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.818795 22627 tablet_bootstrap.cc:654] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.818377 22684 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.822817 22625 tablet_bootstrap.cc:492] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:53.823300 22625 ts_tablet_manager.cc:1403] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.004s
I20260709 13:05:53.825104 22684 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:53.826810 22625 raft_consensus.cc:359] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.827193 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:53.827193 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:53.827633 22625 raft_consensus.cc:385] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.827977 22625 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
W20260709 13:05:53.828713 22545 leader_election.cc:343] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.828872 22625 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:53.829555 22546 leader_election.cc:343] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.830008 22546 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:53.831246 22684 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.839515 22625 ts_tablet_manager.cc:1434] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.006s
I20260709 13:05:53.840790 22625 tablet_bootstrap.cc:492] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.853588 22687 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.855561 22625 tablet_bootstrap.cc:654] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.860245 22627 tablet_bootstrap.cc:492] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:53.860785 22627 ts_tablet_manager.cc:1403] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.020s
I20260709 13:05:53.863487 22627 raft_consensus.cc:359] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.864176 22627 raft_consensus.cc:385] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.864539 22627 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.866385 22626 tablet_bootstrap.cc:492] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:53.865238 22627 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.871685 22626 ts_tablet_manager.cc:1403] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.004s
I20260709 13:05:53.873960 22625 tablet_bootstrap.cc:492] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:53.873986 22627 ts_tablet_manager.cc:1434] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:53.874629 22625 ts_tablet_manager.cc:1403] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.009s
I20260709 13:05:53.875233 22627 tablet_bootstrap.cc:492] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:53.877735 22625 raft_consensus.cc:359] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.878448 22625 raft_consensus.cc:385] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.878719 22625 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.879420 22626 raft_consensus.cc:359] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.881467 22627 tablet_bootstrap.cc:654] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.882135 22625 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.884207 22625 ts_tablet_manager.cc:1434] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:05:53.885274 22625 tablet_bootstrap.cc:492] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:53.885456 22328 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.887359 22684 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.887847 22684 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.890045 22684 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:53.892180 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:53.892972 22432 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:53.892180 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:53.899446 22625 tablet_bootstrap.cc:654] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.900609 22546 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:53.901479 22674 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.901942 22674 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.904343 22674 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:53.904575 22658 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.905011 22674 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.905441 22674 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.905798 22674 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.906788 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:53.880131 22626 raft_consensus.cc:385] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.905167 22658 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.908432 22626 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.909425 22626 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.910267 22658 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.911142 22507 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:53.912127 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:53.912814 22579 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
W20260709 13:05:53.905710 22545 leader_election.cc:343] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.915408 22545 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:53.915719 22626 ts_tablet_manager.cc:1434] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:05:53.915968 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:53.915853 22399 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:53.916730 22626 tablet_bootstrap.cc:492] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:53.916706 22432 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:53.917682 22684 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.917939 22749 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.918373 22749 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.918799 22749 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.919237 22657 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.918308 22684 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.925830 22684 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.927518 22657 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.917722 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:53.929839 22508 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:53.941591 22749 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.945101 22674 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.961521 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:53.962894 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:53.963579 22432 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:53.964423 22545 leader_election.cc:343] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.968326 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:53.969280 22507 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.954124 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:53.974345 22579 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.960047 22674 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:53.977548 22674 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.978564 22674 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:53.952917 22749 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:53.982064 22634 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.984849 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:53.985761 22433 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:54.000645 22674 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:54.008054 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:54.001627 22546 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:54.009171 22627 tablet_bootstrap.cc:492] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:54.009668 22627 ts_tablet_manager.cc:1403] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.024s
I20260709 13:05:54.009639 22674 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.012941 22674 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.013046 22627 raft_consensus.cc:359] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.013317 22674 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.014160 22627 raft_consensus.cc:385] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.014460 22627 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.015110 22627 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.009195 22506 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:54.016914 22627 ts_tablet_manager.cc:1434] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:53.959029 22684 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.017832 22627 tablet_bootstrap.cc:492] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:54.022368 22626 tablet_bootstrap.cc:654] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.029358 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:54.030000 22433 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.034350 22684 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:54.035693 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:54.036355 22506 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.038970 22433 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:54.044073 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:54.026746 22432 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:54.050459 22546 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:54.050714 22625 tablet_bootstrap.cc:492] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:54.214803 22625 ts_tablet_manager.cc:1403] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.330s	user 0.017s	sys 0.052s
I20260709 13:05:54.055358 22506 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:54.062285 22507 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:54.051216 22684 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.222687 22684 raft_consensus.cc:697] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:54.154498 22780 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.093s
I20260709 13:05:54.223687 22684 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.129941 22631 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.228574 22631 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.231065 22626 tablet_bootstrap.cc:492] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:54.232959 22626 ts_tablet_manager.cc:1403] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.316s	user 0.020s	sys 0.010s
I20260709 13:05:54.129588 22782 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.241361 22782 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.246579 22626 raft_consensus.cc:359] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.247174 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:54.250288 22626 raft_consensus.cc:385] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.250299 22506 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:54.251806 22626 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.252687 22545 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:54.256712 22780 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.257212 22780 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.257603 22780 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.033723 22579 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:54.260715 22626 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.263044 22626 ts_tablet_manager.cc:1434] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:05:54.266410 22626 tablet_bootstrap.cc:492] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:54.267767 22396 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:54.268724 22749 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.269241 22749 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:54.273782 22626 tablet_bootstrap.cc:654] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.276099 22506 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:54.276512 22627 tablet_bootstrap.cc:654] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.270062 22749 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.280606 22631 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:54.281924 22674 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.284534 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:54.285182 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:54.285786 22508 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:54.294528 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 244168us
I20260709 13:05:54.295691 22684 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.296391 22684 raft_consensus.cc:697] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:54.297278 22684 consensus_queue.cc:237] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.301595 22625 raft_consensus.cc:359] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.303094 22625 raft_consensus.cc:385] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.303426 22625 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.304148 22625 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.307157 22782 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:54.307852 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:54.310362 22722 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.311784 22649 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.314954 22578 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:54.319250 22626 tablet_bootstrap.cc:492] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:54.327947 22626 ts_tablet_manager.cc:1403] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.027s
I20260709 13:05:54.328738 22780 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.330029 22579 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 1: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:05:54.321998 22508 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:54.331503 22674 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:54.335649 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:54.336287 22432 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.336400 22657 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.336862 22626 raft_consensus.cc:359] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.337532 22626 raft_consensus.cc:385] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.337793 22626 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.336427 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:54.338779 22429 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.338456 22626 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.342533 22627 tablet_bootstrap.cc:492] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:54.343047 22627 ts_tablet_manager.cc:1403] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.325s	user 0.010s	sys 0.000s
I20260709 13:05:54.345902 22432 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:54.345741 22627 raft_consensus.cc:359] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.346626 22627 raft_consensus.cc:385] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.349877 22627 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.353170 22780 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:54.353453 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:54.354252 22626 ts_tablet_manager.cc:1434] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:05:54.353914 22627 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.356323 22627 ts_tablet_manager.cc:1434] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:05:54.358062 22429 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:54.355258 22626 tablet_bootstrap.cc:492] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:54.361945 22657 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:54.376582 22330 catalog_manager.cc:5697] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.384176 22627 tablet_bootstrap.cc:492] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:54.402462 22625 ts_tablet_manager.cc:1434] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.187s	user 0.021s	sys 0.006s
I20260709 13:05:54.403632 22625 tablet_bootstrap.cc:492] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:54.412443 22546 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:54.412684 22780 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.413341 22684 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.413813 22684 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:54.414630 22684 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:54.424526 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 98204.6us
I20260709 13:05:54.433668 22627 tablet_bootstrap.cc:654] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.438591 22330 catalog_manager.cc:5697] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.441433 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:05:54.442332 22472 leader_election.cc:343] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.442523 22508 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.442862 22472 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:54.444007 22625 tablet_bootstrap.cc:654] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.449857 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:54.449129 22626 tablet_bootstrap.cc:654] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.463162 22329 catalog_manager.cc:5697] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.468864 22649 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.458815 22684 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.470448 22684 raft_consensus.cc:697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:54.471308 22684 consensus_queue.cc:237] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.473482 22649 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.505815 22508 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:54.516884 22631 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.549966 22625 tablet_bootstrap.cc:492] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:54.550499 22625 ts_tablet_manager.cc:1403] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.147s	user 0.012s	sys 0.001s
I20260709 13:05:54.551985 22329 catalog_manager.cc:5697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.557102 22780 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.556545 22329 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.557686 22780 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.559731 22780 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:54.561187 22625 raft_consensus.cc:359] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.561784 22625 raft_consensus.cc:385] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.561996 22625 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.562470 22625 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.564314 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:54.565693 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:54.565884 22546 leader_election.cc:343] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:54.567004 22545 leader_election.cc:343] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.567334 22545 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:54.570291 22627 tablet_bootstrap.cc:492] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:54.570782 22627 ts_tablet_manager.cc:1403] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.187s	user 0.011s	sys 0.005s
I20260709 13:05:54.573905 22780 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.578905 22626 tablet_bootstrap.cc:492] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:54.579380 22626 ts_tablet_manager.cc:1403] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.224s	user 0.008s	sys 0.015s
I20260709 13:05:54.581847 22631 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.582348 22631 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.576081 22627 raft_consensus.cc:359] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.586012 22627 raft_consensus.cc:385] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.586155 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:54.586339 22627 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.586333 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:54.586795 22579 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:54.587184 22433 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:54.588177 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:54.589077 22649 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.589432 22649 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.589843 22649 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.590042 22627 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.592645 22625 ts_tablet_manager.cc:1434] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:05:54.593730 22625 tablet_bootstrap.cc:492] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:54.594842 22627 ts_tablet_manager.cc:1434] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:05:54.595712 22627 tablet_bootstrap.cc:492] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:54.584411 22631 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:54.602595 22649 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.604720 22722 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.605212 22722 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.605659 22649 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:54.606446 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:54.607127 22579 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.614537 22579 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:54.649488 22626 raft_consensus.cc:359] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.651113 22626 raft_consensus.cc:385] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.651496 22626 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.652606 22626 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.649200 22722 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:54.659816 22626 ts_tablet_manager.cc:1434] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:05:54.660920 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:54.663275 22431 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.665180 22780 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.666148 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:54.667331 22795 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.669178 22795 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:54.669770 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:54.662801 22626 tablet_bootstrap.cc:492] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:54.670081 22795 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.673341 22780 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.674973 22431 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:54.684804 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:54.685901 22429 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 1: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:05:54.687774 22625 tablet_bootstrap.cc:654] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.690106 22627 tablet_bootstrap.cc:654] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.702040 22472 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:54.704030 22649 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.707146 22687 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.716070 22626 tablet_bootstrap.cc:654] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.743119 22649 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.766425 22749 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:54.778158 22379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:54.795300 22625 tablet_bootstrap.cc:492] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:54.795832 22625 ts_tablet_manager.cc:1403] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.202s	user 0.015s	sys 0.010s
I20260709 13:05:54.797317 22674 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.799182 22627 tablet_bootstrap.cc:492] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:54.805275 22781 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.852303 22626 tablet_bootstrap.cc:492] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:54.852594 22627 ts_tablet_manager.cc:1403] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.257s	user 0.054s	sys 0.037s
I20260709 13:05:54.852761 22626 ts_tablet_manager.cc:1403] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.190s	user 0.010s	sys 0.008s
I20260709 13:05:54.854815 22626 raft_consensus.cc:359] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.858564 22626 raft_consensus.cc:385] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.858816 22626 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.859336 22626 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.856093 22627 raft_consensus.cc:359] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.862995 22627 raft_consensus.cc:385] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.863310 22627 raft_consensus.cc:740] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.863970 22627 consensus_queue.cc:260] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.865563 22627 ts_tablet_manager.cc:1434] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:05:54.866550 22627 tablet_bootstrap.cc:492] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:54.878283 22625 raft_consensus.cc:359] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.888398 22329 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.892007 22674 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.879060 22625 raft_consensus.cc:385] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.898307 22625 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.899021 22625 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.903658 22625 ts_tablet_manager.cc:1434] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.001s
I20260709 13:05:54.904639 22625 tablet_bootstrap.cc:492] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:54.909726 22627 tablet_bootstrap.cc:654] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.911490 22626 ts_tablet_manager.cc:1434] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.001s
I20260709 13:05:54.913694 22626 tablet_bootstrap.cc:492] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:54.920794 22781 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.921967 22625 tablet_bootstrap.cc:654] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.933434 22795 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.933995 22795 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.936160 22795 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:54.939092 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:54.941202 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:54.944890 22578 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
W20260709 13:05:54.945984 22472 leader_election.cc:343] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.946751 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:54.947662 22627 tablet_bootstrap.cc:492] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:54.948101 22627 ts_tablet_manager.cc:1403] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.010s
I20260709 13:05:54.949472 22631 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.949877 22631 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.950220 22631 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.950562 22782 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.965471 22626 tablet_bootstrap.cc:654] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.971210 22627 raft_consensus.cc:359] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.972436 22627 raft_consensus.cc:385] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.972776 22627 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.973498 22627 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.975703 22627 ts_tablet_manager.cc:1434] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.027s	user 0.001s	sys 0.003s
I20260709 13:05:54.976676 22627 tablet_bootstrap.cc:492] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:54.977941 22631 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:54.987546 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:05:54.993383 22472 leader_election.cc:343] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.011226 22782 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.014776 22631 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.015218 22722 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.015662 22722 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.016301 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:55.016901 22578 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.017760 22722 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.019786 22625 tablet_bootstrap.cc:492] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:55.020828 22625 ts_tablet_manager.cc:1403] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.116s	user 0.023s	sys 0.020s
I20260709 13:05:55.021143 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.021786 22429 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:55.019912 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:55.025132 22581 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:55.026182 22625 raft_consensus.cc:359] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.026950 22625 raft_consensus.cc:385] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.027259 22625 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.027925 22625 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.029945 22625 ts_tablet_manager.cc:1434] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:55.035377 22780 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.035880 22780 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.038025 22780 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.039482 22625 tablet_bootstrap.cc:492] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:55.040776 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.026892 22474 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:55.041813 22634 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.042307 22634 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.044445 22634 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.045836 22722 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.046386 22722 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.046701 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.047652 22505 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:05:55.045893 22546 leader_election.cc:343] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.050367 22627 tablet_bootstrap.cc:654] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.046783 22722 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.056324 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.072288 22578 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:55.061281 22722 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.056716 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:55.100387 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:05:55.103094 22545 leader_election.cc:343] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.103549 22722 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.108685 22545 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.108551 22581 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:55.110309 22780 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.111104 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:55.111821 22429 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.112056 22399 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.114432 22634 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.114518 22722 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.115149 22722 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:55.115990 22722 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.122503 22429 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:55.121177 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:55.123659 22626 tablet_bootstrap.cc:492] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:55.123876 22581 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.124145 22626 ts_tablet_manager.cc:1403] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.211s	user 0.009s	sys 0.009s
I20260709 13:05:55.126106 22627 tablet_bootstrap.cc:492] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.126709 22627 ts_tablet_manager.cc:1403] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.009s
I20260709 13:05:55.126801 22472 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:55.127774 22649 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.128279 22649 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:55.129173 22649 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.133713 22626 raft_consensus.cc:359] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.135070 22626 raft_consensus.cc:385] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.135492 22626 raft_consensus.cc:740] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.136300 22627 raft_consensus.cc:359] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.136631 22626 consensus_queue.cc:260] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.137217 22627 raft_consensus.cc:385] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.137603 22627 raft_consensus.cc:740] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.138494 22627 consensus_queue.cc:260] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.139328 22581 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:55.141629 22634 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.149667 22626 ts_tablet_manager.cc:1434] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:05:55.150979 22626 tablet_bootstrap.cc:492] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:55.156791 22627 ts_tablet_manager.cc:1434] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:05:55.157987 22627 tablet_bootstrap.cc:492] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.176007 22627 tablet_bootstrap.cc:654] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.178889 22626 tablet_bootstrap.cc:654] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.184680 22625 tablet_bootstrap.cc:654] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.191565 22328 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.199653 22649 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.200186 22649 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.203598 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:55.204303 22581 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:55.205706 22474 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:55.206691 22795 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.207062 22795 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.207415 22795 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.207927 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.209728 22780 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.210429 22780 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:55.211254 22472 leader_election.cc:343] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.213690 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.213984 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:55.216464 22546 leader_election.cc:343] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.217267 22795 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:55.217639 22545 leader_election.cc:343] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.218130 22545 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.218981 22782 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.212412 22780 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.220141 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:05:55.221836 22472 leader_election.cc:343] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.224458 22625 tablet_bootstrap.cc:492] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:55.225234 22625 ts_tablet_manager.cc:1403] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.186s	user 0.006s	sys 0.011s
I20260709 13:05:55.227003 22627 tablet_bootstrap.cc:492] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.227488 22627 ts_tablet_manager.cc:1403] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.003s
I20260709 13:05:55.231479 22330 catalog_manager.cc:5697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.234184 22625 raft_consensus.cc:359] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.226012 22649 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.235651 22625 raft_consensus.cc:385] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.235991 22625 raft_consensus.cc:740] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.237547 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:55.234751 22627 raft_consensus.cc:359] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.238250 22627 raft_consensus.cc:385] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.238214 22581 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.238641 22627 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.239420 22627 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.241465 22627 ts_tablet_manager.cc:1434] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:05:55.241242 22625 consensus_queue.cc:260] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.247400 22581 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:55.247978 22795 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.249269 22625 ts_tablet_manager.cc:1434] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:05:55.250289 22625 tablet_bootstrap.cc:492] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:55.250389 22474 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:55.250977 22627 tablet_bootstrap.cc:492] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.252614 22626 tablet_bootstrap.cc:492] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:55.254308 22795 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.254920 22795 raft_consensus.cc:697] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:55.256510 22795 consensus_queue.cc:237] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.257153 22627 tablet_bootstrap.cc:654] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.253104 22626 ts_tablet_manager.cc:1403] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.002s
I20260709 13:05:55.267014 22626 raft_consensus.cc:359] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.267800 22626 raft_consensus.cc:385] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.268100 22626 raft_consensus.cc:740] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.268863 22626 consensus_queue.cc:260] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.271008 22626 ts_tablet_manager.cc:1434] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:05:55.272166 22627 tablet_bootstrap.cc:492] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.272697 22627 ts_tablet_manager.cc:1403] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.002s
I20260709 13:05:55.272018 22626 tablet_bootstrap.cc:492] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:55.276250 22627 raft_consensus.cc:359] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.276954 22627 raft_consensus.cc:385] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.277343 22627 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.279646 22625 tablet_bootstrap.cc:654] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.280663 22795 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.281329 22328 catalog_manager.cc:5697] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.280712 22627 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.298300 22627 ts_tablet_manager.cc:1434] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:05:55.299299 22627 tablet_bootstrap.cc:492] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.305684 22649 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.314044 22626 tablet_bootstrap.cc:654] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.314555 22627 tablet_bootstrap.cc:654] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.351656 22627 tablet_bootstrap.cc:492] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.352182 22627 ts_tablet_manager.cc:1403] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.001s
I20260709 13:05:55.354861 22627 raft_consensus.cc:359] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.355633 22627 raft_consensus.cc:385] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.355907 22627 raft_consensus.cc:740] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.356329 22625 tablet_bootstrap.cc:492] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:55.356864 22625 ts_tablet_manager.cc:1403] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.107s	user 0.027s	sys 0.019s
I20260709 13:05:55.359624 22625 raft_consensus.cc:359] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.360301 22625 raft_consensus.cc:385] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.360625 22625 raft_consensus.cc:740] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.361251 22625 consensus_queue.cc:260] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.362838 22627 consensus_queue.cc:260] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.363292 22625 ts_tablet_manager.cc:1434] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:55.366370 22625 tablet_bootstrap.cc:492] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:55.367549 22626 tablet_bootstrap.cc:492] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:55.368031 22626 ts_tablet_manager.cc:1403] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.006s
I20260709 13:05:55.370630 22626 raft_consensus.cc:359] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.371304 22626 raft_consensus.cc:385] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.371582 22626 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.372577 22626 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.374392 22627 ts_tablet_manager.cc:1434] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:05:55.375485 22627 tablet_bootstrap.cc:492] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.376549 22625 tablet_bootstrap.cc:654] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.377547 22626 ts_tablet_manager.cc:1434] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:05:55.378468 22626 tablet_bootstrap.cc:492] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:55.390846 22627 tablet_bootstrap.cc:654] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.398123 22780 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.398679 22780 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.400898 22780 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.402227 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:55.403677 22545 leader_election.cc:343] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.405740 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.406339 22626 tablet_bootstrap.cc:654] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:55.408121 22546 leader_election.cc:343] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.408660 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.410656 22782 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.420064 22627 tablet_bootstrap.cc:492] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.420584 22627 ts_tablet_manager.cc:1403] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.006s
I20260709 13:05:55.424677 22782 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.425225 22782 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.425984 22625 tablet_bootstrap.cc:492] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:55.426355 22625 ts_tablet_manager.cc:1403] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.005s
I20260709 13:05:55.424485 22627 raft_consensus.cc:359] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.426817 22627 raft_consensus.cc:385] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.427114 22627 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.427415 22782 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.428040 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.427770 22627 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.428591 22429 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:55.429735 22546 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:55.430807 22782 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.431273 22782 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.431663 22782 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.431636 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.432438 22505 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:55.433699 22625 raft_consensus.cc:359] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.434406 22625 raft_consensus.cc:385] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.434676 22625 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.435313 22625 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.441354 22627 ts_tablet_manager.cc:1434] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:05:55.441707 22782 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.442412 22627 tablet_bootstrap.cc:492] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.444542 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:55.445176 22429 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.448221 22627 tablet_bootstrap.cc:654] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.458518 22625 ts_tablet_manager.cc:1434] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:05:55.460644 22429 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:55.461977 22546 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:55.462884 22684 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.463364 22684 raft_consensus.cc:697] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:55.464178 22684 consensus_queue.cc:237] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.465018 22625 tablet_bootstrap.cc:492] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:55.470309 22658 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.470827 22658 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.471628 22782 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.471735 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:55.473183 22508 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.473927 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.473168 22658 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.476984 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:55.477772 22581 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
W20260709 13:05:55.479023 22396 leader_election.cc:343] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.479925 22399 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.480971 22658 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.481362 22658 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.481731 22658 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.490180 22658 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.495388 22625 tablet_bootstrap.cc:654] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.497581 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:55.483661 22508 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
W20260709 13:05:55.499080 22396 leader_election.cc:343] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.499356 22627 tablet_bootstrap.cc:492] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.499799 22627 ts_tablet_manager.cc:1403] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.058s	user 0.033s	sys 0.007s
I20260709 13:05:55.501176 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:55.501775 22581 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.502429 22627 raft_consensus.cc:359] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.503089 22627 raft_consensus.cc:385] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.503819 22627 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.504510 22627 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.505362 22328 catalog_manager.cc:5697] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.506574 22627 ts_tablet_manager.cc:1434] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:55.507123 22626 tablet_bootstrap.cc:492] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:55.507506 22627 tablet_bootstrap.cc:492] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.507618 22626 ts_tablet_manager.cc:1403] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.129s	user 0.020s	sys 0.000s
I20260709 13:05:55.512563 22626 raft_consensus.cc:359] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.513386 22626 raft_consensus.cc:385] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.513718 22626 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.514560 22626 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.515332 22627 tablet_bootstrap.cc:654] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.529038 22749 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.529706 22749 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.532256 22749 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.534221 22581 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:55.535291 22658 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.540544 22399 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.541640 22658 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.541893 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:55.542135 22658 raft_consensus.cc:697] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:55.542685 22581 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:55.542979 22658 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.543411 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.541949 22626 ts_tablet_manager.cc:1434] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
I20260709 13:05:55.545532 22626 tablet_bootstrap.cc:492] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:55.545333 22396 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.547309 22625 tablet_bootstrap.cc:492] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:55.547773 22625 ts_tablet_manager.cc:1403] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.011s
I20260709 13:05:55.549801 22627 tablet_bootstrap.cc:492] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.550338 22627 ts_tablet_manager.cc:1403] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.008s
I20260709 13:05:55.551141 22626 tablet_bootstrap.cc:654] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.551506 22749 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.553086 22627 raft_consensus.cc:359] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.553810 22627 raft_consensus.cc:385] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.554121 22627 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.555284 22627 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.555958 22625 raft_consensus.cc:359] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.556681 22625 raft_consensus.cc:385] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.556945 22625 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.557638 22627 ts_tablet_manager.cc:1434] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:55.558004 22625 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.558696 22627 tablet_bootstrap.cc:492] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.565341 22627 tablet_bootstrap.cc:654] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.567647 22625 ts_tablet_manager.cc:1434] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:05:55.571856 22625 tablet_bootstrap.cc:492] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:55.585260 22627 tablet_bootstrap.cc:492] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.585883 22627 ts_tablet_manager.cc:1403] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.003s
I20260709 13:05:55.586544 22631 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.587327 22626 tablet_bootstrap.cc:492] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:55.587777 22626 ts_tablet_manager.cc:1403] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.008s
I20260709 13:05:55.587152 22330 catalog_manager.cc:5697] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.597077 22722 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.597601 22722 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.600770 22626 raft_consensus.cc:359] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.601480 22626 raft_consensus.cc:385] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.601755 22626 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.597106 22627 raft_consensus.cc:359] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.602669 22627 raft_consensus.cc:385] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.603027 22627 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.605147 22626 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.618709 22749 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.636016 22626 ts_tablet_manager.cc:1434] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.007s
I20260709 13:05:55.639490 22626 tablet_bootstrap.cc:492] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:55.638025 22627 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.640401 22722 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.642328 22627 ts_tablet_manager.cc:1434] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.001s
I20260709 13:05:55.646706 22627 tablet_bootstrap.cc:492] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.650997 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.654136 22625 tablet_bootstrap.cc:654] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:55.648653 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 79281.1us
I20260709 13:05:55.658874 22631 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:55.656620 22472 leader_election.cc:343] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.664497 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:55.665227 22581 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:55.665699 22795 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.675359 22782 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.675922 22782 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.677376 22474 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:55.678022 22782 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.683633 22626 tablet_bootstrap.cc:654] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.684331 22631 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.695425 22631 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.695781 22631 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.696058 22625 tablet_bootstrap.cc:492] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:55.696540 22625 ts_tablet_manager.cc:1403] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.000s
I20260709 13:05:55.697764 22627 tablet_bootstrap.cc:654] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.699770 22625 raft_consensus.cc:359] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.684841 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.691473 22684 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.700523 22625 raft_consensus.cc:385] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.700835 22625 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.700801 22684 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.701596 22625 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.703001 22684 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.694352 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.704114 22625 ts_tablet_manager.cc:1434] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:55.702836 22795 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.705143 22625 tablet_bootstrap.cc:492] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
W20260709 13:05:55.707540 22545 leader_election.cc:343] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.707741 22631 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.709776 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:55.710578 22546 leader_election.cc:343] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.711076 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.711833 22684 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.713322 22625 tablet_bootstrap.cc:654] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.723943 22627 tablet_bootstrap.cc:492] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.724849 22627 ts_tablet_manager.cc:1403] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.004s
I20260709 13:05:55.727185 22625 tablet_bootstrap.cc:492] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:55.727758 22625 ts_tablet_manager.cc:1403] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:05:55.691699 22722 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.729066 22631 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.732162 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.735662 22508 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:55.735263 22627 raft_consensus.cc:359] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.737218 22627 raft_consensus.cc:385] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.737959 22627 raft_consensus.cc:740] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.739218 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:55.739878 22579 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.739109 22627 consensus_queue.cc:260] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.741853 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:55.744967 22627 ts_tablet_manager.cc:1434] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:05:55.746590 22627 tablet_bootstrap.cc:492] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.746760 22579 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
W20260709 13:05:55.747489 22546 leader_election.cc:343] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.733109 22722 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.759035 22722 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.761314 22722 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.730417 22625 raft_consensus.cc:359] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.761931 22625 raft_consensus.cc:385] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.762238 22625 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.754585 22626 tablet_bootstrap.cc:492] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:55.763085 22684 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.762872 22625 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.763561 22626 ts_tablet_manager.cc:1403] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.006s
I20260709 13:05:55.763587 22684 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.765466 22474 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:55.767679 22857 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.767835 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:55.766649 22626 raft_consensus.cc:359] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.768255 22857 raft_consensus.cc:697] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:55.768504 22626 raft_consensus.cc:385] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.770514 22626 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.767518 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.766776 22684 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.771405 22626 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.769654 22857 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.774461 22627 tablet_bootstrap.cc:654] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.775633 22626 ts_tablet_manager.cc:1434] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:05:55.768541 22579 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:55.776690 22626 tablet_bootstrap.cc:492] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
W20260709 13:05:55.772229 22546 leader_election.cc:343] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.778515 22545 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:55.781059 22684 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.781294 22625 ts_tablet_manager.cc:1434] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:05:55.781495 22684 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.781849 22684 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.782279 22625 tablet_bootstrap.cc:492] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
W20260709 13:05:55.784549 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49821.8us
I20260709 13:05:55.787012 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.787922 22429 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:55.788993 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.790724 22627 tablet_bootstrap.cc:492] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.791278 22627 ts_tablet_manager.cc:1403] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.007s
W20260709 13:05:55.791728 22545 leader_election.cc:343] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.792248 22545 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.793349 22781 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.793826 22781 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:55.793895 22472 leader_election.cc:343] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.795071 22627 raft_consensus.cc:359] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.796975 22627 raft_consensus.cc:385] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.797609 22627 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.793349 22782 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.796991 22781 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.802590 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.803527 22627 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.805289 22625 tablet_bootstrap.cc:654] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.804773 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.806478 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:55.806957 22627 ts_tablet_manager.cc:1434] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:05:55.807531 22722 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.807826 22627 tablet_bootstrap.cc:492] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.807919 22722 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.808358 22722 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.820262 22722 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:55.823870 22546 leader_election.cc:343] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.838387 22626 tablet_bootstrap.cc:654] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:55.837939 22545 leader_election.cc:343] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.841600 22545 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.842919 22782 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.842911 22627 tablet_bootstrap.cc:654] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.844947 22631 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.845329 22631 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.847023 22684 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.851848 22631 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.855841 22722 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.857689 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:55.861733 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.862602 22429 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.861176 22634 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.863176 22634 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.865342 22634 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.867364 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.867475 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:55.868053 22508 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:55.869071 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:55.868358 22582 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:05:55.870163 22625 tablet_bootstrap.cc:492] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:55.870903 22625 ts_tablet_manager.cc:1403] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.089s	user 0.006s	sys 0.021s
I20260709 13:05:55.874231 22580 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 1: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:05:55.870714 22781 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.874425 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:55.875013 22781 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.872402 22330 catalog_manager.cc:5697] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.878185 22782 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.869494 22396 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:55.883222 22684 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.885186 22782 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.878566 22577 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.890334 22658 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.890782 22658 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.891110 22658 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.892298 22625 raft_consensus.cc:359] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.893005 22625 raft_consensus.cc:385] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.893266 22625 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.893922 22625 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.895967 22625 ts_tablet_manager.cc:1434] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.002s
I20260709 13:05:55.897950 22625 tablet_bootstrap.cc:492] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:55.901170 22781 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.902343 22474 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:55.902298 22857 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.889248 22634 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.905262 22795 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.908669 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:55.909289 22508 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.912914 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.903585 22429 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:55.916177 22782 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:55.917696 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.917197 22795 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.918052 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:55.920369 22625 tablet_bootstrap.cc:654] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.907783 22634 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.925365 22626 tablet_bootstrap.cc:492] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:55.925364 22508 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
W20260709 13:05:55.925931 22545 leader_election.cc:343] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.927353 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:55.928637 22782 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.934811 22626 ts_tablet_manager.cc:1403] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.158s	user 0.010s	sys 0.008s
W20260709 13:05:55.937318 22546 leader_election.cc:343] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.945061 22432 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:55.937484 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.947306 22626 raft_consensus.cc:359] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.947981 22626 raft_consensus.cc:385] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.948251 22626 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.949218 22626 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.948504 22634 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.952942 22626 ts_tablet_manager.cc:1434] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:05:55.953735 22627 tablet_bootstrap.cc:492] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:55.954196 22627 ts_tablet_manager.cc:1403] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.147s	user 0.008s	sys 0.020s
I20260709 13:05:55.956171 22626 tablet_bootstrap.cc:492] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:55.950991 22658 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.959663 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:55.959968 22627 raft_consensus.cc:359] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.960453 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:55.960817 22627 raft_consensus.cc:385] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.951952 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:55.961180 22507 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:55.961158 22627 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.962286 22627 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.962585 22396 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:55.963451 22634 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.964030 22634 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.964442 22634 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.964751 22631 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.965227 22631 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:55.965725 22577 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:55.965955 22631 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:55.967487 22546 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:55.968663 22431 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 1: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:05:55.969978 22684 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.964388 22627 ts_tablet_manager.cc:1434] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:55.973201 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:55.975373 22581 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:55.975617 22627 tablet_bootstrap.cc:492] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:55.979056 22505 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:05:55.980337 22848 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.973755 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:55.983752 22658 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:55.996312 22625 tablet_bootstrap.cc:492] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:55.996877 22625 ts_tablet_manager.cc:1403] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.014s
I20260709 13:05:55.997257 22545 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:55.993494 22577 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:05:55.999188 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:56.017845 22399 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:56.024893 22658 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.011361 22684 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.066658 22781 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.078127 22781 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.078565 22781 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.080119 22634 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:56.115247 22379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:05:56.010703 22545 leader_election.cc:343] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:56.147612 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 145600us
I20260709 13:05:56.178325 22781 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.180892 22781 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:56.220007 22634 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:56.219169 22684 raft_consensus.cc:697] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:56.240233 22625 raft_consensus.cc:359] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.241415 22625 raft_consensus.cc:385] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.241730 22625 raft_consensus.cc:740] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.242367 22625 consensus_queue.cc:260] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.244900 22425 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.246083 22329 catalog_manager.cc:5697] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.241015 22869 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.250173 22869 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.254500 22625 ts_tablet_manager.cc:1434] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.257s	user 0.022s	sys 0.039s
I20260709 13:05:56.255985 22625 tablet_bootstrap.cc:492] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:56.258941 22627 tablet_bootstrap.cc:654] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:56.240139 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 58113.1us
I20260709 13:05:56.262413 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:56.264436 22684 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.264956 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:56.282051 22433 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 1: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:05:56.263329 22749 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:05:56.283142 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:56.283982 22582 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:05:56.285058 22507 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.290524 22631 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.294385 22795 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:56.309115 22869 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:56.338070 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:56.346812 22507 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:56.350720 22869 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.369453 22626 tablet_bootstrap.cc:654] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.363535 22658 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:05:56.376701 22658 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.378839 22625 tablet_bootstrap.cc:654] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.393669 22631 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:56.398866 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 88021.2us
I20260709 13:05:56.402097 22396 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:05:56.393266 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:56.418032 22872 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.413612 22749 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.428013 22330 catalog_manager.cc:5697] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.434204 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:56.439446 22627 tablet_bootstrap.cc:492] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:56.439440 22626 tablet_bootstrap.cc:492] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:56.439950 22627 ts_tablet_manager.cc:1403] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.465s	user 0.018s	sys 0.021s
I20260709 13:05:56.440274 22626 ts_tablet_manager.cc:1403] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.485s	user 0.027s	sys 0.039s
I20260709 13:05:56.438912 22684 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.446796 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:56.435815 22658 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:56.448711 22684 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.444084 22872 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.457317 22684 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.459231 22627 raft_consensus.cc:359] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.460309 22627 raft_consensus.cc:385] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.460609 22627 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.442828 22749 raft_consensus.cc:697] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:56.467710 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:56.468425 22580 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
W20260709 13:05:56.459818 22545 leader_election.cc:343] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.460220 22872 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:56.472987 22749 consensus_queue.cc:237] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.460007 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:56.487979 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:56.490159 22626 raft_consensus.cc:359] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.490859 22626 raft_consensus.cc:385] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.491149 22626 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.496829 22626 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.497722 22627 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.498471 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:56.508311 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:56.509238 22684 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:56.495240 22658 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.509711 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:56.512821 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:56.511073 22658 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.511430 22396 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:56.519135 22872 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:56.522415 22396 leader_election.cc:343] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.518317 22658 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.523854 22626 ts_tablet_manager.cc:1434] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.083s	user 0.004s	sys 0.003s
I20260709 13:05:56.524745 22626 tablet_bootstrap.cc:492] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
W20260709 13:05:56.531483 22545 leader_election.cc:343] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.543191 22658 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.546531 22626 tablet_bootstrap.cc:654] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:56.570572 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 79145.6us
I20260709 13:05:56.573755 22330 catalog_manager.cc:5697] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.584667 22625 tablet_bootstrap.cc:492] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:56.585306 22625 ts_tablet_manager.cc:1403] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.330s	user 0.009s	sys 0.027s
I20260709 13:05:56.586009 22658 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:05:56.588006 22546 leader_election.cc:343] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.588382 22546 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:05:56.589670 22546 leader_election.cc:343] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.590009 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:56.603332 22627 ts_tablet_manager.cc:1434] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.163s	user 0.011s	sys 0.006s
I20260709 13:05:56.604420 22627 tablet_bootstrap.cc:492] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:56.599819 22625 raft_consensus.cc:359] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.605309 22625 raft_consensus.cc:385] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.605597 22625 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.604187 22782 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.607148 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:56.607787 22625 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.608412 22722 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.605923 22684 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:56.609915 22396 leader_election.cc:343] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.611126 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:56.611739 22582 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.631210 22627 tablet_bootstrap.cc:654] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.632668 22625 ts_tablet_manager.cc:1434] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:05:56.633579 22625 tablet_bootstrap.cc:492] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:56.645882 22626 tablet_bootstrap.cc:492] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:56.646950 22626 ts_tablet_manager.cc:1403] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.030s
I20260709 13:05:56.647847 22625 tablet_bootstrap.cc:654] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.649868 22626 raft_consensus.cc:359] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.650645 22626 raft_consensus.cc:385] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.650998 22626 raft_consensus.cc:740] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.646852 22582 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:56.651772 22626 consensus_queue.cc:260] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.653715 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:56.656433 22749 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.656999 22749 raft_consensus.cc:697] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:56.657761 22749 consensus_queue.cc:237] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.662881 22627 tablet_bootstrap.cc:492] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:56.663343 22627 ts_tablet_manager.cc:1403] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.006s
I20260709 13:05:56.664001 22626 ts_tablet_manager.cc:1434] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:05:56.664880 22626 tablet_bootstrap.cc:492] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:56.666990 22627 raft_consensus.cc:359] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.669463 22627 raft_consensus.cc:385] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.669756 22627 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.670431 22627 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.680552 22627 ts_tablet_manager.cc:1434] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:05:56.681650 22627 tablet_bootstrap.cc:492] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:56.709103 22330 catalog_manager.cc:5697] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.711958 22626 tablet_bootstrap.cc:654] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.721625 22889 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.733659 22627 tablet_bootstrap.cc:654] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.738888 22625 tablet_bootstrap.cc:492] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:56.739360 22626 tablet_bootstrap.cc:492] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:56.739403 22625 ts_tablet_manager.cc:1403] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.018s
I20260709 13:05:56.739845 22626 ts_tablet_manager.cc:1403] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.011s
I20260709 13:05:56.742626 22626 raft_consensus.cc:359] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.784489 22626 raft_consensus.cc:385] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.784956 22626 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.786170 22626 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.791105 22626 ts_tablet_manager.cc:1434] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
I20260709 13:05:56.796022 22888 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.799005 22782 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.800086 22782 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.801864 22626 tablet_bootstrap.cc:492] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:56.804574 22782 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:56.805212 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:56.807085 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:56.808314 22545 leader_election.cc:343] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:56.809633 22546 leader_election.cc:343] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.812112 22627 tablet_bootstrap.cc:492] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:56.813115 22627 ts_tablet_manager.cc:1403] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.132s	user 0.011s	sys 0.002s
I20260709 13:05:56.742645 22625 raft_consensus.cc:359] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.815064 22625 raft_consensus.cc:385] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.815390 22625 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.816339 22546 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:56.816278 22625 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.818135 22782 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.826216 22631 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.826967 22631 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.829577 22631 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:56.832197 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:56.839413 22626 tablet_bootstrap.cc:654] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.841631 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:56.842983 22576 raft_consensus.cc:2393] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 1: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:05:56.850373 22474 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:56.857776 22873 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.858556 22873 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.862085 22795 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.865429 22625 ts_tablet_manager.cc:1434] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.001s
I20260709 13:05:56.863960 22627 raft_consensus.cc:359] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.871018 22627 raft_consensus.cc:385] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.872803 22627 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.873538 22627 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.876494 22627 ts_tablet_manager.cc:1434] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.063s	user 0.001s	sys 0.005s
I20260709 13:05:56.872529 22625 tablet_bootstrap.cc:492] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:56.889218 22627 tablet_bootstrap.cc:492] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:56.897883 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:56.899338 22873 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:56.903234 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:56.904152 22576 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:56.906083 22889 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.906577 22889 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.907639 22795 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.909649 22889 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:56.910602 22857 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.910969 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:56.911284 22857 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.911711 22505 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:56.913370 22545 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:56.914251 22782 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.914734 22782 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.915169 22782 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:56.909523 22396 leader_election.cc:343] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.916720 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:56.919101 22749 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.919519 22749 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.919890 22749 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.922204 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:56.923794 22782 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:56.926388 22472 leader_election.cc:343] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.926538 22782 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:56.927716 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:56.928625 22424 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:56.919023 22857 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:56.933982 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:56.932293 22781 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.935004 22781 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.934082 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:56.935849 22505 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.938079 22576 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:56.938140 22781 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:56.939224 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:56.939451 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:56.940006 22430 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.941457 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:56.948997 22631 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.949676 22631 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.950280 22631 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:56.940888 22545 leader_election.cc:343] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.944329 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:56.961424 22546 leader_election.cc:343] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.966109 22546 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:56.969000 22782 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.975876 22626 tablet_bootstrap.cc:492] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:56.976408 22626 ts_tablet_manager.cc:1403] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.175s	user 0.026s	sys 0.021s
I20260709 13:05:56.978755 22631 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.979950 22625 tablet_bootstrap.cc:654] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.982268 22631 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:56.983543 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:56.983721 22749 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.984180 22582 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.984835 22626 raft_consensus.cc:359] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.985507 22626 raft_consensus.cc:385] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.985764 22626 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.985826 22505 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:56.987486 22627 tablet_bootstrap.cc:654] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.987792 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:56.988581 22626 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:56.990119 22430 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:56.991210 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:56.991823 22577 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.994707 22545 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:56.990283 22626 ts_tablet_manager.cc:1434] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:05:56.995609 22889 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.996356 22889 raft_consensus.cc:697] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:56.990662 22506 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.996694 22626 tablet_bootstrap.cc:492] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:57.004293 22749 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.004768 22577 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:57.005468 22889 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.018380 22506 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:57.012108 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:57.018385 22582 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:57.028064 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:57.028975 22631 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.029532 22631 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:05:57.034968 22472 leader_election.cc:343] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.035142 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:57.036257 22749 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.036844 22749 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:57.038537 22749 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.041118 22631 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.061630 22627 tablet_bootstrap.cc:492] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:57.062137 22627 ts_tablet_manager.cc:1403] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.177s	user 0.010s	sys 0.035s
I20260709 13:05:57.063344 22658 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.064800 22625 tablet_bootstrap.cc:492] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:57.065253 22625 ts_tablet_manager.cc:1403] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.193s	user 0.004s	sys 0.018s
I20260709 13:05:57.068572 22625 raft_consensus.cc:359] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.069305 22625 raft_consensus.cc:385] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.069589 22625 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.070773 22625 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.073087 22625 ts_tablet_manager.cc:1434] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:57.073621 22658 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.074158 22625 tablet_bootstrap.cc:492] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:57.083940 22626 tablet_bootstrap.cc:654] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.084585 22627 raft_consensus.cc:359] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.087073 22627 raft_consensus.cc:385] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.087817 22627 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.091578 22627 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.094129 22328 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.096390 22331 catalog_manager.cc:5697] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:57.105697 22330 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.113722 22658 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.115343 22627 ts_tablet_manager.cc:1434] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.004s
I20260709 13:05:57.116453 22627 tablet_bootstrap.cc:492] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:57.133004 22625 tablet_bootstrap.cc:654] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.138736 22626 tablet_bootstrap.cc:492] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:57.141628 22626 ts_tablet_manager.cc:1403] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.003s
I20260709 13:05:57.144938 22626 raft_consensus.cc:359] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.145709 22626 raft_consensus.cc:385] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.145960 22626 raft_consensus.cc:740] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.156961 22627 tablet_bootstrap.cc:654] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.168183 22626 consensus_queue.cc:260] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.206364 22626 ts_tablet_manager.cc:1434] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:05:57.207835 22626 tablet_bootstrap.cc:492] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:57.218472 22658 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.225589 22649 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.226107 22649 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.228024 22649 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.230194 22625 tablet_bootstrap.cc:492] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:57.230703 22625 ts_tablet_manager.cc:1403] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.157s	user 0.034s	sys 0.000s
I20260709 13:05:57.231267 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:57.235885 22472 leader_election.cc:343] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.245488 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:57.250967 22577 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:57.255383 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:57.256233 22649 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.256675 22649 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.256134 22625 raft_consensus.cc:359] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.257006 22649 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.257081 22625 raft_consensus.cc:385] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.257423 22625 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.258093 22625 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.259634 22625 ts_tablet_manager.cc:1434] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:05:57.262985 22873 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.263490 22873 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.265492 22873 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.266714 22649 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.267647 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:57.269169 22396 leader_election.cc:343] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.272197 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:57.272979 22576 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:57.273679 22625 tablet_bootstrap.cc:492] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:57.276696 22626 tablet_bootstrap.cc:654] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.278978 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:57.280550 22911 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.280946 22911 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.281267 22911 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.290097 22627 tablet_bootstrap.cc:492] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:57.290714 22627 ts_tablet_manager.cc:1403] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.175s	user 0.017s	sys 0.008s
I20260709 13:05:57.298687 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:57.299353 22576 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.298456 22627 raft_consensus.cc:359] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.304445 22625 tablet_bootstrap.cc:654] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.306892 22911 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.322535 22626 tablet_bootstrap.cc:492] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:57.323108 22626 ts_tablet_manager.cc:1403] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.116s	user 0.006s	sys 0.006s
I20260709 13:05:57.323786 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:05:57.325181 22396 leader_election.cc:343] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.305311 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:57.298748 22649 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.330330 22911 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.311360 22576 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:57.326140 22626 raft_consensus.cc:359] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.331459 22626 raft_consensus.cc:385] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.331773 22626 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.331802 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:57.332432 22626 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.334018 22626 ts_tablet_manager.cc:1434] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.002s
I20260709 13:05:57.334987 22626 tablet_bootstrap.cc:492] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
W20260709 13:05:57.327493 22472 leader_election.cc:343] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:57.337180 22379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:57.332443 22577 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.339293 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:57.340688 22795 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.341192 22795 raft_consensus.cc:697] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:57.307528 22627 raft_consensus.cc:385] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.341497 22631 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.341681 22627 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.341967 22631 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.342098 22795 consensus_queue.cc:237] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.342497 22627 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.344003 22631 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.346280 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:57.346956 22582 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:57.348945 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:57.350488 22472 leader_election.cc:343] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.351341 22626 tablet_bootstrap.cc:654] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.352264 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:57.353356 22627 ts_tablet_manager.cc:1434] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.002s
I20260709 13:05:57.355772 22627 tablet_bootstrap.cc:492] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:57.356158 22577 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:57.356649 22649 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.357029 22649 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.357336 22649 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.357697 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:57.358489 22911 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.358996 22911 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:57.360595 22911 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.364219 22869 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.364820 22869 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.368589 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:57.371155 22545 leader_election.cc:343] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.372720 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:57.375149 22546 leader_election.cc:343] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.375644 22546 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:57.376451 22889 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.380555 22869 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:57.381707 22626 tablet_bootstrap.cc:492] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:57.382164 22626 ts_tablet_manager.cc:1403] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.012s
I20260709 13:05:57.373100 22649 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.384719 22626 raft_consensus.cc:359] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.385380 22626 raft_consensus.cc:385] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.385632 22626 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.386291 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:57.386256 22626 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:57.387689 22472 leader_election.cc:343] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.388398 22626 ts_tablet_manager.cc:1434] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:57.389185 22625 tablet_bootstrap.cc:492] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:57.390271 22625 ts_tablet_manager.cc:1403] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.130s	user 0.008s	sys 0.011s
I20260709 13:05:57.396284 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:57.396991 22577 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.401515 22649 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.391549 22328 catalog_manager.cc:5697] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.389424 22626 tablet_bootstrap.cc:492] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:57.404536 22627 tablet_bootstrap.cc:654] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.407135 22577 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:57.406262 22331 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.408216 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:57.408897 22649 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.409262 22649 raft_consensus.cc:697] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:57.409904 22649 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.409771 22625 raft_consensus.cc:359] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.417932 22625 raft_consensus.cc:385] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.418314 22625 raft_consensus.cc:740] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.419065 22625 consensus_queue.cc:260] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.420133 22626 tablet_bootstrap.cc:654] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.421600 22625 ts_tablet_manager.cc:1434] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:05:57.426348 22627 tablet_bootstrap.cc:492] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:57.426856 22627 ts_tablet_manager.cc:1403] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.000s
I20260709 13:05:57.427970 22625 tablet_bootstrap.cc:492] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:57.429821 22627 raft_consensus.cc:359] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.430893 22627 raft_consensus.cc:385] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.431175 22627 raft_consensus.cc:740] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.432257 22869 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.431867 22627 consensus_queue.cc:260] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.433673 22869 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.438989 22625 tablet_bootstrap.cc:654] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.442175 22869 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:57.442845 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:57.443383 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:57.443696 22430 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
W20260709 13:05:57.445601 22545 leader_election.cc:343] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.447484 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:57.449602 22869 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.453958 22869 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.454360 22869 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.454001 22328 catalog_manager.cc:5697] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.460630 22626 tablet_bootstrap.cc:492] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:57.461118 22626 ts_tablet_manager.cc:1403] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.003s
I20260709 13:05:57.463048 22869 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.463752 22626 raft_consensus.cc:359] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.464423 22626 raft_consensus.cc:385] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.464747 22626 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.465498 22626 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.469014 22626 ts_tablet_manager.cc:1434] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:57.469422 22627 ts_tablet_manager.cc:1434] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:05:57.476677 22627 tablet_bootstrap.cc:492] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:57.484365 22869 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:57.481120 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:57.486150 22626 tablet_bootstrap.cc:492] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:57.488533 22625 tablet_bootstrap.cc:492] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:57.488821 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:57.489113 22625 ts_tablet_manager.cc:1403] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.002s
I20260709 13:05:57.485486 22429 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.493095 22627 tablet_bootstrap.cc:654] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:57.492091 22545 leader_election.cc:343] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.494527 22625 raft_consensus.cc:359] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.495062 22625 raft_consensus.cc:385] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.495260 22625 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.499706 22625 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.501405 22626 tablet_bootstrap.cc:654] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.501840 22625 ts_tablet_manager.cc:1434] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:05:57.516636 22869 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.522984 22625 tablet_bootstrap.cc:492] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:57.531176 22429 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:57.535104 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:57.536193 22869 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.536702 22869 raft_consensus.cc:697] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:57.534472 22911 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.537189 22911 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.537523 22869 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.539780 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:57.540838 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:57.541558 22582 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:57.539794 22911 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.543602 22399 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:57.544196 22627 tablet_bootstrap.cc:492] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:57.544595 22911 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.544699 22627 ts_tablet_manager.cc:1403] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.007s
I20260709 13:05:57.545934 22781 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.570518 22627 raft_consensus.cc:359] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.571309 22627 raft_consensus.cc:385] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.571700 22627 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.575326 22626 tablet_bootstrap.cc:492] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:57.575837 22626 ts_tablet_manager.cc:1403] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.094s	user 0.005s	sys 0.017s
I20260709 13:05:57.580869 22626 raft_consensus.cc:359] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.581589 22626 raft_consensus.cc:385] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.581904 22626 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.582602 22626 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.581712 22328 catalog_manager.cc:5697] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:57.585589 22889 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.586452 22625 tablet_bootstrap.cc:654] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.586102 22889 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.589423 22626 ts_tablet_manager.cc:1434] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:05:57.591516 22626 tablet_bootstrap.cc:492] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:57.591264 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:57.593482 22546 leader_election.cc:343] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.596760 22848 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.598277 22889 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:57.600232 22795 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.602065 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:57.602721 22505 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:57.588503 22627 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.605712 22545 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:05:57.619025 22472 consensus_peers.cc:597] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:57.619958 22873 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.622944 22889 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.623345 22889 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.623674 22889 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.621203 22911 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.639802 22627 ts_tablet_manager.cc:1434] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.002s
I20260709 13:05:57.649289 22889 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.650348 22625 tablet_bootstrap.cc:492] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:57.651947 22626 tablet_bootstrap.cc:654] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.652606 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:57.652833 22627 tablet_bootstrap.cc:492] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:57.655683 22782 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.675062 22782 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.656562 22911 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.660586 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:57.676748 22506 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.677380 22782 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:57.680156 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:57.676386 22911 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:57.682232 22546 leader_election.cc:343] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.682557 22911 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:05:57.682924 22546 leader_election.cc:343] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.684090 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:57.684895 22576 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:57.663812 22889 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:57.664716 22722 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.700102 22625 ts_tablet_manager.cc:1403] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.188s	user 0.025s	sys 0.020s
I20260709 13:05:57.699774 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:57.700620 22722 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.690006 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:57.708046 22545 leader_election.cc:343] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.708524 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:57.710536 22782 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.712141 22722 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.715090 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:57.717576 22577 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:57.718982 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:57.720306 22474 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:57.721127 22631 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.721457 22631 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.721751 22631 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.719691 22627 tablet_bootstrap.cc:654] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:57.728161 22472 leader_election.cc:343] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.727849 22396 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:57.733269 22506 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:57.734210 22631 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.736438 22722 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:57.742627 22625 raft_consensus.cc:359] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.744339 22625 raft_consensus.cc:385] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.735545 22848 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.744690 22625 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.745491 22625 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.747581 22625 ts_tablet_manager.cc:1434] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:05:57.749356 22545 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:57.749610 22631 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.750466 22782 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.750982 22782 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:57.751500 22625 tablet_bootstrap.cc:492] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:57.751812 22782 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.755230 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:57.755806 22582 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.761883 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:05:57.763754 22472 leader_election.cc:343] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.766887 22582 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:57.768350 22474 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:57.770974 22649 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.771426 22649 raft_consensus.cc:697] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:57.772145 22649 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.780932 22626 tablet_bootstrap.cc:492] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:57.781385 22626 ts_tablet_manager.cc:1403] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.190s	user 0.012s	sys 0.009s
I20260709 13:05:57.783272 22848 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.784345 22626 raft_consensus.cc:359] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.785094 22626 raft_consensus.cc:385] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.785527 22626 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.789703 22795 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.798032 22627 tablet_bootstrap.cc:492] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:57.798651 22627 ts_tablet_manager.cc:1403] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.146s	user 0.016s	sys 0.007s
I20260709 13:05:57.800808 22626 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.804006 22627 raft_consensus.cc:359] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.804942 22627 raft_consensus.cc:385] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.805223 22627 raft_consensus.cc:740] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.805864 22627 consensus_queue.cc:260] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.810842 22627 ts_tablet_manager.cc:1434] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:05:57.812153 22627 tablet_bootstrap.cc:492] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:57.810843 22626 ts_tablet_manager.cc:1434] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 13:05:57.818933 22626 tablet_bootstrap.cc:492] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:57.824872 22626 tablet_bootstrap.cc:654] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.831442 22627 tablet_bootstrap.cc:654] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.833956 22625 tablet_bootstrap.cc:654] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.836864 22330 catalog_manager.cc:5697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:57.841015 22911 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.843027 22911 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.845151 22911 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.847973 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:57.850471 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:57.852669 22399 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:57.853523 22627 tablet_bootstrap.cc:492] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:57.853946 22627 ts_tablet_manager.cc:1403] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.042s	user 0.005s	sys 0.005s
I20260709 13:05:57.853844 22911 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.856879 22627 raft_consensus.cc:359] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.858199 22627 raft_consensus.cc:385] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.858481 22627 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.859159 22627 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.861231 22627 ts_tablet_manager.cc:1434] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:57.862164 22627 tablet_bootstrap.cc:492] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:57.868045 22627 tablet_bootstrap.cc:654] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.868463 22649 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.868988 22649 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.870836 22649 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.871845 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:57.872489 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:57.873205 22582 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 1: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:05:57.875435 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:57.876549 22649 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.883317 22626 tablet_bootstrap.cc:492] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:57.883751 22626 ts_tablet_manager.cc:1403] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.009s
I20260709 13:05:57.884042 22331 catalog_manager.cc:5697] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.886368 22626 raft_consensus.cc:359] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.887162 22626 raft_consensus.cc:385] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.887437 22626 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.893237 22626 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.894033 22889 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.894556 22889 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.895406 22626 ts_tablet_manager.cc:1434] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:05:57.896344 22626 tablet_bootstrap.cc:492] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:57.896689 22889 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:57.897851 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:57.898518 22506 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:57.900261 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:57.900765 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:05:57.901721 22546 leader_election.cc:343] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.902108 22626 tablet_bootstrap.cc:654] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.903620 22889 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.904052 22889 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.904378 22889 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.913036 22782 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.913558 22782 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.914049 22626 tablet_bootstrap.cc:492] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:57.914603 22626 ts_tablet_manager.cc:1403] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:05:57.915141 22722 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.918494 22782 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:57.919482 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:57.920657 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:57.921775 22546 leader_election.cc:343] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.922809 22631 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:57.929489 22545 leader_election.cc:343] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.930697 22545 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:57.931493 22782 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.934199 22649 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.935770 22626 raft_consensus.cc:359] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.936240 22911 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:57.934051 22545 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:57.937816 22889 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.938725 22625 tablet_bootstrap.cc:492] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:57.939196 22625 ts_tablet_manager.cc:1403] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.188s	user 0.014s	sys 0.003s
I20260709 13:05:57.939870 22889 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:57.940668 22626 raft_consensus.cc:385] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.940964 22626 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.941699 22626 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.942196 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:57.942817 22506 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.944083 22626 ts_tablet_manager.cc:1434] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 13:05:57.944368 22911 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.944303 22625 raft_consensus.cc:359] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.946617 22625 raft_consensus.cc:385] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.946882 22625 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.947502 22625 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.949594 22625 ts_tablet_manager.cc:1434] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:57.950630 22625 tablet_bootstrap.cc:492] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:57.956665 22625 tablet_bootstrap.cc:654] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.957603 22626 tablet_bootstrap.cc:492] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:57.963716 22506 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:57.964388 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:57.975308 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:57.976054 22626 tablet_bootstrap.cc:654] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.977696 22649 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.978838 22649 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:57.982173 22649 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:57.983449 22627 tablet_bootstrap.cc:492] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:57.984344 22627 ts_tablet_manager.cc:1403] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.122s	user 0.021s	sys 0.032s
I20260709 13:05:57.988190 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:57.994760 22472 leader_election.cc:343] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.007266 22625 tablet_bootstrap.cc:492] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:58.007970 22625 ts_tablet_manager.cc:1403] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.003s
I20260709 13:05:58.011878 22625 raft_consensus.cc:359] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.012591 22625 raft_consensus.cc:385] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.012857 22625 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.013357 22915 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.013420 22625 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.013903 22915 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.016177 22915 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.016588 22889 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.024798 22889 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:58.025816 22889 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.018010 22627 raft_consensus.cc:359] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.027294 22627 raft_consensus.cc:385] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.027629 22627 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.026970 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:05:58.018980 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 43822.8us
I20260709 13:05:58.026054 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:58.044443 22506 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:05:58.045859 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:58.047132 22915 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.063691 22915 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.064684 22627 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.017786 22625 ts_tablet_manager.cc:1434] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:58.072249 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:58.080062 22582 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:58.080642 22625 tablet_bootstrap.cc:492] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:58.083904 22627 ts_tablet_manager.cc:1434] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.008s
I20260709 13:05:58.085039 22627 tablet_bootstrap.cc:492] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
W20260709 13:05:58.087543 22546 leader_election.cc:343] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.090101 22626 tablet_bootstrap.cc:492] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:58.090703 22626 ts_tablet_manager.cc:1403] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.133s	user 0.041s	sys 0.036s
I20260709 13:05:58.096688 22625 tablet_bootstrap.cc:654] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.096546 22626 raft_consensus.cc:359] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.097420 22626 raft_consensus.cc:385] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.097785 22626 raft_consensus.cc:740] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.104151 22626 consensus_queue.cc:260] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.104557 22474 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:58.105881 22631 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.106283 22631 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.106633 22631 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.112600 22782 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.115495 22627 tablet_bootstrap.cc:654] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.121423 22631 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.125174 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:58.125785 22433 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.124598 22328 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.140246 22433 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:58.141360 22626 ts_tablet_manager.cc:1434] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:05:58.141307 22472 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:58.142284 22722 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.142707 22626 tablet_bootstrap.cc:492] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:58.142761 22722 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:58.144274 22722 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.152972 22627 tablet_bootstrap.cc:492] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:58.153528 22627 ts_tablet_manager.cc:1403] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.002s
I20260709 13:05:58.159116 22631 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.158957 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:58.159678 22579 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.159765 22627 raft_consensus.cc:359] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.162428 22626 tablet_bootstrap.cc:654] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.165951 22579 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:58.189553 22429 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.204633 22889 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.205252 22889 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.208612 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:58.210230 22546 leader_election.cc:343] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.166901 22627 raft_consensus.cc:385] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.189405 22626 tablet_bootstrap.cc:492] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:58.174717 22625 tablet_bootstrap.cc:492] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:58.214577 22625 ts_tablet_manager.cc:1403] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.134s	user 0.008s	sys 0.017s
I20260709 13:05:58.217801 22625 raft_consensus.cc:359] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.219053 22625 raft_consensus.cc:385] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.219403 22625 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.213846 22627 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.218743 22626 ts_tablet_manager.cc:1403] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.002s
I20260709 13:05:58.220809 22649 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.221287 22649 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.223162 22649 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.223704 22625 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.232438 22889 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:58.221410 22627 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.229890 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:58.233314 22582 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:58.234681 22627 ts_tablet_manager.cc:1434] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.002s
I20260709 13:05:58.234539 22474 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:58.230504 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.235378 22626 raft_consensus.cc:359] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.238858 22626 raft_consensus.cc:385] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.237936 22649 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.237233 22625 ts_tablet_manager.cc:1434] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:05:58.240366 22649 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.240797 22649 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.241436 22625 tablet_bootstrap.cc:492] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:58.247406 22649 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.240341 22626 raft_consensus.cc:740] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.248752 22626 consensus_queue.cc:260] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.250711 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:58.251339 22582 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.257226 22795 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.247844 22625 tablet_bootstrap.cc:654] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.257794 22795 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:58.258473 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 90220.4us
I20260709 13:05:58.260425 22582 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:58.260792 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:58.261566 22474 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:58.262015 22795 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.261590 22782 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.262562 22795 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.263206 22795 raft_consensus.cc:697] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:58.263062 22782 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.264037 22958 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.265175 22782 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:58.265823 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.266299 22649 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.239996 22627 tablet_bootstrap.cc:492] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
W20260709 13:05:58.267232 22546 leader_election.cc:343] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.265170 22626 ts_tablet_manager.cc:1434] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:05:58.264158 22795 consensus_queue.cc:237] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.269147 22626 tablet_bootstrap.cc:492] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:58.265691 22330 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.279173 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:58.282994 22626 tablet_bootstrap.cc:654] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.283588 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.285276 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:58.290293 22627 tablet_bootstrap.cc:654] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.294543 22649 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.297242 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:58.311776 22625 tablet_bootstrap.cc:492] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:58.312321 22625 ts_tablet_manager.cc:1403] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.006s
W20260709 13:05:58.311817 22472 leader_election.cc:343] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:58.315102 22472 leader_election.cc:343] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.316526 22472 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:58.320371 22649 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.324266 22429 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:58.325996 22545 leader_election.cc:343] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.333040 22545 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:58.334216 22958 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:58.335031 22545 leader_election.cc:343] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.335580 22545 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:58.343132 22625 raft_consensus.cc:359] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.343880 22625 raft_consensus.cc:385] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.345824 22625 raft_consensus.cc:740] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.346433 22625 consensus_queue.cc:260] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.344780 22782 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:58.348165 22627 tablet_bootstrap.cc:492] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:58.344758 22889 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.348681 22627 ts_tablet_manager.cc:1403] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.007s
I20260709 13:05:58.350956 22631 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.346061 22330 catalog_manager.cc:5697] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.387318 22625 ts_tablet_manager.cc:1434] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.001s
I20260709 13:05:58.391471 22627 raft_consensus.cc:359] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.397394 22627 raft_consensus.cc:385] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.399201 22626 tablet_bootstrap.cc:492] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:58.399665 22626 ts_tablet_manager.cc:1403] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.131s	user 0.023s	sys 0.006s
I20260709 13:05:58.397889 22627 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.409554 22627 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.419837 22625 tablet_bootstrap.cc:492] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:58.433048 22627 ts_tablet_manager.cc:1434] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 13:05:58.434305 22626 raft_consensus.cc:359] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.435074 22626 raft_consensus.cc:385] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.435348 22626 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.436043 22626 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.447494 22627 tablet_bootstrap.cc:492] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:58.453676 22626 ts_tablet_manager.cc:1434] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:05:58.457264 22626 tablet_bootstrap.cc:492] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
W20260709 13:05:58.462963 22379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:58.473109 22625 tablet_bootstrap.cc:654] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.477216 22627 tablet_bootstrap.cc:654] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.480722 22626 tablet_bootstrap.cc:654] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.485873 22625 tablet_bootstrap.cc:492] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:58.486385 22625 ts_tablet_manager.cc:1403] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.078s	user 0.005s	sys 0.005s
I20260709 13:05:58.486354 22626 tablet_bootstrap.cc:492] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:58.486577 22627 tablet_bootstrap.cc:492] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:58.487298 22626 ts_tablet_manager.cc:1403] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.005s
I20260709 13:05:58.487311 22627 ts_tablet_manager.cc:1403] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:05:58.489607 22625 raft_consensus.cc:359] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.490119 22627 raft_consensus.cc:359] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.490383 22625 raft_consensus.cc:385] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.490814 22627 raft_consensus.cc:385] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.490866 22625 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.490408 22626 raft_consensus.cc:359] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.491273 22627 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.491495 22626 raft_consensus.cc:385] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.491986 22626 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.491858 22625 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.492010 22627 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.493022 22626 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.496097 22625 ts_tablet_manager.cc:1434] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:58.497954 22627 ts_tablet_manager.cc:1434] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:58.498989 22627 tablet_bootstrap.cc:492] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:58.505159 22627 tablet_bootstrap.cc:654] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.508190 22626 ts_tablet_manager.cc:1434] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:58.509464 22626 tablet_bootstrap.cc:492] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:58.517870 22626 tablet_bootstrap.cc:654] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.505116 22625 tablet_bootstrap.cc:492] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:58.527410 22625 tablet_bootstrap.cc:654] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.528049 22627 tablet_bootstrap.cc:492] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:58.528045 22505 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.528671 22627 ts_tablet_manager.cc:1403] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.006s
I20260709 13:05:58.531428 22627 raft_consensus.cc:359] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.532068 22627 raft_consensus.cc:385] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.532308 22627 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.532934 22627 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.539851 22722 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.540414 22722 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.542454 22722 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.543151 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.543615 22627 ts_tablet_manager.cc:1434] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:58.544214 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:58.544791 22582 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:58.544656 22627 tablet_bootstrap.cc:492] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:58.547259 22795 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.547672 22472 leader_election.cc:343] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.547801 22795 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.548914 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:58.549872 22795 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.550431 22722 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.550809 22722 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.551074 22627 tablet_bootstrap.cc:654] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.551857 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:58.552428 22582 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:58.553658 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:58.554330 22631 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.554695 22631 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.554996 22631 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.555114 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.551143 22722 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:58.561524 22472 leader_election.cc:343] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.561648 22631 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.564239 22631 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.564436 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:58.565076 22579 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.566406 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:05:58.567919 22472 leader_election.cc:343] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.571270 22579 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:58.572283 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:58.573329 22795 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.573812 22795 raft_consensus.cc:697] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:58.574633 22795 consensus_queue.cc:237] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.575045 22722 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.573343 22960 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:58.578645 22625 tablet_bootstrap.cc:492] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:58.579150 22625 ts_tablet_manager.cc:1403] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.074s	user 0.006s	sys 0.004s
I20260709 13:05:58.579989 22626 tablet_bootstrap.cc:492] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:58.580641 22626 ts_tablet_manager.cc:1403] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.006s
I20260709 13:05:58.584838 22626 raft_consensus.cc:359] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.585554 22626 raft_consensus.cc:385] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.585812 22626 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.586504 22626 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.590840 22722 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.591581 22626 ts_tablet_manager.cc:1434] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:58.592890 22626 tablet_bootstrap.cc:492] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:58.594503 22627 tablet_bootstrap.cc:492] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:58.594978 22627 ts_tablet_manager.cc:1403] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.008s
I20260709 13:05:58.596386 22625 raft_consensus.cc:359] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.596784 22328 catalog_manager.cc:5697] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.598583 22626 tablet_bootstrap.cc:654] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.600304 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:58.606097 22957 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.606622 22957 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.607800 22625 raft_consensus.cc:385] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.608150 22625 raft_consensus.cc:740] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.608850 22625 consensus_queue.cc:260] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.611052 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.611632 22625 ts_tablet_manager.cc:1434] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
W20260709 13:05:58.612422 22546 leader_election.cc:343] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.612835 22625 tablet_bootstrap.cc:492] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:58.613749 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:58.614208 22472 leader_election.cc:343] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.601137 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:58.614912 22579 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:58.615491 22545 leader_election.cc:343] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.602906 22969 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.616009 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:58.617273 22969 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.623844 22579 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:58.625010 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:58.598908 22627 raft_consensus.cc:359] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.608811 22957 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:58.626534 22631 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.627139 22631 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:58.626567 22627 raft_consensus.cc:385] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.627720 22627 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.628000 22631 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.628557 22627 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.631910 22627 ts_tablet_manager.cc:1434] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:05:58.639569 22915 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.640126 22915 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.649904 22915 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.651937 22627 tablet_bootstrap.cc:492] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:58.654253 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:58.655088 22579 raft_consensus.cc:2393] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:58.659680 22795 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.660113 22627 tablet_bootstrap.cc:654] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.660241 22795 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.660508 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:58.661957 22626 tablet_bootstrap.cc:492] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:58.662540 22626 ts_tablet_manager.cc:1403] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.041s
I20260709 13:05:58.665539 22396 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:58.666291 22915 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.666502 22626 raft_consensus.cc:359] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.667451 22626 raft_consensus.cc:385] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.667606 22782 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.667847 22626 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.668139 22782 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.668936 22626 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.670271 22782 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:58.671299 22626 ts_tablet_manager.cc:1434] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:58.672569 22626 tablet_bootstrap.cc:492] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:58.672384 22960 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.674853 22915 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.676846 22782 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.678735 22546 consensus_peers.cc:597] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.677372 22782 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.679476 22626 tablet_bootstrap.cc:654] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.682686 22722 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.688387 22782 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:58.690748 22782 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.691212 22782 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.692456 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.692459 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:58.693183 22576 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:58.693997 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.694144 22782 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:58.695704 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.696058 22627 tablet_bootstrap.cc:492] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:58.698057 22627 ts_tablet_manager.cc:1403] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.009s
I20260709 13:05:58.700691 22915 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.701289 22915 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.702261 22474 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:58.703055 22960 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.703418 22960 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.703771 22960 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.703665 22627 raft_consensus.cc:359] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.704584 22627 raft_consensus.cc:385] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.704921 22627 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.705677 22627 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.706880 22795 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.711196 22915 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.712037 22627 ts_tablet_manager.cc:1434] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:05:58.713408 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:58.714211 22576 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
I20260709 13:05:58.715632 22399 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:58.716611 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:58.717221 22506 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 0.
W20260709 13:05:58.710580 22546 leader_election.cc:343] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:58.718236 22546 leader_election.cc:343] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.718586 22848 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:58.719010 22546 leader_election.cc:343] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.719060 22848 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.719472 22848 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.713425 22627 tablet_bootstrap.cc:492] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:58.724769 22960 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.730432 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:58.731063 22576 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.727173 22848 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.736218 22848 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.744778 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:58.750553 22627 tablet_bootstrap.cc:654] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.758180 22576 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:58.767505 22506 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.774374 22960 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:05:58.779371 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46431us
I20260709 13:05:58.773618 22915 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.792212 22474 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:58.793519 22722 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.794085 22722 raft_consensus.cc:697] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:58.794943 22722 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.798466 22631 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.799105 22631 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.799364 22915 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.802661 22506 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:05:58.803966 22396 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:58.804788 22625 tablet_bootstrap.cc:654] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.805580 22631 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.805045 22915 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.822029 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.825583 22915 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.825600 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:58.827257 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:58.826221 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:58.838079 22580 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.838768 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:58.850227 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:58.855340 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:58.857580 22506 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
I20260709 13:05:58.863095 22626 tablet_bootstrap.cc:492] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:58.863847 22626 ts_tablet_manager.cc:1403] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.192s	user 0.063s	sys 0.068s
I20260709 13:05:58.869012 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:58.868073 22626 raft_consensus.cc:359] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.870580 22626 raft_consensus.cc:385] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.870908 22626 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.871649 22626 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.875701 22915 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:05:58.883805 22969 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.876422 22626 ts_tablet_manager.cc:1434] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:05:58.885682 22969 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.887004 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.891588 22580 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
W20260709 13:05:58.892091 22545 leader_election.cc:343] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.888244 22969 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:58.892612 22545 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:58.894055 22969 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:58.892627 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 89261.6us
I20260709 13:05:58.883260 22915 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:58.897910 22545 leader_election.cc:343] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.899015 22545 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:58.901600 22545 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:58.902772 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:58.903609 22889 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.906860 22577 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:58.907873 22889 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.908263 22889 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.908644 22889 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:58.914713 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 110829us
I20260709 13:05:58.916029 22626 tablet_bootstrap.cc:492] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:58.919176 22627 tablet_bootstrap.cc:492] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:58.919713 22627 ts_tablet_manager.cc:1403] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.207s	user 0.020s	sys 0.016s
W20260709 13:05:58.922355 22472 leader_election.cc:343] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:58.923278 22472 leader_election.cc:343] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.916566 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:58.932540 22649 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.932932 22649 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.933244 22649 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:58.934988 22472 leader_election.cc:343] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.935946 22330 catalog_manager.cc:5697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.943953 22649 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.944977 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:58.945838 22649 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:58.946177 22396 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:58.950635 22433 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.956231 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:58.959014 22545 leader_election.cc:343] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.959146 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:58.962477 22848 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:58.961097 22472 leader_election.cc:343] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.980186 22627 raft_consensus.cc:359] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.989233 22627 raft_consensus.cc:385] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.976270 22626 tablet_bootstrap.cc:654] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.969060 22625 tablet_bootstrap.cc:492] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:58.970702 22722 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:05:58.991235 22625 ts_tablet_manager.cc:1403] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.379s	user 0.012s	sys 0.046s
I20260709 13:05:58.965278 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:58.989723 22627 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.964764 22889 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:58.971235 22795 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:05:59.006318 22625 raft_consensus.cc:359] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.011837 22625 raft_consensus.cc:385] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:59.001709 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 44059.4us
I20260709 13:05:59.012216 22625 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.003434 22627 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.013146 22889 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:59.013430 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:59.014168 22506 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:59.014995 22627 ts_tablet_manager.cc:1434] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.002s
I20260709 13:05:59.011044 22580 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 1: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:05:59.012952 22625 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.028754 22627 tablet_bootstrap.cc:492] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:59.030776 22625 ts_tablet_manager.cc:1434] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
W20260709 13:05:59.032251 22546 leader_election.cc:343] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.032795 22546 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:59.031142 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:59.040884 22722 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.050719 22722 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.051246 22722 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.056911 22625 tablet_bootstrap.cc:492] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:59.035261 22957 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.059116 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:59.063436 22722 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:59.074371 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:59.083052 22472 leader_election.cc:343] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.084870 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:59.085498 22579 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
W20260709 13:05:59.086413 22546 leader_election.cc:343] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.086889 22546 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:59.089638 22782 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.088058 22330 catalog_manager.cc:5697] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.097121 22474 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:59.098009 22795 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.098416 22795 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.098733 22795 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.106380 22649 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.114701 22626 tablet_bootstrap.cc:492] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:59.115216 22626 ts_tablet_manager.cc:1403] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.199s	user 0.001s	sys 0.024s
I20260709 13:05:59.125500 22626 raft_consensus.cc:359] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.126150 22626 raft_consensus.cc:385] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.126564 22626 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.134982 22626 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.139451 22625 tablet_bootstrap.cc:654] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.141769 22626 ts_tablet_manager.cc:1434] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 13:05:59.143378 22331 catalog_manager.cc:5697] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.145159 22795 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.151093 22795 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:59.153786 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:59.155347 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:59.155686 22579 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:59.157066 22472 leader_election.cc:343] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.157758 22627 tablet_bootstrap.cc:654] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:59.168197 22472 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:59.178987 22579 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:59.181996 22626 tablet_bootstrap.cc:492] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:59.183401 22474 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:59.188740 22433 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.195936 22994 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.196602 22994 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:59.197485 22994 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:59.207103 22534 tablet.cc:2406] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:59.218760 22626 tablet_bootstrap.cc:654] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.220647 22627 tablet_bootstrap.cc:492] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:59.221228 22627 ts_tablet_manager.cc:1403] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.202s	user 0.017s	sys 0.029s
I20260709 13:05:59.224354 22627 raft_consensus.cc:359] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.226714 22984 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:59.231302 22627 raft_consensus.cc:385] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.231772 22627 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.232646 22627 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.234980 22627 ts_tablet_manager.cc:1434] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:59.241710 22627 tablet_bootstrap.cc:492] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: Bootstrap starting.
I20260709 13:05:59.253230 22627 tablet_bootstrap.cc:654] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.266158 22625 tablet_bootstrap.cc:492] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:59.266625 22625 ts_tablet_manager.cc:1403] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.213s	user 0.011s	sys 0.014s
I20260709 13:05:59.268539 23004 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.269086 23004 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.269237 22625 raft_consensus.cc:359] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.269853 22625 raft_consensus.cc:385] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.270141 22625 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.270745 22625 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.272296 22625 ts_tablet_manager.cc:1434] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:05:59.272146 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:59.273285 22625 tablet_bootstrap.cc:492] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:59.273506 23004 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:05:59.273962 22546 leader_election.cc:343] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.277088 22627 tablet_bootstrap.cc:492] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: No bootstrap required, opened a new log
I20260709 13:05:59.277630 22627 ts_tablet_manager.cc:1403] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.008s
I20260709 13:05:59.280725 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:05:59.282435 22545 leader_election.cc:343] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.282909 22545 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:59.282670 22627 raft_consensus.cc:359] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.283886 22433 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.284327 22627 raft_consensus.cc:385] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.284690 23005 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.284744 22627 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.285732 22627 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.288300 22627 ts_tablet_manager.cc:1434] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:59.295003 22625 tablet_bootstrap.cc:654] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.295557 22626 tablet_bootstrap.cc:492] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:59.294963 22330 catalog_manager.cc:5697] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.296043 22626 ts_tablet_manager.cc:1403] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.001s
I20260709 13:05:59.298810 22626 raft_consensus.cc:359] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.300276 22626 raft_consensus.cc:385] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.300588 22626 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.301306 22626 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.303696 22626 ts_tablet_manager.cc:1434] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:59.304725 22626 tablet_bootstrap.cc:492] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:59.326963 23005 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.327544 23005 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.329083 22649 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.329849 23005 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:59.329641 22649 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.332072 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:59.332079 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:59.333994 22649 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:05:59.334213 22546 leader_election.cc:343] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:59.334960 22545 leader_election.cc:343] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.335448 22545 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:59.335475 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:59.336277 23005 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.337967 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:59.339267 22579 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:59.338410 22649 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:05:59.338579 22472 leader_election.cc:343] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.340692 22474 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:59.341401 22649 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.344455 22625 tablet_bootstrap.cc:492] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:59.345106 22625 ts_tablet_manager.cc:1403] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.072s	user 0.038s	sys 0.012s
I20260709 13:05:59.346726 22626 tablet_bootstrap.cc:654] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.348229 22625 raft_consensus.cc:359] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.348752 22649 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.349155 22625 raft_consensus.cc:385] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.349202 22649 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.349647 22625 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.351642 22625 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.354943 22625 ts_tablet_manager.cc:1434] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:59.356215 22625 tablet_bootstrap.cc:492] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:59.363075 22915 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.372756 22915 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.375015 22625 tablet_bootstrap.cc:654] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.375780 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:59.378650 22915 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:59.380856 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:59.382782 22399 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:59.385299 22992 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.388155 22625 tablet_bootstrap.cc:492] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:59.388690 22625 ts_tablet_manager.cc:1403] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.016s
I20260709 13:05:59.391336 22625 raft_consensus.cc:359] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.392030 22625 raft_consensus.cc:385] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.392287 22625 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.392951 22625 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.395020 22625 ts_tablet_manager.cc:1434] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:59.395977 22625 tablet_bootstrap.cc:492] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:59.402150 22625 tablet_bootstrap.cc:654] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.386245 22649 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.410555 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:59.410903 22649 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:59.411224 22425 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.414918 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:59.415510 22579 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.421108 22625 tablet_bootstrap.cc:492] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:59.425063 22722 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.428725 22579 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:59.430619 22625 ts_tablet_manager.cc:1403] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.011s
I20260709 13:05:59.438450 22474 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:59.439344 22984 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.439728 22984 raft_consensus.cc:697] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:59.440461 22984 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.441159 22626 tablet_bootstrap.cc:492] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:59.441725 22626 ts_tablet_manager.cc:1403] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.016s
I20260709 13:05:59.441278 22625 raft_consensus.cc:359] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.442224 22625 raft_consensus.cc:385] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.442550 22625 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.443217 22625 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.444617 22626 raft_consensus.cc:359] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.445276 22626 raft_consensus.cc:385] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.445539 22626 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.446314 22626 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.447153 22625 ts_tablet_manager.cc:1434] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:59.446625 22425 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:59.448309 22626 ts_tablet_manager.cc:1434] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:05:59.449313 22626 tablet_bootstrap.cc:492] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:59.449700 22625 tablet_bootstrap.cc:492] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:59.454959 22626 tablet_bootstrap.cc:654] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.458738 22625 tablet_bootstrap.cc:654] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.479810 22626 tablet_bootstrap.cc:492] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:59.480381 22626 ts_tablet_manager.cc:1403] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 13:05:59.482568 22999 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.483114 22999 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.485615 22999 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:59.488109 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:59.488422 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:59.486905 22626 raft_consensus.cc:359] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.489414 22576 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:05:59.489398 22626 raft_consensus.cc:385] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.489888 22626 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.490566 22626 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.492147 22626 ts_tablet_manager.cc:1434] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.001s
I20260709 13:05:59.490607 22505 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:05:59.493201 22626 tablet_bootstrap.cc:492] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:59.493554 22396 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:05:59.494566 22999 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.507958 22626 tablet_bootstrap.cc:654] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.505359 22999 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.519644 22328 catalog_manager.cc:5697] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.544350 22999 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:59.552417 22625 tablet_bootstrap.cc:492] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:59.554992 22433 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.555886 22625 ts_tablet_manager.cc:1403] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.106s	user 0.037s	sys 0.033s
I20260709 13:05:59.564798 22625 raft_consensus.cc:359] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.570199 22625 raft_consensus.cc:385] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.571049 22625 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.576753 22625 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:59.567901 22379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:59.567708 22999 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:59.588310 22625 ts_tablet_manager.cc:1434] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:05:59.591809 22625 tablet_bootstrap.cc:492] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:59.593915 22626 tablet_bootstrap.cc:492] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:59.594734 22626 ts_tablet_manager.cc:1403] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.028s
I20260709 13:05:59.598369 22960 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.605953 22984 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.606417 22984 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.603926 22960 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.611449 22984 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:59.612644 22960 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:59.618671 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:59.619064 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:59.619360 22579 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:59.620362 22625 tablet_bootstrap.cc:654] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.618695 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:59.619397 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:05:59.621842 22472 leader_election.cc:343] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.623209 22474 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:59.622954 22576 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:59.629915 22626 raft_consensus.cc:359] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.637008 22626 raft_consensus.cc:385] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.637351 22626 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.638908 22994 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.639343 22994 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.639684 22994 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.640463 22626 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:59.644193 22472 leader_election.cc:343] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.648737 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:59.650260 22722 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.650615 22722 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.650915 22722 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.651146 22626 ts_tablet_manager.cc:1434] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:05:59.652674 22649 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.653419 22649 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.662962 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:59.662954 22649 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:05:59.664395 22472 leader_election.cc:343] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.645699 23005 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.669370 23005 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.675364 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:05:59.678016 22577 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:05:59.683007 22474 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:59.688619 22722 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.690068 22795 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.690486 22795 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.690800 22795 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.700227 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:05:59.701876 23005 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:59.703722 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:05:59.704456 22505 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 0.
W20260709 13:05:59.704854 22546 leader_election.cc:343] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.705288 22722 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:59.705327 22626 tablet_bootstrap.cc:492] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: Bootstrap starting.
I20260709 13:05:59.707973 22795 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.709898 22795 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:59.704659 22625 tablet_bootstrap.cc:492] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:59.710718 22625 ts_tablet_manager.cc:1403] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.119s	user 0.039s	sys 0.003s
I20260709 13:05:59.706112 22994 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.715991 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:59.716687 22577 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.716847 22545 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:59.725049 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:59.733439 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:59.733762 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:59.734550 22576 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.735679 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:05:59.736531 22579 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.741870 22577 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
W20260709 13:05:59.742921 22472 leader_election.cc:343] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:59.744932 22472 leader_election.cc:343] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.717051 22994 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:05:59.746546 22579 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:59.750779 22576 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:05:59.747045 23006 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.753609 22474 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:59.755084 22626 tablet_bootstrap.cc:654] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.759987 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:05:59.761298 22474 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:05:59.759055 22960 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.762292 22994 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.762717 22649 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.752311 22625 raft_consensus.cc:359] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.763358 22625 raft_consensus.cc:385] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.763712 22625 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.764531 22625 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.752375 23006 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.772416 23006 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.776748 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:59.777546 22625 ts_tablet_manager.cc:1434] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:05:59.766762 22649 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:59.778640 22625 tablet_bootstrap.cc:492] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:59.778419 22649 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:05:59.784382 22472 leader_election.cc:343] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.766033 22994 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:59.810722 22994 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.806699 22960 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:05:59.818740 22425 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.827544 22625 tablet_bootstrap.cc:654] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.831806 22795 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.828950 23006 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.837800 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:05:59.838318 22429 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.844061 22429 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:59.845290 22546 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:05:59.845445 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:05:59.846031 22782 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.846561 22782 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:05:59.847280 22782 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.847097 22960 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.844563 23006 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:05:59.846091 22505 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.921604 22330 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.936206 22330 catalog_manager.cc:5697] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.954568 22625 tablet_bootstrap.cc:492] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:05:59.940176 22984 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:05:59.955194 22625 ts_tablet_manager.cc:1403] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.177s	user 0.012s	sys 0.019s
I20260709 13:05:59.962762 22625 raft_consensus.cc:359] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.963563 22625 raft_consensus.cc:385] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.963858 22625 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.968818 22625 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:05:59.971095 22625 ts_tablet_manager.cc:1434] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:05:59.973459 22505 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:05:59.982317 22625 tablet_bootstrap.cc:492] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:05:59.982352 22626 tablet_bootstrap.cc:492] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: No bootstrap required, opened a new log
I20260709 13:05:59.983217 22626 ts_tablet_manager.cc:1403] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent bootstrapping tablet: real 0.278s	user 0.012s	sys 0.010s
I20260709 13:05:59.983347 22328 catalog_manager.cc:5697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.999907 22626 raft_consensus.cc:359] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.003334 22626 raft_consensus.cc:385] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.009400 22626 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.010795 22626 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.012228 22915 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.012818 22915 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.013221 22626 ts_tablet_manager.cc:1434] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:06:00.015883 22915 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:00.018335 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:00.018309 23030 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:00.022682 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:00.024269 22396 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:00.031896 23030 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:00.038620 22330 catalog_manager.cc:5697] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.048749 22915 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.062070 22625 tablet_bootstrap.cc:654] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.109308 23030 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.109812 23030 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.111831 23030 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:00.115592 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:00.122036 22625 tablet_bootstrap.cc:492] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:06:00.122563 22625 ts_tablet_manager.cc:1403] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.001s
I20260709 13:06:00.125730 22625 raft_consensus.cc:359] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.126410 22625 raft_consensus.cc:385] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.126681 22625 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.127295 22625 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:00.127569 22472 leader_election.cc:343] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.130436 22625 ts_tablet_manager.cc:1434] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:06:00.132674 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:00.135690 22625 tablet_bootstrap.cc:492] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:06:00.136653 22576 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 0.
I20260709 13:06:00.137951 22474 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:00.138743 23030 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.139099 23030 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.139432 23030 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.146453 23030 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.148241 22625 tablet_bootstrap.cc:654] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.149577 23030 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:00.149940 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:00.150580 22576 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.151029 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:00.153620 22472 leader_election.cc:343] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.161629 22576 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:00.162907 22474 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:00.163964 22984 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.164429 22984 raft_consensus.cc:697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:00.165293 22984 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.174995 22625 tablet_bootstrap.cc:492] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:06:00.175513 22625 ts_tablet_manager.cc:1403] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.005s
I20260709 13:06:00.178268 22625 raft_consensus.cc:359] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.178941 22625 raft_consensus.cc:385] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.179193 22625 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.179769 22625 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.181281 22625 ts_tablet_manager.cc:1434] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:00.182320 22625 tablet_bootstrap.cc:492] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Bootstrap starting.
I20260709 13:06:00.188112 22625 tablet_bootstrap.cc:654] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.189213 22328 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.213502 23029 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.214016 23029 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.217128 23029 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:00.217167 22425 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.217959 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:00.222656 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:00.223450 22576 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:00.225062 22399 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:00.226960 23029 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.228183 22984 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.228134 22625 tablet_bootstrap.cc:492] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: No bootstrap required, opened a new log
I20260709 13:06:00.229669 22625 ts_tablet_manager.cc:1403] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.009s
I20260709 13:06:00.231097 22915 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.231585 22915 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.232040 22625 raft_consensus.cc:359] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.232717 22625 raft_consensus.cc:385] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.233001 22625 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.234095 22625 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.234726 22915 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:00.234754 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:00.236204 22625 ts_tablet_manager.cc:1434] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:06:00.236951 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:00.237741 22576 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:00.239667 22399 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:00.240427 23029 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.244220 22984 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.258831 23005 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.274381 22915 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.274906 22915 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.276607 23005 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.278198 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:00.279724 22579 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:00.283841 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:00.287082 22915 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:00.291723 22915 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.292109 23029 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.292201 22915 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.295468 22915 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:00.296725 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:00.296890 22960 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.298911 22579 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 1: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:00.299800 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:00.306396 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:00.310247 22424 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.319478 23029 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.322204 22994 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.320806 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:00.330672 23029 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.377525 23029 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.393060 22994 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:00.401525 22994 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.546236 22994 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.568432 22984 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:00.626109 22379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:00.700721 23032 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.701270 23032 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.703442 23032 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:00.704391 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:00.704442 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:00.705124 22577 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:00.705098 22433 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:00.706147 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:00.706835 23032 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:00.707283 23032 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.707554 23032 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.712586 23032 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.714277 23032 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:00.715003 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:00.715231 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:00.715698 22433 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.715763 22577 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.722010 22577 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:00.722055 22433 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:00.722923 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:00.723551 23032 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.724025 23032 raft_consensus.cc:697] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:00.724881 23032 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:00.737824 22330 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 0 to 2, leader changed from <none> to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.156976 22576 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:01.158900 22994 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.200747 22425 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:01.210309 22984 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:02.427752 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:02.462960 23068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:02.463150 23070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:02.462960 23067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:02.464491 21312 server_base.cc:1061] running on GCE node
I20260709 13:06:02.465580 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:02.465807 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:02.465978 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602362465959 us; error 0 us; skew 500 ppm
I20260709 13:06:02.466502 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:02.469216 21312 webserver.cc:533] Webserver started at http://127.20.208.4:41423/ using document root <none> and password file <none>
I20260709 13:06:02.469753 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:02.469961 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:02.470376 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:02.472095 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-3-root/instance:
uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
format_stamp: "Formatted at 2026-07-09 13:06:02 on dist-test-slave-6j4g"
I20260709 13:06:02.476835 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:06:02.480583 23075 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:02.481418 21312 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:06:02.481787 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-3-root
uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
format_stamp: "Formatted at 2026-07-09 13:06:02 on dist-test-slave-6j4g"
I20260709 13:06:02.482149 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:02.500198 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:02.501735 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:02.503204 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:02.505573 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:02.505787 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:02.506022 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:02.506181 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:02.582271 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.4:42955
I20260709 13:06:02.582371 23137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.4:42955 every 8 connection(s)
I20260709 13:06:02.587540 21312 auto_leader_rebalancer-test.cc:384] add a tserver: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:02.600440 23138 heartbeater.cc:344] Connected to a master server at 127.20.208.62:33169
I20260709 13:06:02.600955 23138 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:02.601787 23138 heartbeater.cc:507] Master 127.20.208.62:33169 requested a full tablet report, sending...
I20260709 13:06:02.603962 22330 ts_manager.cc:194] Registered new tserver with Master: 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:02.605546 22330 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43642
I20260709 13:06:02.754040 22505 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:02.761436 22576 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:02.761505 22424 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:02.762995 22984 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.763924 22994 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.775029 22994 raft_consensus.cc:2955] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:02.777150 22576 raft_consensus.cc:2955] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:02.781140 22424 raft_consensus.cc:2955] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:06:02.799139 22473 consensus_peers.cc:597] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a98509b657f84336bb26dd231a3124f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.818799 22330 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 2 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:02.862011 22425 consensus_queue.cc:237] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:02.870488 22577 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:02.873003 22504 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:02.877039 23029 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.878652 23029 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.896165 22504 raft_consensus.cc:2955] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:02.894052 23029 raft_consensus.cc:2955] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:06:02.906168 22398 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 063ac6dfc4614afb9ca68efa49225bf7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.911049 22579 raft_consensus.cc:2955] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:02.921074 22328 catalog_manager.cc:5697] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:02.925277 22425 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:02.935261 22398 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6089498054d24ce99c46fe9be74f8589. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.935999 22504 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:02.938060 23029 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.938649 22576 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:02.940076 23029 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.952792 23162 raft_consensus.cc:2955] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:02.960358 22576 raft_consensus.cc:2955] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:02.963634 22506 raft_consensus.cc:2955] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:02.966121 22504 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:02.977596 22330 catalog_manager.cc:5697] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:02.988584 22576 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:02.988771 22473 consensus_peers.cc:597] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8fecad4f2f3d49ea8a691075b31e1f96. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.989939 23149 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.998368 23152 raft_consensus.cc:2955] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:03.000092 22576 raft_consensus.cc:2955] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:03.002910 22425 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:03.009747 23149 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.017580 22328 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:03.036350 22424 raft_consensus.cc:2955] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:03.158840 23169 ts_tablet_manager.cc:933] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:03.170625 23169 tablet_copy_client.cc:323] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:03.192289 22518 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet a98509b657f84336bb26dd231a3124f1 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:03.192926 22518 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet a98509b657f84336bb26dd231a3124f1 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-a98509b657f84336bb26dd231a3124f1
I20260709 13:06:03.198539 22518 tablet_copy_source_session.cc:215] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:03.201793 23169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98509b657f84336bb26dd231a3124f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.215387 23169 tablet_copy_client.cc:806] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:03.216104 23169 tablet_copy_client.cc:670] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:03.223138 23169 tablet_copy_client.cc:538] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:03.232550 23169 tablet_bootstrap.cc:492] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:03.256677 23169 tablet_bootstrap.cc:492] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.257645 23169 tablet_bootstrap.cc:492] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:03.258301 23169 ts_tablet_manager.cc:1403] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.005s
I20260709 13:06:03.261297 23169 raft_consensus.cc:359] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:03.262148 23169 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:03.262995 23169 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:03.266610 23138 heartbeater.cc:499] Master 127.20.208.62:33169 was elected leader, sending a full tablet report...
I20260709 13:06:03.266912 23169 ts_tablet_manager.cc:1434] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.007s
I20260709 13:06:03.272782 22518 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-a98509b657f84336bb26dd231a3124f1 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:03.273381 22518 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-a98509b657f84336bb26dd231a3124f1 on tablet a98509b657f84336bb26dd231a3124f1 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:03.401921 23169 ts_tablet_manager.cc:933] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:03.403909 23169 tablet_copy_client.cc:323] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:03.405339 22518 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 8fecad4f2f3d49ea8a691075b31e1f96 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:03.405766 22518 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 8fecad4f2f3d49ea8a691075b31e1f96 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-8fecad4f2f3d49ea8a691075b31e1f96
I20260709 13:06:03.410562 22518 tablet_copy_source_session.cc:215] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:03.413344 23169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fecad4f2f3d49ea8a691075b31e1f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.414357 23175 ts_tablet_manager.cc:933] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
I20260709 13:06:03.416009 23175 tablet_copy_client.cc:323] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.1:43859
I20260709 13:06:03.428856 23169 tablet_copy_client.cc:806] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:03.429493 23169 tablet_copy_client.cc:670] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:03.433033 23169 tablet_copy_client.cc:538] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:03.433490 22443 tablet_copy_service.cc:140] P e32ba8e6132b4f8e98a99066b6fffe05: Received BeginTabletCopySession request for tablet 6089498054d24ce99c46fe9be74f8589 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:34614)
I20260709 13:06:03.434055 22443 tablet_copy_service.cc:161] P e32ba8e6132b4f8e98a99066b6fffe05: Beginning new tablet copy session on tablet 6089498054d24ce99c46fe9be74f8589 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:34614: session id = 9cea93fb03e04e48a6dabc4094ee7c93-6089498054d24ce99c46fe9be74f8589
I20260709 13:06:03.441088 22443 tablet_copy_source_session.cc:215] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:03.445084 23175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6089498054d24ce99c46fe9be74f8589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.461318 23169 tablet_bootstrap.cc:492] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:03.472265 23175 tablet_copy_client.cc:806] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:03.473932 23175 tablet_copy_client.cc:670] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:03.478765 23175 tablet_copy_client.cc:538] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:03.505268 23169 tablet_bootstrap.cc:492] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.506310 23169 tablet_bootstrap.cc:492] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:03.506685 23175 tablet_bootstrap.cc:492] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:03.507156 23169 ts_tablet_manager.cc:1403] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.007s
I20260709 13:06:03.507855 23178 ts_tablet_manager.cc:933] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
I20260709 13:06:03.516561 23178 tablet_copy_client.cc:323] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.1:43859
I20260709 13:06:03.518268 22443 tablet_copy_service.cc:140] P e32ba8e6132b4f8e98a99066b6fffe05: Received BeginTabletCopySession request for tablet 063ac6dfc4614afb9ca68efa49225bf7 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:34614)
I20260709 13:06:03.518833 22443 tablet_copy_service.cc:161] P e32ba8e6132b4f8e98a99066b6fffe05: Beginning new tablet copy session on tablet 063ac6dfc4614afb9ca68efa49225bf7 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:34614: session id = 9cea93fb03e04e48a6dabc4094ee7c93-063ac6dfc4614afb9ca68efa49225bf7
I20260709 13:06:03.518602 23169 raft_consensus.cc:359] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:03.519434 23169 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:03.520077 23169 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:03.522481 23169 ts_tablet_manager.cc:1434] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:06:03.527905 22518 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-8fecad4f2f3d49ea8a691075b31e1f96 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:03.528347 22518 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-8fecad4f2f3d49ea8a691075b31e1f96 on tablet 8fecad4f2f3d49ea8a691075b31e1f96 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:03.529639 22443 tablet_copy_source_session.cc:215] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:03.536980 23113 raft_consensus.cc:1217] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:06:03.542752 23178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063ac6dfc4614afb9ca68efa49225bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.560068 23178 tablet_copy_client.cc:806] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:03.560698 23178 tablet_copy_client.cc:670] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:03.563748 23178 tablet_copy_client.cc:538] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:03.566613 23175 tablet_bootstrap.cc:492] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.567545 23175 tablet_bootstrap.cc:492] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:03.568229 23175 ts_tablet_manager.cc:1403] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.012s
I20260709 13:06:03.572783 23178 tablet_bootstrap.cc:492] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:03.573366 23175 raft_consensus.cc:359] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:03.574764 23175 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:03.575445 23175 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:03.579519 23175 ts_tablet_manager.cc:1434] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:03.584085 22443 tablet_copy_service.cc:342] P e32ba8e6132b4f8e98a99066b6fffe05: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-6089498054d24ce99c46fe9be74f8589 received from {username='slave'} at 127.0.0.1:34614
I20260709 13:06:03.584565 22443 tablet_copy_service.cc:434] P e32ba8e6132b4f8e98a99066b6fffe05: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-6089498054d24ce99c46fe9be74f8589 on tablet 6089498054d24ce99c46fe9be74f8589 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:03.599764 23178 tablet_bootstrap.cc:492] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.602398 23178 tablet_bootstrap.cc:492] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:03.603153 23178 ts_tablet_manager.cc:1403] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.008s
I20260709 13:06:03.606164 23178 raft_consensus.cc:359] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:03.607040 23178 raft_consensus.cc:740] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:03.607733 23178 consensus_queue.cc:260] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:03.610109 23178 ts_tablet_manager.cc:1434] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:03.613511 22443 tablet_copy_service.cc:342] P e32ba8e6132b4f8e98a99066b6fffe05: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-063ac6dfc4614afb9ca68efa49225bf7 received from {username='slave'} at 127.0.0.1:34614
I20260709 13:06:03.613940 22443 tablet_copy_service.cc:434] P e32ba8e6132b4f8e98a99066b6fffe05: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-063ac6dfc4614afb9ca68efa49225bf7 on tablet 063ac6dfc4614afb9ca68efa49225bf7 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:03.814106 23113 raft_consensus.cc:1217] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:03.910248 23113 raft_consensus.cc:1217] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:03.981961 23113 raft_consensus.cc:1217] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:04.118221 23149 raft_consensus.cc:1064] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:04.120633 23149 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:04.128995 23113 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:04.130380 23152 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.132108 22579 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:04.133612 22425 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:04.133493 23152 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.137356 23032 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.143869 23151 raft_consensus.cc:2955] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.145910 23113 raft_consensus.cc:2955] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.155954 22579 raft_consensus.cc:2955] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.165987 22425 raft_consensus.cc:2955] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.166154 22328 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.197999 22504 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:04.204609 23113 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:04.207203 23151 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.209101 22579 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:04.219931 23152 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.221884 23152 raft_consensus.cc:2955] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.223101 23113 raft_consensus.cc:2955] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.244411 22579 raft_consensus.cc:2955] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.248190 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a98509b657f84336bb26dd231a3124f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:04.252517 22329 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 2 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.270792 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet a98509b657f84336bb26dd231a3124f1 with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:06:04.272893 23194 tablet_replica.cc:333] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:06:04.273669 23194 raft_consensus.cc:2243] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.274219 23194 raft_consensus.cc:2272] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.277446 23194 ts_tablet_manager.cc:1916] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:04.285794 23029 raft_consensus.cc:1064] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:04.287983 23029 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:04.297329 23194 ts_tablet_manager.cc:1929] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:06:04.300719 23194 log.cc:1199] T a98509b657f84336bb26dd231a3124f1 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/a98509b657f84336bb26dd231a3124f1
I20260709 13:06:04.304940 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet a98509b657f84336bb26dd231a3124f1 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:04.310710 23113 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.315572 23162 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:04.317683 23183 raft_consensus.cc:1064] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:04.328588 23183 consensus_queue.cc:237] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:04.349257 22506 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.350522 22579 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.359514 23162 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.363512 23029 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.370666 22504 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.372936 22577 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.372730 23197 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.380708 23029 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.382706 23113 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.394317 23029 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.407665 23183 raft_consensus.cc:2955] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.415144 22506 raft_consensus.cc:2955] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.418615 22577 raft_consensus.cc:2955] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.425041 23162 raft_consensus.cc:2955] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.428812 22504 raft_consensus.cc:2955] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.442693 22577 raft_consensus.cc:2955] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.446846 23113 raft_consensus.cc:2955] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.453512 23112 raft_consensus.cc:2955] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.464991 22329 catalog_manager.cc:5697] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.464991 23151 raft_consensus.cc:1064] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:04.469125 23151 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:04.495540 22424 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.499037 23112 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.499152 23193 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:04.497584 22329 catalog_manager.cc:5697] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.577957 23149 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.587065 22576 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.593894 23151 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:04.668944 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 57336.5us
W20260709 13:06:04.698776 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 101208us
I20260709 13:06:04.701484 23214 raft_consensus.cc:2955] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.705574 22429 consensus_queue.cc:237] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:04.707444 22424 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:04.720503 23113 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.722892 23206 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:04.724550 23113 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.726919 22576 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.726783 23206 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.731567 23206 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:04.742884 23111 raft_consensus.cc:2955] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.739739 23183 raft_consensus.cc:2955] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.742321 23112 raft_consensus.cc:2955] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.751382 22506 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.754750 23217 raft_consensus.cc:2955] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.743201 22576 raft_consensus.cc:2955] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.757812 22577 raft_consensus.cc:2955] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.752538 22327 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.773175 23113 raft_consensus.cc:2955] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.788410 22429 raft_consensus.cc:2955] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.793318 22329 catalog_manager.cc:5697] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.810895 22494 tablet_service.cc:1558] Processing DeleteTablet for tablet 063ac6dfc4614afb9ca68efa49225bf7 with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58696
I20260709 13:06:04.811307 22328 catalog_manager.cc:5697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.813026 23219 tablet_replica.cc:333] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:06:04.814981 23219 raft_consensus.cc:2243] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.819159 23219 raft_consensus.cc:2272] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.825016 23219 ts_tablet_manager.cc:1916] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:04.827251 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet 6089498054d24ce99c46fe9be74f8589 with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49180
I20260709 13:06:04.836041 23162 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.837339 22504 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:04.843321 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 063ac6dfc4614afb9ca68efa49225bf7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:04.845072 23220 tablet_replica.cc:333] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:06:04.848233 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6089498054d24ce99c46fe9be74f8589 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:04.858306 22433 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.858811 23219 ts_tablet_manager.cc:1929] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:04.859278 23219 log.cc:1199] T 063ac6dfc4614afb9ca68efa49225bf7 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/063ac6dfc4614afb9ca68efa49225bf7
I20260709 13:06:04.857458 22504 raft_consensus.cc:2955] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.860832 23112 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.861392 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 063ac6dfc4614afb9ca68efa49225bf7 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:04.862524 23215 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:06:04.865469 23032 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.865880 23220 raft_consensus.cc:2243] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.866703 23220 raft_consensus.cc:2272] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.870414 23220 ts_tablet_manager.cc:1916] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:04.879016 23193 raft_consensus.cc:2955] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.896109 23112 raft_consensus.cc:2955] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.903539 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8fecad4f2f3d49ea8a691075b31e1f96 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:04.903717 23220 ts_tablet_manager.cc:1929] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:04.905395 23220 log.cc:1199] T 6089498054d24ce99c46fe9be74f8589 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/6089498054d24ce99c46fe9be74f8589
I20260709 13:06:04.907680 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet 6089498054d24ce99c46fe9be74f8589 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:04.911207 22433 raft_consensus.cc:2955] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:04.916266 22329 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.930181 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fecad4f2f3d49ea8a691075b31e1f96 with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49180
I20260709 13:06:04.932497 23220 tablet_replica.cc:333] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:06:04.933462 23220 raft_consensus.cc:2243] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.934126 23220 raft_consensus.cc:2272] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.936928 23220 ts_tablet_manager.cc:1916] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:04.948741 23220 ts_tablet_manager.cc:1929] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:04.949131 23220 log.cc:1199] T 8fecad4f2f3d49ea8a691075b31e1f96 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/8fecad4f2f3d49ea8a691075b31e1f96
I20260709 13:06:04.950673 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet 8fecad4f2f3d49ea8a691075b31e1f96 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:05.997790 22504 consensus_queue.cc:237] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.004772 22576 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:06.005326 22473 consensus_peers.cc:597] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5964cb0c6d2046d4b63d976e33ff0d84. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.006342 23215 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.006628 22425 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.008664 23222 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.026695 23032 raft_consensus.cc:2955] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.029469 22425 raft_consensus.cc:2955] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.033824 22576 raft_consensus.cc:2955] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.042670 22328 catalog_manager.cc:5697] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.069793 22576 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.078593 22433 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.080082 23006 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.080734 22504 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.083225 23211 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.094868 23006 raft_consensus.cc:2955] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.096845 22433 raft_consensus.cc:2955] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.125844 22506 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.130072 22504 raft_consensus.cc:2955] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.133847 22327 catalog_manager.cc:5697] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:06:06.147780 22547 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d46675566504843a14e59e2035629c3. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:06.151829 22473 consensus_peers.cc:597] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 572a8927b7f349538a2b1f1300d659d2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.152523 22576 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.154999 23215 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.157138 22429 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.159192 23215 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.167074 23222 raft_consensus.cc:2955] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.168694 22576 raft_consensus.cc:2955] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.182816 22429 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.186159 22327 catalog_manager.cc:5697] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.199419 22506 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.200099 22576 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:06.199436 22398 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69f070e8e9ed4c95b36baa7f987d1fba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.201418 23217 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.202800 23183 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.202275 22433 raft_consensus.cc:2955] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.224299 23183 raft_consensus.cc:2955] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.225960 22506 raft_consensus.cc:2955] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.227777 22576 raft_consensus.cc:2955] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.242162 22327 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:06.548316 23243 ts_tablet_manager.cc:933] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:06.562376 23244 ts_tablet_manager.cc:933] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:06.562834 23243 tablet_copy_client.cc:323] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:06.565685 22518 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 572a8927b7f349538a2b1f1300d659d2 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:06.566267 22518 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 572a8927b7f349538a2b1f1300d659d2 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-572a8927b7f349538a2b1f1300d659d2
I20260709 13:06:06.573912 23244 tablet_copy_client.cc:323] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:06.576500 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 5964cb0c6d2046d4b63d976e33ff0d84 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:06.576531 22518 tablet_copy_source_session.cc:215] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:06.577101 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 5964cb0c6d2046d4b63d976e33ff0d84 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-5964cb0c6d2046d4b63d976e33ff0d84
I20260709 13:06:06.584592 22517 tablet_copy_source_session.cc:215] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:06.585590 23243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572a8927b7f349538a2b1f1300d659d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:06.587898 23244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5964cb0c6d2046d4b63d976e33ff0d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:06.604725 23244 tablet_copy_client.cc:806] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:06.605367 23244 tablet_copy_client.cc:670] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:06.606359 23243 tablet_copy_client.cc:806] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:06.607205 23243 tablet_copy_client.cc:670] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:06.611096 23244 tablet_copy_client.cc:538] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:06.612514 23243 tablet_copy_client.cc:538] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:06.620244 23244 tablet_bootstrap.cc:492] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:06.621263 23243 tablet_bootstrap.cc:492] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:06.650354 23244 tablet_bootstrap.cc:492] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:06.651350 23244 tablet_bootstrap.cc:492] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:06.652118 23244 ts_tablet_manager.cc:1403] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.018s
I20260709 13:06:06.654541 23243 tablet_bootstrap.cc:492] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:06.655537 23243 tablet_bootstrap.cc:492] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:06.655107 23244 raft_consensus.cc:359] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.656035 23244 raft_consensus.cc:740] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:06.656368 23243 ts_tablet_manager.cc:1403] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.035s	user 0.024s	sys 0.004s
I20260709 13:06:06.658552 23244 consensus_queue.cc:260] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.660620 23243 raft_consensus.cc:359] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.661657 23243 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:06.662458 23243 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.668752 23244 ts_tablet_manager.cc:1434] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:06:06.672135 23243 ts_tablet_manager.cc:1434] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.006s
I20260709 13:06:06.674939 23251 ts_tablet_manager.cc:933] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:06.682904 23251 tablet_copy_client.cc:323] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:06:06.687561 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-5964cb0c6d2046d4b63d976e33ff0d84 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:06.688098 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-5964cb0c6d2046d4b63d976e33ff0d84 on tablet 5964cb0c6d2046d4b63d976e33ff0d84 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:06.690308 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-572a8927b7f349538a2b1f1300d659d2 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:06.690737 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-572a8927b7f349538a2b1f1300d659d2 on tablet 572a8927b7f349538a2b1f1300d659d2 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:06.696764 23244 ts_tablet_manager.cc:933] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
I20260709 13:06:06.704905 23244 tablet_copy_client.cc:323] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.1:43859
I20260709 13:06:06.708670 22443 tablet_copy_service.cc:140] P e32ba8e6132b4f8e98a99066b6fffe05: Received BeginTabletCopySession request for tablet 69f070e8e9ed4c95b36baa7f987d1fba from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:34614)
I20260709 13:06:06.709214 22443 tablet_copy_service.cc:161] P e32ba8e6132b4f8e98a99066b6fffe05: Beginning new tablet copy session on tablet 69f070e8e9ed4c95b36baa7f987d1fba from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:34614: session id = 9cea93fb03e04e48a6dabc4094ee7c93-69f070e8e9ed4c95b36baa7f987d1fba
I20260709 13:06:06.716378 22443 tablet_copy_source_session.cc:215] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:06.718042 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 4d46675566504843a14e59e2035629c3 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:06:06.718677 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 4d46675566504843a14e59e2035629c3 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-4d46675566504843a14e59e2035629c3
I20260709 13:06:06.720924 23244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f070e8e9ed4c95b36baa7f987d1fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:06.726046 22592 tablet_copy_source_session.cc:215] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:06.729449 23251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d46675566504843a14e59e2035629c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:06.741525 23251 tablet_copy_client.cc:806] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:06.742102 23251 tablet_copy_client.cc:670] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:06.742983 23244 tablet_copy_client.cc:806] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:06.743561 23244 tablet_copy_client.cc:670] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:06.746424 23251 tablet_copy_client.cc:538] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:06.747861 23244 tablet_copy_client.cc:538] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:06.755951 23251 tablet_bootstrap.cc:492] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:06.757643 23244 tablet_bootstrap.cc:492] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:06.789749 23244 tablet_bootstrap.cc:492] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:06.790658 23244 tablet_bootstrap.cc:492] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:06.791321 23244 ts_tablet_manager.cc:1403] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.003s
I20260709 13:06:06.791654 23251 tablet_bootstrap.cc:492] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:06.794806 23251 tablet_bootstrap.cc:492] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:06.794204 23244 raft_consensus.cc:359] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.795315 23244 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:06.795722 23251 ts_tablet_manager.cc:1403] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.012s
I20260709 13:06:06.795967 23244 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.798764 23244 ts_tablet_manager.cc:1434] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:06:06.799988 23251 raft_consensus.cc:359] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.800457 22443 tablet_copy_service.cc:342] P e32ba8e6132b4f8e98a99066b6fffe05: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-69f070e8e9ed4c95b36baa7f987d1fba received from {username='slave'} at 127.0.0.1:34614
I20260709 13:06:06.801002 23251 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:06.801069 22443 tablet_copy_service.cc:434] P e32ba8e6132b4f8e98a99066b6fffe05: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-69f070e8e9ed4c95b36baa7f987d1fba on tablet 69f070e8e9ed4c95b36baa7f987d1fba with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:06.802613 23251 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:06.805308 23251 ts_tablet_manager.cc:1434] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:06.806996 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-4d46675566504843a14e59e2035629c3 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:06:06.807430 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-4d46675566504843a14e59e2035629c3 on tablet 4d46675566504843a14e59e2035629c3 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:06.970335 23112 raft_consensus.cc:1217] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:07.020032 23111 raft_consensus.cc:1217] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:07.097278 23112 raft_consensus.cc:1217] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:07.207173 23112 raft_consensus.cc:1217] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:07.416465 23265 raft_consensus.cc:1064] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:07.419669 23265 consensus_queue.cc:237] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:07.428520 23112 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.428773 22577 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.430622 23222 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.431818 23264 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.431840 22433 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.434801 23264 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:07.453265 22425 raft_consensus.cc:2955] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.452298 23265 raft_consensus.cc:2955] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.472026 22329 catalog_manager.cc:5697] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.471858 23112 raft_consensus.cc:2955] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.482892 22577 raft_consensus.cc:2955] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.529701 22504 consensus_queue.cc:237] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:07.536405 23263 raft_consensus.cc:1064] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:07.540199 22579 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:07.536506 23112 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:07.542567 23222 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:07.542784 23263 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:07.543315 23265 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:07.551884 23032 raft_consensus.cc:2955] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.563583 22579 raft_consensus.cc:2955] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.612870 23264 raft_consensus.cc:1064] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:07.613848 23112 raft_consensus.cc:2955] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.615563 23264 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:07.631938 22331 catalog_manager.cc:5697] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.634728 22429 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.636458 23264 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.645605 23111 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.666849 23183 raft_consensus.cc:1064] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:07.669605 23183 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:07.684201 23264 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.685129 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet 5964cb0c6d2046d4b63d976e33ff0d84 with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:06:07.690933 23111 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.695477 23254 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:07.705251 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 103895us
I20260709 13:06:07.710536 23286 tablet_replica.cc:333] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:06:07.713680 22576 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.714222 23286 raft_consensus.cc:2243] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:07.716017 23286 raft_consensus.cc:2272] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:07.715126 22579 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.718263 23254 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.730369 22429 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.731917 23113 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.737121 22504 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.741307 23183 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.747082 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5964cb0c6d2046d4b63d976e33ff0d84 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:07.732054 23263 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:07.749181 23276 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.750056 23286 ts_tablet_manager.cc:1916] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:07.751262 23263 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.773001 23183 raft_consensus.cc:2955] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.777793 22576 raft_consensus.cc:2955] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.866962 23111 raft_consensus.cc:2955] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.872779 23279 raft_consensus.cc:2955] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:06:07.880337 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 107907us
I20260709 13:06:07.883067 23112 raft_consensus.cc:2955] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.890725 22506 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.941293 23113 raft_consensus.cc:2955] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.920214 22331 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.929761 23211 raft_consensus.cc:2955] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:06:07.960741 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 55288.3us
I20260709 13:06:07.962755 23282 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.964043 22576 raft_consensus.cc:2955] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.929062 22506 raft_consensus.cc:2955] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:07.975646 23286 ts_tablet_manager.cc:1929] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:07.976322 23286 log.cc:1199] T 5964cb0c6d2046d4b63d976e33ff0d84 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/5964cb0c6d2046d4b63d976e33ff0d84
I20260709 13:06:07.980921 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet 5964cb0c6d2046d4b63d976e33ff0d84 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:08.024247 22328 catalog_manager.cc:5697] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.046378 22425 raft_consensus.cc:2955] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:06:08.048594 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 75918.1us
I20260709 13:06:08.063448 22506 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:08.069829 22424 raft_consensus.cc:2955] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.082247 23113 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.084816 23032 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:08.084865 22329 catalog_manager.cc:5697] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.093189 22428 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:08.097404 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 50267.1us
I20260709 13:06:08.104107 23279 raft_consensus.cc:2955] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.106891 23113 raft_consensus.cc:2955] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.135301 22504 raft_consensus.cc:2955] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.139431 22578 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.145413 23112 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.147218 23183 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:08.156737 23254 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:08.168442 22433 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.173885 23295 raft_consensus.cc:2955] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.179911 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 572a8927b7f349538a2b1f1300d659d2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:08.174738 23112 raft_consensus.cc:2955] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.186026 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 69f070e8e9ed4c95b36baa7f987d1fba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:08.198997 22327 catalog_manager.cc:5697] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.212437 23032 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:08.214555 22576 raft_consensus.cc:2955] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.228976 22331 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.227820 22425 raft_consensus.cc:2955] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.241138 22582 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:08.247619 22425 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.249015 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet 572a8927b7f349538a2b1f1300d659d2 with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49180
I20260709 13:06:08.251286 23258 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:08.252368 23303 tablet_replica.cc:333] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:06:08.260939 23112 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.258962 23301 raft_consensus.cc:2955] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.262897 22425 raft_consensus.cc:2955] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.264212 23258 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:08.269518 23112 raft_consensus.cc:2955] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.272624 23303 raft_consensus.cc:2243] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:08.277019 22494 tablet_service.cc:1558] Processing DeleteTablet for tablet 69f070e8e9ed4c95b36baa7f987d1fba with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58696
I20260709 13:06:08.281610 23303 raft_consensus.cc:2272] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:08.290439 23303 ts_tablet_manager.cc:1916] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:08.291427 23304 tablet_replica.cc:333] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:06:08.297284 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d46675566504843a14e59e2035629c3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:08.299634 23304 raft_consensus.cc:2243] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:08.300678 23304 raft_consensus.cc:2272] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:08.307706 22331 catalog_manager.cc:5697] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:08.312548 23304 ts_tablet_manager.cc:1916] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:08.319312 23303 ts_tablet_manager.cc:1929] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:08.319893 23303 log.cc:1199] T 572a8927b7f349538a2b1f1300d659d2 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/572a8927b7f349538a2b1f1300d659d2
I20260709 13:06:08.325376 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet 572a8927b7f349538a2b1f1300d659d2 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:08.329748 22494 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d46675566504843a14e59e2035629c3 with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58696
I20260709 13:06:08.341693 23304 ts_tablet_manager.cc:1929] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:08.342278 23304 log.cc:1199] T 69f070e8e9ed4c95b36baa7f987d1fba P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/69f070e8e9ed4c95b36baa7f987d1fba
I20260709 13:06:08.344246 23304 tablet_replica.cc:333] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:06:08.344173 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 69f070e8e9ed4c95b36baa7f987d1fba (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:08.345487 23304 raft_consensus.cc:2243] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:08.346094 23304 raft_consensus.cc:2272] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:08.349143 23304 ts_tablet_manager.cc:1916] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:08.360642 23304 ts_tablet_manager.cc:1929] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:08.360954 23304 log.cc:1199] T 4d46675566504843a14e59e2035629c3 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/4d46675566504843a14e59e2035629c3
I20260709 13:06:08.362164 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 4d46675566504843a14e59e2035629c3 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:09.405879 22576 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:09.412096 22504 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:09.412650 22547 consensus_peers.cc:597] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7dae4a3a8e0e4e2e97b920c88a3fb020. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.412675 22425 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:09.413640 23306 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.414565 23301 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.421759 23306 raft_consensus.cc:2955] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.424535 22504 raft_consensus.cc:2955] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.427713 22425 raft_consensus.cc:2955] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.440434 22504 consensus_queue.cc:237] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:09.441219 22331 catalog_manager.cc:5697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:06:09.456645 22473 consensus_peers.cc:597] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94be7e6c95554db88c30fee7a3db405f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.457226 22576 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:09.458755 23279 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.459201 22433 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:09.460639 23277 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.470574 23032 raft_consensus.cc:2955] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.473934 22433 raft_consensus.cc:2955] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.477353 22576 raft_consensus.cc:2955] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.487090 22425 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:09.493180 22329 catalog_manager.cc:5697] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:09.494680 22398 consensus_peers.cc:597] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28e7a53997c5479d8edfb755d887f72a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.498011 22582 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:09.499797 23183 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.515523 23319 raft_consensus.cc:2955] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.524703 22504 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:09.526713 23295 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:09.533643 22576 raft_consensus.cc:2955] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.536016 22507 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:09.536819 22504 raft_consensus.cc:2955] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.549981 22331 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:09.559945 22473 consensus_peers.cc:597] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03bee4af77fb4bccad7991b1429bba72. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.560117 22425 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:09.561439 23279 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.563493 22576 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:09.564867 23279 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.574301 23277 raft_consensus.cc:2955] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.576691 22576 raft_consensus.cc:2955] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.593950 22425 raft_consensus.cc:2955] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.625270 22329 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:09.841365 23327 ts_tablet_manager.cc:933] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:09.843559 23327 tablet_copy_client.cc:323] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:06:09.845965 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 7dae4a3a8e0e4e2e97b920c88a3fb020 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:06:09.846426 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 7dae4a3a8e0e4e2e97b920c88a3fb020 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-7dae4a3a8e0e4e2e97b920c88a3fb020
I20260709 13:06:09.853330 22592 tablet_copy_source_session.cc:215] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:09.858223 23327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dae4a3a8e0e4e2e97b920c88a3fb020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:09.872555 23327 tablet_copy_client.cc:806] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:09.873095 23327 tablet_copy_client.cc:670] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:09.890298 23327 tablet_copy_client.cc:538] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:09.896970 23327 tablet_bootstrap.cc:492] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:09.920610 23327 tablet_bootstrap.cc:492] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:09.921555 23327 tablet_bootstrap.cc:492] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:09.922145 23327 ts_tablet_manager.cc:1403] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:06:09.924506 23327 raft_consensus.cc:359] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:09.925174 23327 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:09.925855 23327 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:09.929530 23327 ts_tablet_manager.cc:1434] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:09.931236 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-7dae4a3a8e0e4e2e97b920c88a3fb020 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:06:09.931685 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-7dae4a3a8e0e4e2e97b920c88a3fb020 on tablet 7dae4a3a8e0e4e2e97b920c88a3fb020 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:09.960547 23327 ts_tablet_manager.cc:933] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:09.962031 23327 tablet_copy_client.cc:323] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:09.963761 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 03bee4af77fb4bccad7991b1429bba72 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:09.964218 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 03bee4af77fb4bccad7991b1429bba72 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-03bee4af77fb4bccad7991b1429bba72
I20260709 13:06:09.970281 22517 tablet_copy_source_session.cc:215] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:09.974073 23327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bee4af77fb4bccad7991b1429bba72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:09.988760 23327 tablet_copy_client.cc:806] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:09.989372 23327 tablet_copy_client.cc:670] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:09.992769 23327 tablet_copy_client.cc:538] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:10.002055 23327 tablet_bootstrap.cc:492] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:10.014596 23332 ts_tablet_manager.cc:933] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:10.017820 23332 tablet_copy_client.cc:323] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:10.019641 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 94be7e6c95554db88c30fee7a3db405f from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:10.020187 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 94be7e6c95554db88c30fee7a3db405f from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-94be7e6c95554db88c30fee7a3db405f
I20260709 13:06:10.022646 23327 tablet_bootstrap.cc:492] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:10.023609 23327 tablet_bootstrap.cc:492] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:10.024319 23327 ts_tablet_manager.cc:1403] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.001s
I20260709 13:06:10.027712 23327 raft_consensus.cc:359] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:10.028573 22517 tablet_copy_source_session.cc:215] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:10.028825 23327 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:10.029558 23327 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:10.033281 23327 ts_tablet_manager.cc:1434] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:06:10.034775 23332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94be7e6c95554db88c30fee7a3db405f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:10.039431 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-03bee4af77fb4bccad7991b1429bba72 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:10.039980 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-03bee4af77fb4bccad7991b1429bba72 on tablet 03bee4af77fb4bccad7991b1429bba72 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:10.050494 23332 tablet_copy_client.cc:806] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:10.051090 23332 tablet_copy_client.cc:670] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:10.054718 23332 tablet_copy_client.cc:538] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:10.063901 23332 tablet_bootstrap.cc:492] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:10.086578 23332 tablet_bootstrap.cc:492] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:10.087529 23332 tablet_bootstrap.cc:492] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:10.088243 23332 ts_tablet_manager.cc:1403] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 13:06:10.091271 23332 raft_consensus.cc:359] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:10.092123 23332 raft_consensus.cc:740] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:10.092797 23332 consensus_queue.cc:260] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:10.096035 23327 ts_tablet_manager.cc:933] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
I20260709 13:06:10.096277 23332 ts_tablet_manager.cc:1434] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:10.098214 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-94be7e6c95554db88c30fee7a3db405f received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:10.098655 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-94be7e6c95554db88c30fee7a3db405f on tablet 94be7e6c95554db88c30fee7a3db405f with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:10.099212 23327 tablet_copy_client.cc:323] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.1:43859
I20260709 13:06:10.102728 22443 tablet_copy_service.cc:140] P e32ba8e6132b4f8e98a99066b6fffe05: Received BeginTabletCopySession request for tablet 28e7a53997c5479d8edfb755d887f72a from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:34614)
I20260709 13:06:10.103293 22443 tablet_copy_service.cc:161] P e32ba8e6132b4f8e98a99066b6fffe05: Beginning new tablet copy session on tablet 28e7a53997c5479d8edfb755d887f72a from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:34614: session id = 9cea93fb03e04e48a6dabc4094ee7c93-28e7a53997c5479d8edfb755d887f72a
I20260709 13:06:10.111464 22443 tablet_copy_source_session.cc:215] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:10.117245 23327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e7a53997c5479d8edfb755d887f72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:10.142684 23327 tablet_copy_client.cc:806] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:10.143332 23327 tablet_copy_client.cc:670] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:10.156242 23327 tablet_copy_client.cc:538] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:10.181809 23327 tablet_bootstrap.cc:492] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
W20260709 13:06:10.199824 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 59950.1us
I20260709 13:06:10.220098 23327 tablet_bootstrap.cc:492] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:10.220880 23327 tablet_bootstrap.cc:492] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:10.221398 23327 ts_tablet_manager.cc:1403] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.008s
I20260709 13:06:10.223996 23327 raft_consensus.cc:359] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:10.224735 23327 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:10.225312 23327 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:10.227022 23327 ts_tablet_manager.cc:1434] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:10.228575 22443 tablet_copy_service.cc:342] P e32ba8e6132b4f8e98a99066b6fffe05: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-28e7a53997c5479d8edfb755d887f72a received from {username='slave'} at 127.0.0.1:34614
I20260709 13:06:10.229017 22443 tablet_copy_service.cc:434] P e32ba8e6132b4f8e98a99066b6fffe05: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-28e7a53997c5479d8edfb755d887f72a on tablet 28e7a53997c5479d8edfb755d887f72a with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:10.298013 23113 raft_consensus.cc:1217] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:10.395658 23113 raft_consensus.cc:1217] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:10.424062 23113 raft_consensus.cc:1217] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:10.478529 23113 raft_consensus.cc:1217] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:10.850025 23339 raft_consensus.cc:1064] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:10.852733 23339 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:10.859583 23113 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.860152 22576 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.860591 22433 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.861155 23339 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:10.862169 23340 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:10.863035 23338 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:10.892915 23339 raft_consensus.cc:2955] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:10.898931 22425 raft_consensus.cc:2955] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:10.900718 23306 raft_consensus.cc:1064] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:10.908519 23306 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:10.921741 22327 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:10.901290 23113 raft_consensus.cc:2955] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:10.927191 22582 raft_consensus.cc:2955] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:10.931277 23321 raft_consensus.cc:1064] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:10.950474 22507 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.951126 23321 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:10.954172 22425 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.962762 23344 raft_consensus.cc:1064] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:10.938298 23112 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.965801 23344 consensus_queue.cc:237] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:10.968338 23351 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:10.970520 23351 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:10.972889 23112 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.972414 23351 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:10.974639 23295 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:10.988359 22429 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.991966 23340 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:11.000236 22576 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.013348 23112 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.015169 23344 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.016819 23340 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.021984 22578 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.022281 22504 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.023980 23295 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.026716 23321 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.063943 23351 raft_consensus.cc:2955] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.065503 23109 raft_consensus.cc:2955] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.081089 22507 raft_consensus.cc:2955] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.088126 22433 raft_consensus.cc:2955] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.138159 22504 raft_consensus.cc:2955] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.147024 22578 raft_consensus.cc:2955] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.092376 23338 raft_consensus.cc:2955] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.109138 22429 raft_consensus.cc:2955] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.130923 23295 raft_consensus.cc:2955] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:06:11.158869 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44863.9us
I20260709 13:06:11.160538 23112 raft_consensus.cc:2955] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.174540 23111 raft_consensus.cc:2955] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.178086 22578 raft_consensus.cc:2955] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.185595 22504 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:11.188613 22328 catalog_manager.cc:5697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:11.191650 23112 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.193375 23339 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.201898 23368 raft_consensus.cc:2955] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.205375 23113 raft_consensus.cc:2955] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.201872 22429 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.226415 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03bee4af77fb4bccad7991b1429bba72 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:11.231199 22331 catalog_manager.cc:5697] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.233127 23339 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.238144 22578 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:11.245311 23111 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.245600 22504 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.246873 23351 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.247881 23348 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.248971 22329 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:11.266948 22429 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:11.270668 22330 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.281174 22433 raft_consensus.cc:2955] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.279448 23301 raft_consensus.cc:2955] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.288829 23111 raft_consensus.cc:2955] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.290402 23112 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.302513 23337 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.312661 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7dae4a3a8e0e4e2e97b920c88a3fb020 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:11.324949 23373 raft_consensus.cc:2955] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.337343 23113 raft_consensus.cc:2955] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.293814 22578 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.348613 23295 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.350754 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet 03bee4af77fb4bccad7991b1429bba72 with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49180
I20260709 13:06:11.358944 22576 raft_consensus.cc:2955] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.293129 22504 raft_consensus.cc:2955] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.378717 22327 catalog_manager.cc:5697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.388749 22507 consensus_queue.cc:237] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:11.395216 23375 tablet_replica.cc:333] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:06:11.396304 23375 raft_consensus.cc:2243] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.397317 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dae4a3a8e0e4e2e97b920c88a3fb020 with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:06:11.404299 22330 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.405208 23376 tablet_replica.cc:333] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:06:11.406607 23376 raft_consensus.cc:2243] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.407400 23376 raft_consensus.cc:2272] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.412364 23376 ts_tablet_manager.cc:1916] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:11.423422 22494 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e7a53997c5479d8edfb755d887f72a with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58696
I20260709 13:06:11.397177 23375 raft_consensus.cc:2272] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.432622 23376 ts_tablet_manager.cc:1929] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:11.433310 23376 log.cc:1199] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/7dae4a3a8e0e4e2e97b920c88a3fb020
I20260709 13:06:11.435076 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet 7dae4a3a8e0e4e2e97b920c88a3fb020 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:11.436379 23378 tablet_replica.cc:333] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:06:11.437556 23378 raft_consensus.cc:2243] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.445573 23113 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.447871 23375 ts_tablet_manager.cc:1916] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:11.448014 23338 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.452065 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28e7a53997c5479d8edfb755d887f72a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:11.463876 23378 raft_consensus.cc:2272] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.462976 23344 raft_consensus.cc:2955] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.466387 23111 raft_consensus.cc:2955] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.477991 22582 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.479624 23368 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.502619 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94be7e6c95554db88c30fee7a3db405f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:11.506883 23375 ts_tablet_manager.cc:1929] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:11.506176 22576 raft_consensus.cc:2955] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:11.507654 23375 log.cc:1199] T 03bee4af77fb4bccad7991b1429bba72 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/03bee4af77fb4bccad7991b1429bba72
I20260709 13:06:11.514734 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet 03bee4af77fb4bccad7991b1429bba72 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:11.516223 22327 catalog_manager.cc:5697] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:11.534853 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet 94be7e6c95554db88c30fee7a3db405f with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:06:11.536070 23376 tablet_replica.cc:333] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:06:11.537417 23376 raft_consensus.cc:2243] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.537798 23378 ts_tablet_manager.cc:1916] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:11.538455 23376 raft_consensus.cc:2272] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.542965 23376 ts_tablet_manager.cc:1916] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:11.558835 23378 ts_tablet_manager.cc:1929] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:11.559355 23378 log.cc:1199] T 28e7a53997c5479d8edfb755d887f72a P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/28e7a53997c5479d8edfb755d887f72a
I20260709 13:06:11.561120 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 28e7a53997c5479d8edfb755d887f72a (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:11.569278 23376 ts_tablet_manager.cc:1929] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:11.569787 23376 log.cc:1199] T 94be7e6c95554db88c30fee7a3db405f P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/94be7e6c95554db88c30fee7a3db405f
I20260709 13:06:11.571283 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet 94be7e6c95554db88c30fee7a3db405f (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:12.601475 22433 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:12.608553 22398 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd39ff0031394113b2b75f15cd7c44a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.608601 22582 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.610217 23373 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.619988 22504 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.622320 23373 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.628690 23295 raft_consensus.cc:2955] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.630379 22582 raft_consensus.cc:2955] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.632556 22504 raft_consensus.cc:2955] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.645155 22506 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:12.649463 22330 catalog_manager.cc:5697] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:06:12.655100 22473 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0a2c1c9e9dd4272a78e7cd3da913fad. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.656843 22582 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.658601 22425 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.659929 23344 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.662011 23338 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.691443 23338 raft_consensus.cc:2955] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.693645 22429 raft_consensus.cc:2955] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.693403 22582 raft_consensus.cc:2955] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.713609 22506 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:12.731228 22328 catalog_manager.cc:5697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:12.737772 22473 consensus_peers.cc:597] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b2c58309c5440b19fa96cbeb5491c79. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.738284 22576 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.742514 22429 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.744231 23338 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.751523 23383 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.757709 23385 raft_consensus.cc:2955] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.767246 22425 raft_consensus.cc:2955] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.773195 22576 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:12.765971 22582 raft_consensus.cc:2955] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:06:12.791661 22547 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3cb0890d5a7741bd8793d654027263a2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.792410 22327 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.796018 22425 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.796885 22506 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.797540 23351 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.798830 23301 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.820595 23301 raft_consensus.cc:2955] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.823325 22506 raft_consensus.cc:2955] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:12.845638 22327 catalog_manager.cc:5697] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.850440 22425 raft_consensus.cc:2955] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:13.017985 23400 ts_tablet_manager.cc:933] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
I20260709 13:06:13.019820 23400 tablet_copy_client.cc:323] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.1:43859
I20260709 13:06:13.021608 22443 tablet_copy_service.cc:140] P e32ba8e6132b4f8e98a99066b6fffe05: Received BeginTabletCopySession request for tablet bd39ff0031394113b2b75f15cd7c44a4 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:34614)
I20260709 13:06:13.022099 22443 tablet_copy_service.cc:161] P e32ba8e6132b4f8e98a99066b6fffe05: Beginning new tablet copy session on tablet bd39ff0031394113b2b75f15cd7c44a4 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:34614: session id = 9cea93fb03e04e48a6dabc4094ee7c93-bd39ff0031394113b2b75f15cd7c44a4
I20260709 13:06:13.027277 22443 tablet_copy_source_session.cc:215] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:13.030355 23400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd39ff0031394113b2b75f15cd7c44a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.044622 23400 tablet_copy_client.cc:806] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:13.045279 23400 tablet_copy_client.cc:670] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:13.053517 23400 tablet_copy_client.cc:538] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:13.063651 23400 tablet_bootstrap.cc:492] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:13.089454 23400 tablet_bootstrap.cc:492] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:13.090487 23400 tablet_bootstrap.cc:492] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:13.091217 23400 ts_tablet_manager.cc:1403] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.000s
I20260709 13:06:13.094383 23400 raft_consensus.cc:359] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:13.095301 23400 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:13.096010 23400 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:13.099561 23400 ts_tablet_manager.cc:1434] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:13.101536 22443 tablet_copy_service.cc:342] P e32ba8e6132b4f8e98a99066b6fffe05: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-bd39ff0031394113b2b75f15cd7c44a4 received from {username='slave'} at 127.0.0.1:34614
I20260709 13:06:13.101958 22443 tablet_copy_service.cc:434] P e32ba8e6132b4f8e98a99066b6fffe05: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-bd39ff0031394113b2b75f15cd7c44a4 on tablet bd39ff0031394113b2b75f15cd7c44a4 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:13.116441 23400 ts_tablet_manager.cc:933] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:13.119113 23400 tablet_copy_client.cc:323] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:13.123376 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 2b2c58309c5440b19fa96cbeb5491c79 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:13.123931 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 2b2c58309c5440b19fa96cbeb5491c79 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-2b2c58309c5440b19fa96cbeb5491c79
I20260709 13:06:13.131248 22517 tablet_copy_source_session.cc:215] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:13.134608 23400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2c58309c5440b19fa96cbeb5491c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.152114 23400 tablet_copy_client.cc:806] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:13.152822 23400 tablet_copy_client.cc:670] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:13.155041 23405 ts_tablet_manager.cc:933] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:13.158334 23405 tablet_copy_client.cc:323] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:13.159365 23400 tablet_copy_client.cc:538] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:13.160894 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet e0a2c1c9e9dd4272a78e7cd3da913fad from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:13.161448 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet e0a2c1c9e9dd4272a78e7cd3da913fad from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-e0a2c1c9e9dd4272a78e7cd3da913fad
I20260709 13:06:13.167037 23400 tablet_bootstrap.cc:492] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:13.168717 22517 tablet_copy_source_session.cc:215] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:13.172794 23405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a2c1c9e9dd4272a78e7cd3da913fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.192117 23405 tablet_copy_client.cc:806] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:13.193006 23405 tablet_copy_client.cc:670] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:13.194401 23400 tablet_bootstrap.cc:492] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:13.196455 23400 tablet_bootstrap.cc:492] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:13.196810 23405 tablet_copy_client.cc:538] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:13.197561 23400 ts_tablet_manager.cc:1403] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.031s	user 0.026s	sys 0.004s
I20260709 13:06:13.201464 23400 raft_consensus.cc:359] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:13.202319 23400 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:13.202972 23400 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:13.205468 23400 ts_tablet_manager.cc:1434] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:13.207108 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-2b2c58309c5440b19fa96cbeb5491c79 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:13.207547 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-2b2c58309c5440b19fa96cbeb5491c79 on tablet 2b2c58309c5440b19fa96cbeb5491c79 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:13.213585 23405 tablet_bootstrap.cc:492] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:13.256934 23405 tablet_bootstrap.cc:492] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:13.257704 23405 tablet_bootstrap.cc:492] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:13.258257 23405 ts_tablet_manager.cc:1403] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.003s
I20260709 13:06:13.260437 23405 raft_consensus.cc:359] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:13.261090 23405 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:13.261623 23405 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:13.263499 23405 ts_tablet_manager.cc:1434] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:06:13.265228 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-e0a2c1c9e9dd4272a78e7cd3da913fad received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:13.265614 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-e0a2c1c9e9dd4272a78e7cd3da913fad on tablet e0a2c1c9e9dd4272a78e7cd3da913fad with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:13.347368 23405 ts_tablet_manager.cc:933] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:13.349200 23405 tablet_copy_client.cc:323] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:06:13.350903 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 3cb0890d5a7741bd8793d654027263a2 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:06:13.351504 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 3cb0890d5a7741bd8793d654027263a2 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-3cb0890d5a7741bd8793d654027263a2
I20260709 13:06:13.361970 22592 tablet_copy_source_session.cc:215] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:13.367543 23405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb0890d5a7741bd8793d654027263a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.378965 23405 tablet_copy_client.cc:806] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:13.379561 23405 tablet_copy_client.cc:670] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:13.383028 23405 tablet_copy_client.cc:538] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:13.401057 23405 tablet_bootstrap.cc:492] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:13.434784 23405 tablet_bootstrap.cc:492] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:13.435676 23405 tablet_bootstrap.cc:492] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:13.436510 23405 ts_tablet_manager.cc:1403] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.010s
I20260709 13:06:13.439364 23405 raft_consensus.cc:359] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:13.440289 23405 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:13.441016 23405 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:13.443960 23405 ts_tablet_manager.cc:1434] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:13.446183 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-3cb0890d5a7741bd8793d654027263a2 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:06:13.446614 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-3cb0890d5a7741bd8793d654027263a2 on tablet 3cb0890d5a7741bd8793d654027263a2 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:13.559675 23113 raft_consensus.cc:1217] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:13.716638 23111 raft_consensus.cc:1217] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:13.736189 23111 raft_consensus.cc:1217] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:13.939293 23295 raft_consensus.cc:1064] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:13.941316 23295 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:13.949743 23111 raft_consensus.cc:1217] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:13.950745 23113 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.952174 23411 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.974670 22506 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.976704 22576 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.976711 23373 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:13.980036 23373 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.998518 23295 raft_consensus.cc:2955] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.000198 22506 raft_consensus.cc:2955] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.008129 22582 raft_consensus.cc:2955] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.018188 22330 catalog_manager.cc:5697] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.023120 23111 raft_consensus.cc:2955] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.060602 22429 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:14.068132 23111 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.069384 23373 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.072548 22582 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.076619 23373 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.086171 23295 raft_consensus.cc:2955] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.096735 23111 raft_consensus.cc:2955] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.104255 23415 raft_consensus.cc:1064] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:14.107057 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd39ff0031394113b2b75f15cd7c44a4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.109947 22576 raft_consensus.cc:2955] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.110176 23415 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:14.122392 22328 catalog_manager.cc:5697] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.137105 22494 tablet_service.cc:1558] Processing DeleteTablet for tablet bd39ff0031394113b2b75f15cd7c44a4 with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58696
I20260709 13:06:14.139289 23424 tablet_replica.cc:333] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:06:14.143209 23424 raft_consensus.cc:2243] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.144330 23424 raft_consensus.cc:2272] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.154438 23424 ts_tablet_manager.cc:1916] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.187337 23113 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.188823 22576 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.189949 23385 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.190917 23415 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.191908 22425 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.197636 23417 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.200558 23424 ts_tablet_manager.cc:1929] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.201135 23424 log.cc:1199] T bd39ff0031394113b2b75f15cd7c44a4 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/bd39ff0031394113b2b75f15cd7c44a4
I20260709 13:06:14.202685 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet bd39ff0031394113b2b75f15cd7c44a4 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:14.236533 23417 raft_consensus.cc:2955] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.238133 22425 raft_consensus.cc:2955] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.255652 22576 raft_consensus.cc:2955] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.257884 23113 raft_consensus.cc:2955] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.260337 22327 catalog_manager.cc:5697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.268174 23385 raft_consensus.cc:1064] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:14.270645 23385 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:14.295396 22507 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:14.301832 23111 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.303364 23395 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.304551 22577 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.306200 23338 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.314359 22433 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.316990 23395 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.327425 22429 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.329276 23113 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.330021 23338 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:14.330983 23417 raft_consensus.cc:2955] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.331875 23385 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:14.337215 23111 raft_consensus.cc:2955] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.344211 23395 raft_consensus.cc:2955] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.351109 22429 raft_consensus.cc:2955] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.375916 22329 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.379478 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0a2c1c9e9dd4272a78e7cd3da913fad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.379040 23111 raft_consensus.cc:2955] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.372078 22425 raft_consensus.cc:2955] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.395882 22330 catalog_manager.cc:5697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.401839 22582 raft_consensus.cc:2955] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.411320 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet e0a2c1c9e9dd4272a78e7cd3da913fad with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49180
I20260709 13:06:14.416119 23433 tablet_replica.cc:333] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:06:14.417277 23433 raft_consensus.cc:2243] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.418181 23433 raft_consensus.cc:2272] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.424652 23433 ts_tablet_manager.cc:1916] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.439618 22507 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:14.452033 23433 ts_tablet_manager.cc:1929] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.453176 23433 log.cc:1199] T e0a2c1c9e9dd4272a78e7cd3da913fad P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/e0a2c1c9e9dd4272a78e7cd3da913fad
I20260709 13:06:14.454941 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet e0a2c1c9e9dd4272a78e7cd3da913fad (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:14.457654 23111 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.459779 23415 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.465338 22576 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.478376 23415 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.483242 23432 raft_consensus.cc:2955] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.486500 23113 raft_consensus.cc:2955] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.492787 22576 raft_consensus.cc:2955] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.494868 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b2c58309c5440b19fa96cbeb5491c79 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.503782 23301 raft_consensus.cc:1064] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:14.503219 22329 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.508203 23301 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:14.533838 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b2c58309c5440b19fa96cbeb5491c79 with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:06:14.545235 22425 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.549247 23399 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.555744 23435 tablet_replica.cc:333] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:06:14.556945 23435 raft_consensus.cc:2243] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.557289 23111 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.557900 23435 raft_consensus.cc:2272] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.558974 23399 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.566618 23435 ts_tablet_manager.cc:1916] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.575420 22506 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.581358 23436 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.584178 23301 raft_consensus.cc:2955] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.589237 23111 raft_consensus.cc:2955] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.594982 22425 raft_consensus.cc:2955] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.605525 22507 raft_consensus.cc:2955] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.605741 22330 catalog_manager.cc:5697] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.645442 22576 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:14.651418 23435 ts_tablet_manager.cc:1929] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.651643 22425 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.652012 23435 log.cc:1199] T 2b2c58309c5440b19fa96cbeb5491c79 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/2b2c58309c5440b19fa96cbeb5491c79
I20260709 13:06:14.654502 23112 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.654553 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet 2b2c58309c5440b19fa96cbeb5491c79 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:14.654747 23437 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:14.657099 23437 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.662169 23399 raft_consensus.cc:2955] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.668073 22425 raft_consensus.cc:2955] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.674774 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3cb0890d5a7741bd8793d654027263a2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.676003 23112 raft_consensus.cc:2955] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:14.682904 22329 catalog_manager.cc:5697] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.695663 22494 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cb0890d5a7741bd8793d654027263a2 with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58696
I20260709 13:06:14.696574 23424 tablet_replica.cc:333] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:06:14.697503 23424 raft_consensus.cc:2243] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.698230 23424 raft_consensus.cc:2272] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.701820 23424 ts_tablet_manager.cc:1916] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.716658 23424 ts_tablet_manager.cc:1929] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.717083 23424 log.cc:1199] T 3cb0890d5a7741bd8793d654027263a2 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/3cb0890d5a7741bd8793d654027263a2
I20260709 13:06:14.718398 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 3cb0890d5a7741bd8793d654027263a2 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:15.768373 22507 consensus_queue.cc:237] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:15.776811 22473 consensus_peers.cc:597] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bdd4b2c523374ff98c16360fa254608c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.778015 22425 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.780894 22582 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.782562 23385 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.785979 23417 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.793644 23415 raft_consensus.cc:2955] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.796248 22582 raft_consensus.cc:2955] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.797673 22428 raft_consensus.cc:2955] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.815574 22330 catalog_manager.cc:5697] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.837844 22507 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:15.850322 22428 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:15.851711 22473 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73e134e5a00e463595325b431f07a3bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.852183 23417 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.853631 22576 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.855593 23417 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.861671 23445 raft_consensus.cc:2955] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.863878 22425 raft_consensus.cc:2955] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.867659 22576 raft_consensus.cc:2955] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.880960 22507 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:15.885691 22329 catalog_manager.cc:5697] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:06:15.900825 22473 consensus_peers.cc:597] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69914642ad6d43889fea43ca1c6697f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.901588 22425 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.903008 22582 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.903007 23415 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:15.905988 23415 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.921113 23385 raft_consensus.cc:2955] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.925859 22425 raft_consensus.cc:2955] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.926327 22582 raft_consensus.cc:2955] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.935412 22576 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:15.944008 22327 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:15.953537 22547 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2647750dc34142bf8dd2c7a3bd334fc4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.954659 22507 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.958424 22428 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.959349 23437 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.961617 23437 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.971926 23399 raft_consensus.cc:2955] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.973596 22425 raft_consensus.cc:2955] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.974030 22507 raft_consensus.cc:2955] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:15.993009 22329 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:16.280786 23461 ts_tablet_manager.cc:933] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:16.283519 23461 tablet_copy_client.cc:323] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:16.285303 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 73e134e5a00e463595325b431f07a3bd from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:16.285894 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 73e134e5a00e463595325b431f07a3bd from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-73e134e5a00e463595325b431f07a3bd
I20260709 13:06:16.293263 22517 tablet_copy_source_session.cc:215] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.296873 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e134e5a00e463595325b431f07a3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.310246 23461 tablet_copy_client.cc:806] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.310734 23461 tablet_copy_client.cc:670] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.314452 23461 tablet_copy_client.cc:538] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.322727 23461 tablet_bootstrap.cc:492] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:16.342805 23461 tablet_bootstrap.cc:492] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.343636 23461 tablet_bootstrap.cc:492] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:16.344343 23461 ts_tablet_manager.cc:1403] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.008s
I20260709 13:06:16.346637 23461 raft_consensus.cc:359] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:16.347452 23461 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:16.348093 23461 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:16.352912 23461 ts_tablet_manager.cc:1434] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:16.355187 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-73e134e5a00e463595325b431f07a3bd received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:16.355631 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-73e134e5a00e463595325b431f07a3bd on tablet 73e134e5a00e463595325b431f07a3bd with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:16.376883 23461 ts_tablet_manager.cc:933] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:16.380640 23461 tablet_copy_client.cc:323] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:16.382479 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet bdd4b2c523374ff98c16360fa254608c from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:16.383028 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet bdd4b2c523374ff98c16360fa254608c from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-bdd4b2c523374ff98c16360fa254608c
I20260709 13:06:16.388253 23466 ts_tablet_manager.cc:933] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:16.393121 22517 tablet_copy_source_session.cc:215] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.396589 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd4b2c523374ff98c16360fa254608c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.397101 23466 tablet_copy_client.cc:323] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:16.402961 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 69914642ad6d43889fea43ca1c6697f4 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:16.403546 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 69914642ad6d43889fea43ca1c6697f4 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-69914642ad6d43889fea43ca1c6697f4
I20260709 13:06:16.411530 22517 tablet_copy_source_session.cc:215] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.414511 23461 tablet_copy_client.cc:806] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.415165 23461 tablet_copy_client.cc:670] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.427137 23461 tablet_copy_client.cc:538] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.421837 23466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69914642ad6d43889fea43ca1c6697f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.440456 23461 tablet_bootstrap.cc:492] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:16.453091 23466 tablet_copy_client.cc:806] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.453672 23466 tablet_copy_client.cc:670] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.457742 23466 tablet_copy_client.cc:538] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.462632 23461 tablet_bootstrap.cc:492] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.463601 23461 tablet_bootstrap.cc:492] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:16.464520 23461 ts_tablet_manager.cc:1403] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.024s	user 0.023s	sys 0.001s
I20260709 13:06:16.467351 23466 tablet_bootstrap.cc:492] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:16.468444 23461 raft_consensus.cc:359] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:16.469343 23461 raft_consensus.cc:740] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:16.470017 23461 consensus_queue.cc:260] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:16.472422 23461 ts_tablet_manager.cc:1434] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:06:16.474609 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-bdd4b2c523374ff98c16360fa254608c received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:16.475050 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-bdd4b2c523374ff98c16360fa254608c on tablet bdd4b2c523374ff98c16360fa254608c with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:16.497470 23466 tablet_bootstrap.cc:492] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.498358 23466 tablet_bootstrap.cc:492] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:16.499084 23466 ts_tablet_manager.cc:1403] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.009s
I20260709 13:06:16.501981 23466 raft_consensus.cc:359] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:16.502761 23466 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:16.503589 23466 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:16.505710 23466 ts_tablet_manager.cc:1434] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:06:16.507751 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-69914642ad6d43889fea43ca1c6697f4 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:16.508173 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-69914642ad6d43889fea43ca1c6697f4 on tablet 69914642ad6d43889fea43ca1c6697f4 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:16.523154 23466 ts_tablet_manager.cc:933] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:16.525913 23466 tablet_copy_client.cc:323] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:06:16.527309 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 2647750dc34142bf8dd2c7a3bd334fc4 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:06:16.527773 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 2647750dc34142bf8dd2c7a3bd334fc4 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-2647750dc34142bf8dd2c7a3bd334fc4
I20260709 13:06:16.533025 22592 tablet_copy_source_session.cc:215] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.536321 23466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2647750dc34142bf8dd2c7a3bd334fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.549996 23466 tablet_copy_client.cc:806] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.550627 23466 tablet_copy_client.cc:670] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.554802 23466 tablet_copy_client.cc:538] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.566913 23466 tablet_bootstrap.cc:492] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:16.613656 23466 tablet_bootstrap.cc:492] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.614636 23466 tablet_bootstrap.cc:492] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:16.615242 23466 ts_tablet_manager.cc:1403] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.049s	user 0.025s	sys 0.020s
I20260709 13:06:16.617790 23466 raft_consensus.cc:359] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:16.618603 23466 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:16.619120 23466 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:16.621491 23466 ts_tablet_manager.cc:1434] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:06:16.623363 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-2647750dc34142bf8dd2c7a3bd334fc4 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:06:16.623796 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-2647750dc34142bf8dd2c7a3bd334fc4 on tablet 2647750dc34142bf8dd2c7a3bd334fc4 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:16.744954 23111 raft_consensus.cc:1217] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.862757 23111 raft_consensus.cc:1217] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.968505 23111 raft_consensus.cc:1217] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.969772 23112 raft_consensus.cc:1217] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.283253 23474 raft_consensus.cc:1064] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:17.287070 23474 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:17.295709 23111 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.296981 22582 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.297940 22428 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.299562 23474 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.301513 23415 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.302536 23445 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.322890 23445 raft_consensus.cc:2955] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.327275 23111 raft_consensus.cc:2955] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.346127 22578 raft_consensus.cc:2955] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.348647 22327 catalog_manager.cc:5697] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.370373 23477 raft_consensus.cc:1064] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:17.374002 23477 consensus_queue.cc:237] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:17.380829 23475 raft_consensus.cc:1064] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:17.383677 23475 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:17.404070 22582 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.405285 23111 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.405992 23474 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.406960 22429 raft_consensus.cc:2955] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.408064 23474 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.408928 22424 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.412775 23477 raft_consensus.cc:1064] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:17.415560 23477 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:17.442585 23445 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.444532 22504 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.446156 22428 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.448675 23437 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.455392 23447 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.447357 23111 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.499117 23417 raft_consensus.cc:2955] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.506577 23111 raft_consensus.cc:2955] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.541968 22425 raft_consensus.cc:2955] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.485397 23475 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:06:17.554064 23447 raft_consensus.cc:2955] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.565657 22582 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.567845 23417 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.568048 22577 raft_consensus.cc:2955] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.573472 22504 raft_consensus.cc:2955] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.588296 22425 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.592134 23417 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.593331 22328 catalog_manager.cc:5697] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.588181 23112 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.601210 22424 raft_consensus.cc:2955] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.609274 23417 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.626557 22506 consensus_queue.cc:237] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:17.643231 22507 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:17.646275 22327 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.649812 23111 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.651412 23417 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.652690 23113 raft_consensus.cc:2955] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.660530 23474 raft_consensus.cc:2955] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.667933 23110 raft_consensus.cc:2955] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.673491 23109 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.677578 23385 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:17.680950 22429 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.682188 22582 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.683162 22576 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:17.698311 23415 raft_consensus.cc:2955] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.702499 22429 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.703971 23417 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.707757 23108 raft_consensus.cc:2955] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.716516 23500 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:17.731216 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bdd4b2c523374ff98c16360fa254608c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:06:17.732523 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 100866us
I20260709 13:06:17.741672 23109 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.747860 22329 catalog_manager.cc:5697] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.750389 22577 raft_consensus.cc:2955] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.752751 23475 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.736001 23417 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:06:17.750129 23500 raft_consensus.cc:2955] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.791642 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2647750dc34142bf8dd2c7a3bd334fc4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.804579 22330 catalog_manager.cc:5697] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:06:17.817639 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 52799.3us
W20260709 13:06:17.824813 23499 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:06:17.827028 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet bdd4b2c523374ff98c16360fa254608c with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:06:17.767119 23108 raft_consensus.cc:2955] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.829213 22329 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.832213 22429 raft_consensus.cc:2955] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:06:17.843104 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 77414.1us
I20260709 13:06:17.848658 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73e134e5a00e463595325b431f07a3bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.852620 22428 raft_consensus.cc:2955] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.858855 23477 raft_consensus.cc:2955] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.860226 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet 73e134e5a00e463595325b431f07a3bd with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49180
I20260709 13:06:17.870005 22577 raft_consensus.cc:2955] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.879984 23504 tablet_replica.cc:333] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:06:17.880293 22494 tablet_service.cc:1558] Processing DeleteTablet for tablet 2647750dc34142bf8dd2c7a3bd334fc4 with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58696
I20260709 13:06:17.892608 23504 raft_consensus.cc:2243] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.884688 23505 tablet_replica.cc:333] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:06:17.894263 23505 raft_consensus.cc:2243] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.895262 23505 raft_consensus.cc:2272] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.899044 23505 ts_tablet_manager.cc:1916] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:17.903167 23506 tablet_replica.cc:333] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:06:17.907132 23506 raft_consensus.cc:2243] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.908145 23112 raft_consensus.cc:2955] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.914172 23506 raft_consensus.cc:2272] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.914979 23504 raft_consensus.cc:2272] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.923162 23505 ts_tablet_manager.cc:1929] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:17.923465 23504 ts_tablet_manager.cc:1916] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:17.923928 23505 log.cc:1199] T 73e134e5a00e463595325b431f07a3bd P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/73e134e5a00e463595325b431f07a3bd
I20260709 13:06:17.931681 23506 ts_tablet_manager.cc:1916] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:17.933046 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet 73e134e5a00e463595325b431f07a3bd (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:17.924606 22331 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.956068 22507 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:17.962076 23506 ts_tablet_manager.cc:1929] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:17.962599 23506 log.cc:1199] T 2647750dc34142bf8dd2c7a3bd334fc4 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/2647750dc34142bf8dd2c7a3bd334fc4
I20260709 13:06:17.964931 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 2647750dc34142bf8dd2c7a3bd334fc4 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:17.975322 23504 ts_tablet_manager.cc:1929] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:17.975914 23504 log.cc:1199] T bdd4b2c523374ff98c16360fa254608c P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/bdd4b2c523374ff98c16360fa254608c
I20260709 13:06:17.980356 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet bdd4b2c523374ff98c16360fa254608c (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:17.985796 22576 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.975234 22424 raft_consensus.cc:2955] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:17.997959 23415 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.001919 23112 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.005972 23417 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.012290 23502 raft_consensus.cc:2955] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:18.014635 22577 raft_consensus.cc:2955] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:18.015033 23108 raft_consensus.cc:2955] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:18.024688 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 69914642ad6d43889fea43ca1c6697f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:18.037189 22330 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:18.048274 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet 69914642ad6d43889fea43ca1c6697f4 with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:06:18.049297 23504 tablet_replica.cc:333] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:06:18.076946 23504 raft_consensus.cc:2243] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.077592 23504 raft_consensus.cc:2272] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.080334 23504 ts_tablet_manager.cc:1916] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.092242 23504 ts_tablet_manager.cc:1929] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.092588 23504 log.cc:1199] T 69914642ad6d43889fea43ca1c6697f4 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/69914642ad6d43889fea43ca1c6697f4
I20260709 13:06:18.093927 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet 69914642ad6d43889fea43ca1c6697f4 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:19.126493 22507 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:19.149688 22577 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:19.150707 22473 consensus_peers.cc:597] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c04b0ff4c7da4211acec428ae776775a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.151975 23385 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.153481 22424 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.154633 23385 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.160061 23415 raft_consensus.cc:2955] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.162045 22577 raft_consensus.cc:2955] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.170667 22424 raft_consensus.cc:2955] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.180160 22331 catalog_manager.cc:5697] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.193962 22507 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:19.203218 22473 consensus_peers.cc:597] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78e6dd3ee498418ab0eeb27b3289cdc5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.203346 22578 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.204599 22424 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.205473 23512 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:19.207731 23417 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.217772 23417 raft_consensus.cc:2955] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.220779 22428 raft_consensus.cc:2955] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.228631 22578 raft_consensus.cc:2955] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.232769 22506 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:19.241526 22473 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17ed109556234df2aeba1d6118cc0a95. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.241039 22330 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.242621 22577 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.244338 22428 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.244376 23512 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:19.248294 23512 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.257750 23512 raft_consensus.cc:2955] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.259809 22577 raft_consensus.cc:2955] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.263017 22424 raft_consensus.cc:2955] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.272732 22578 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:19.292116 22547 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c96fcf9d065e46528b502778fede0f1f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.288597 22331 catalog_manager.cc:5697] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.293545 22506 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.295358 22428 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.295954 23475 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.298660 23508 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.309527 23508 raft_consensus.cc:2955] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.311764 22428 raft_consensus.cc:2955] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.315485 22506 raft_consensus.cc:2955] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:19.340564 22331 catalog_manager.cc:5697] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.563467 23526 ts_tablet_manager.cc:933] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:19.568142 23526 tablet_copy_client.cc:323] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:19.570446 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet c04b0ff4c7da4211acec428ae776775a from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:19.571062 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet c04b0ff4c7da4211acec428ae776775a from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-c04b0ff4c7da4211acec428ae776775a
I20260709 13:06:19.578442 22517 tablet_copy_source_session.cc:215] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:19.581993 23526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04b0ff4c7da4211acec428ae776775a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.596930 23526 tablet_copy_client.cc:806] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:19.597602 23526 tablet_copy_client.cc:670] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:19.601408 23526 tablet_copy_client.cc:538] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:19.611845 23526 tablet_bootstrap.cc:492] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:19.634090 23526 tablet_bootstrap.cc:492] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:19.635068 23526 tablet_bootstrap.cc:492] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:19.635764 23526 ts_tablet_manager.cc:1403] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 13:06:19.638919 23526 raft_consensus.cc:359] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:19.639783 23526 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:19.640535 23526 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:19.644315 23526 ts_tablet_manager.cc:1434] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.004s
I20260709 13:06:19.646435 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-c04b0ff4c7da4211acec428ae776775a received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:19.646952 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-c04b0ff4c7da4211acec428ae776775a on tablet c04b0ff4c7da4211acec428ae776775a with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:19.650440 23526 ts_tablet_manager.cc:933] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:19.656636 23526 tablet_copy_client.cc:323] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:19.658576 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 17ed109556234df2aeba1d6118cc0a95 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:19.659053 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 17ed109556234df2aeba1d6118cc0a95 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-17ed109556234df2aeba1d6118cc0a95
I20260709 13:06:19.666145 22517 tablet_copy_source_session.cc:215] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:19.673590 23526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ed109556234df2aeba1d6118cc0a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.695945 23531 ts_tablet_manager.cc:933] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:19.705770 23526 tablet_copy_client.cc:806] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:19.707419 23526 tablet_copy_client.cc:670] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:19.715183 23526 tablet_copy_client.cc:538] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:19.723300 23531 tablet_copy_client.cc:323] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:19.730975 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 78e6dd3ee498418ab0eeb27b3289cdc5 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:19.731566 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 78e6dd3ee498418ab0eeb27b3289cdc5 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-78e6dd3ee498418ab0eeb27b3289cdc5
I20260709 13:06:19.731986 23526 tablet_bootstrap.cc:492] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:19.741283 22517 tablet_copy_source_session.cc:215] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:19.750449 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e6dd3ee498418ab0eeb27b3289cdc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.757539 23526 tablet_bootstrap.cc:492] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:19.758457 23526 tablet_bootstrap.cc:492] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:19.759083 23526 ts_tablet_manager.cc:1403] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260709 13:06:19.761575 23526 raft_consensus.cc:359] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:19.762396 23526 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:19.763039 23526 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:19.770308 23526 ts_tablet_manager.cc:1434] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:06:19.772082 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-17ed109556234df2aeba1d6118cc0a95 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:19.772554 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-17ed109556234df2aeba1d6118cc0a95 on tablet 17ed109556234df2aeba1d6118cc0a95 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:19.773679 23531 tablet_copy_client.cc:806] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:19.774292 23531 tablet_copy_client.cc:670] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:19.783519 23531 tablet_copy_client.cc:538] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:19.793471 23531 tablet_bootstrap.cc:492] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:19.809005 23526 ts_tablet_manager.cc:933] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:19.810911 23526 tablet_copy_client.cc:323] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:06:19.812968 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet c96fcf9d065e46528b502778fede0f1f from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:06:19.813519 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet c96fcf9d065e46528b502778fede0f1f from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-c96fcf9d065e46528b502778fede0f1f
I20260709 13:06:19.815953 23531 tablet_bootstrap.cc:492] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:19.817164 23531 tablet_bootstrap.cc:492] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:19.817860 23531 ts_tablet_manager.cc:1403] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 13:06:19.820959 23531 raft_consensus.cc:359] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:19.821811 23531 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:19.822440 23531 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:19.826996 23531 ts_tablet_manager.cc:1434] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:06:19.829003 22592 tablet_copy_source_session.cc:215] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:19.829250 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-78e6dd3ee498418ab0eeb27b3289cdc5 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:19.829685 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-78e6dd3ee498418ab0eeb27b3289cdc5 on tablet 78e6dd3ee498418ab0eeb27b3289cdc5 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:19.836196 23526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96fcf9d065e46528b502778fede0f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.854597 23526 tablet_copy_client.cc:806] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:19.855180 23526 tablet_copy_client.cc:670] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:19.861253 23526 tablet_copy_client.cc:538] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:19.867539 23526 tablet_bootstrap.cc:492] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:19.886996 23526 tablet_bootstrap.cc:492] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:19.887717 23526 tablet_bootstrap.cc:492] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:19.888270 23526 ts_tablet_manager.cc:1403] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:06:19.890388 23526 raft_consensus.cc:359] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:19.891156 23526 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:19.891729 23526 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:19.893950 23526 ts_tablet_manager.cc:1434] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:06:19.899240 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-c96fcf9d065e46528b502778fede0f1f received from {username='slave'} at 127.0.0.1:55062
I20260709 13:06:19.899730 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-c96fcf9d065e46528b502778fede0f1f on tablet c96fcf9d065e46528b502778fede0f1f with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:20.008343 23112 raft_consensus.cc:1217] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:20.155725 23112 raft_consensus.cc:1217] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:20.255056 23112 raft_consensus.cc:1217] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:20.436549 23112 raft_consensus.cc:1217] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:20.473618 23511 raft_consensus.cc:1064] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:20.476179 23511 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:20.482868 22577 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.482964 23112 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.484627 23511 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.485780 22428 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.487074 23417 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.488798 23533 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.503053 23512 raft_consensus.cc:2955] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.505067 22428 raft_consensus.cc:2955] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.513643 22577 raft_consensus.cc:2955] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.536746 23108 raft_consensus.cc:2955] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.540983 23417 raft_consensus.cc:1064] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:20.543305 23417 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:20.547509 22330 catalog_manager.cc:5697] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.581429 22428 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.581430 23108 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.581539 22577 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.582995 23545 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.583920 23533 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.585564 23417 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.601217 23533 raft_consensus.cc:2955] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.603256 23108 raft_consensus.cc:2955] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.616623 22428 raft_consensus.cc:2955] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.622437 22506 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:20.622599 22328 catalog_manager.cc:5697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.623066 22577 raft_consensus.cc:2955] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.652000 23108 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.653599 23417 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.652000 22428 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.655990 23545 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.661715 23512 raft_consensus.cc:2955] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.668053 22424 raft_consensus.cc:2955] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.671985 22506 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:20.675037 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c04b0ff4c7da4211acec428ae776775a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.665758 23108 raft_consensus.cc:2955] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.693470 23112 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.695322 23512 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:20.695581 22425 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.700137 23545 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:20.711676 22327 catalog_manager.cc:5697] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.717396 23417 raft_consensus.cc:2955] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.766832 23546 raft_consensus.cc:1064] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:20.769702 23546 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:20.772105 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet c04b0ff4c7da4211acec428ae776775a with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49180
W20260709 13:06:20.773331 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 52740.3us
I20260709 13:06:20.780119 23112 raft_consensus.cc:2955] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.802956 22327 catalog_manager.cc:5697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.822568 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17ed109556234df2aeba1d6118cc0a95 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.828179 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet 17ed109556234df2aeba1d6118cc0a95 with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49180
I20260709 13:06:20.830004 23559 tablet_replica.cc:333] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
W20260709 13:06:20.833748 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 83080.8us
I20260709 13:06:20.876287 23540 raft_consensus.cc:1064] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:20.879379 23540 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:20.917609 23112 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.919401 23540 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:20.920363 22425 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.922029 23500 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.961863 23500 raft_consensus.cc:2955] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.973308 23112 raft_consensus.cc:2955] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.986498 22424 raft_consensus.cc:2955] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.989157 22425 raft_consensus.cc:2955] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:20.994560 22327 catalog_manager.cc:5697] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.013486 22577 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:21.024148 23112 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.029316 23569 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:21.037616 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 54399us
I20260709 13:06:21.038770 23112 raft_consensus.cc:2955] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.045210 23108 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.048141 23511 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.051760 22578 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.057658 22506 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.058310 23417 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.050324 23508 raft_consensus.cc:2955] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.065078 22428 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.069176 23559 raft_consensus.cc:2243] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.070154 23559 raft_consensus.cc:2272] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.073928 23559 ts_tablet_manager.cc:1916] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.083161 22433 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.070132 23540 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:06:21.101761 22428 raft_consensus.cc:2955] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.124856 23565 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:21.129369 23546 raft_consensus.cc:2955] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.139220 22327 catalog_manager.cc:5697] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 4, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.143759 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c96fcf9d065e46528b502778fede0f1f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.144899 22577 raft_consensus.cc:2955] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.150956 23108 raft_consensus.cc:2955] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.195801 23559 ts_tablet_manager.cc:1929] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.198727 23559 log.cc:1199] T c04b0ff4c7da4211acec428ae776775a P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/c04b0ff4c7da4211acec428ae776775a
I20260709 13:06:21.200240 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet c04b0ff4c7da4211acec428ae776775a (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:21.201465 23559 tablet_replica.cc:333] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:06:21.203718 22494 tablet_service.cc:1558] Processing DeleteTablet for tablet c96fcf9d065e46528b502778fede0f1f with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58696
I20260709 13:06:21.201113 22331 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.209712 23559 raft_consensus.cc:2243] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.211068 23576 tablet_replica.cc:333] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:06:21.212205 23576 raft_consensus.cc:2243] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.213013 23576 raft_consensus.cc:2272] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.216144 23576 ts_tablet_manager.cc:1916] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.218896 22425 raft_consensus.cc:2955] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.225380 22507 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:21.226693 23559 raft_consensus.cc:2272] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.230556 23559 ts_tablet_manager.cc:1916] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.234614 23576 ts_tablet_manager.cc:1929] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 13:06:21.235226 23576 log.cc:1199] T c96fcf9d065e46528b502778fede0f1f P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/c96fcf9d065e46528b502778fede0f1f
I20260709 13:06:21.237077 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet c96fcf9d065e46528b502778fede0f1f (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:21.248175 22577 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.248169 23112 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.250871 23417 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.252868 23417 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.259001 23533 raft_consensus.cc:2955] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.261122 22577 raft_consensus.cc:2955] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.271677 23559 ts_tablet_manager.cc:1929] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.272152 23559 log.cc:1199] T 17ed109556234df2aeba1d6118cc0a95 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/17ed109556234df2aeba1d6118cc0a95
I20260709 13:06:21.274353 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet 17ed109556234df2aeba1d6118cc0a95 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:21.277547 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78e6dd3ee498418ab0eeb27b3289cdc5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.280525 23112 raft_consensus.cc:2955] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.286827 22328 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 3 to 4, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:21.314106 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet 78e6dd3ee498418ab0eeb27b3289cdc5 with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:06:21.316440 23577 tablet_replica.cc:333] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:06:21.317674 23577 raft_consensus.cc:2243] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.318547 23577 raft_consensus.cc:2272] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.321872 23577 ts_tablet_manager.cc:1916] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.345175 23577 ts_tablet_manager.cc:1929] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.345599 23577 log.cc:1199] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/78e6dd3ee498418ab0eeb27b3289cdc5
I20260709 13:06:21.347182 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet 78e6dd3ee498418ab0eeb27b3289cdc5 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:06:22.383993 22504 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:22.390260 22576 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:22.390524 22473 consensus_peers.cc:597] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1dcd5807b34a410c9196ed1b6e80ace3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.391541 22428 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:22.392457 23533 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.393278 23546 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.404461 23417 raft_consensus.cc:2955] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.406083 22576 raft_consensus.cc:2955] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.406500 22428 raft_consensus.cc:2955] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.417562 22504 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:22.425132 22328 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.426889 22425 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:22.428261 22577 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:22.428495 22473 consensus_peers.cc:597] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4d35c45e33c4336b33461cdbe7f7b6f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.430140 23546 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:22.433883 23583 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.467628 23533 raft_consensus.cc:2955] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.482199 22577 raft_consensus.cc:2955] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.499413 22425 raft_consensus.cc:2955] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.501647 22430 consensus_queue.cc:237] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:22.516417 22398 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06de1406fed544b39bf6d0ab441df770. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.517724 22504 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:22.519984 23555 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.517665 22577 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:22.527807 22331 catalog_manager.cc:5697] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.530349 23555 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.535033 23556 raft_consensus.cc:2955] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.539544 22504 raft_consensus.cc:2955] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.547075 22577 raft_consensus.cc:2955] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.560110 22578 consensus_queue.cc:237] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:22.565488 22331 catalog_manager.cc:5697] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:06:22.571374 22547 consensus_peers.cc:597] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee6d9e2f597948e7b4670b3606ebf448. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.572824 22425 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:22.575438 22504 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:22.575840 23570 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.579298 23569 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.589041 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:22.592043 23570 raft_consensus.cc:2955] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.600910 22504 raft_consensus.cc:2955] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.601500 22425 raft_consensus.cc:2955] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:22.613724 22328 catalog_manager.cc:5697] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 2, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 1 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.682528 22504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:06:22.683211 22504 raft_consensus.cc:606] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:22.685838 22504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:06:22.686359 22504 raft_consensus.cc:606] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:22.689055 22504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:06:22.689740 22504 raft_consensus.cc:606] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:22.692377 22504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:06:22.692965 22504 raft_consensus.cc:606] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:22.696797 22504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:06:22.697433 22504 raft_consensus.cc:606] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:22.699250 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:22.700546 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:22.827883 23583 raft_consensus.cc:993] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:06:22.828414 23533 raft_consensus.cc:1081] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Signalling peer 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:06:22.829952 23108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95"
dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:59008
I20260709 13:06:22.830621 23108 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.831019 23108 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.838733 23108 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:22.840915 23108 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:22.841940 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:22.842981 22504 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:22.843277 22504 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:22.841964 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:22.845525 22425 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.843989 22504 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:22.849426 22504 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.858870 22425 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:22.859200 22504 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:22.860579 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:22.862259 23600 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:22.863442 23600 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:22.864171 23600 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:22.872396 22328 catalog_manager.cc:5697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.947199 23603 ts_tablet_manager.cc:933] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:22.949146 23603 tablet_copy_client.cc:323] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:22.950841 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet f4d35c45e33c4336b33461cdbe7f7b6f from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:22.951438 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet f4d35c45e33c4336b33461cdbe7f7b6f from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-f4d35c45e33c4336b33461cdbe7f7b6f
I20260709 13:06:22.959146 22517 tablet_copy_source_session.cc:215] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.962631 23603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d35c45e33c4336b33461cdbe7f7b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.968106 23546 raft_consensus.cc:993] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:06:22.968703 23546 raft_consensus.cc:1081] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Signalling peer 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:06:22.972028 23112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96"
dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:59008
I20260709 13:06:22.972738 23112 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.973112 23112 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.985273 23533 raft_consensus.cc:993] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:06:22.985780 23533 raft_consensus.cc:1081] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Signalling peer 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:06:22.986007 23603 tablet_copy_client.cc:806] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:22.986680 23603 tablet_copy_client.cc:670] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:22.988054 23111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1"
dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:59008
I20260709 13:06:22.988698 23111 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.989034 23111 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.990638 23112 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:22.993656 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:22.994256 22425 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.997749 23112 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:22.998232 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:22.998817 22504 raft_consensus.cc:3055] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:22.999094 22504 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:22.999807 22504 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.000944 22504 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.001878 23605 ts_tablet_manager.cc:933] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:23.013065 23111 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.027426 23583 raft_consensus.cc:993] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:06:23.039616 23583 raft_consensus.cc:1081] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Signalling peer 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:06:23.041951 23112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2"
dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:59008
I20260709 13:06:23.042798 23112 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.043745 23112 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.037647 22504 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:23.044409 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:23.036875 22425 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:23.045028 22577 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.045851 23077 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:23.047473 23111 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:23.052757 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 47287.5us
I20260709 13:06:23.052737 23600 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:23.055255 23600 raft_consensus.cc:697] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:23.056155 23600 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.057492 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:23.058071 22504 raft_consensus.cc:3055] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:23.058343 22504 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:23.059058 22504 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.060321 22504 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.069514 22328 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.071516 23603 tablet_copy_client.cc:538] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.089670 23605 tablet_copy_client.cc:323] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:06:23.091238 22577 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:23.092562 23079 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:23.093700 23600 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:23.094213 23600 raft_consensus.cc:697] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:23.095367 23603 tablet_bootstrap.cc:492] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:23.095099 23600 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.098246 22517 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 1dcd5807b34a410c9196ed1b6e80ace3 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:06:23.098834 22517 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 1dcd5807b34a410c9196ed1b6e80ace3 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-1dcd5807b34a410c9196ed1b6e80ace3
I20260709 13:06:23.106269 23583 raft_consensus.cc:993] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:06:23.106709 22504 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:23.106833 23583 raft_consensus.cc:1081] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Signalling peer 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:06:23.108434 22517 tablet_copy_source_session.cc:215] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.109761 23110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79"
dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:59008
I20260709 13:06:23.110442 23110 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.110812 23110 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.052016 23112 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.112870 23112 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:23.113898 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:23.114542 22425 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.119086 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:23.119773 22504 raft_consensus.cc:3055] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:23.120087 22504 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:23.126718 22504 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.129603 22504 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.144330 22425 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:23.134330 23110 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.146306 23077 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:23.147276 23601 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:23.143369 22504 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:23.185206 23601 raft_consensus.cc:697] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:23.212545 23605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcd5807b34a410c9196ed1b6e80ace3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.212571 23110 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:23.215862 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:23.216462 22506 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:23.216746 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:23.217342 22578 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.216780 22506 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:23.214649 22328 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 3, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 3 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.219218 22506 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.212878 23601 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.227175 22506 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.251062 22506 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:23.252315 23076 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:23.253378 23600 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:23.253890 23600 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:23.255560 22578 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:23.254772 23600 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:23.265146 23610 ts_tablet_manager.cc:933] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
I20260709 13:06:23.317327 23603 tablet_bootstrap.cc:492] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.318346 23603 tablet_bootstrap.cc:492] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:23.319187 23603 ts_tablet_manager.cc:1403] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.224s	user 0.026s	sys 0.004s
I20260709 13:06:23.330852 22328 catalog_manager.cc:5697] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.344084 23610 tablet_copy_client.cc:323] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.1:43859
I20260709 13:06:23.344789 22430 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:23.345779 23614 ts_tablet_manager.cc:933] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:23.351810 23616 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:23.354004 22443 tablet_copy_service.cc:140] P e32ba8e6132b4f8e98a99066b6fffe05: Received BeginTabletCopySession request for tablet 06de1406fed544b39bf6d0ab441df770 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:34614)
I20260709 13:06:23.354729 22443 tablet_copy_service.cc:161] P e32ba8e6132b4f8e98a99066b6fffe05: Beginning new tablet copy session on tablet 06de1406fed544b39bf6d0ab441df770 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:34614: session id = 9cea93fb03e04e48a6dabc4094ee7c93-06de1406fed544b39bf6d0ab441df770
I20260709 13:06:23.401391 23603 raft_consensus.cc:359] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:23.402401 23603 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:23.402624 22443 tablet_copy_source_session.cc:215] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.403270 23603 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:23.404101 22328 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.408331 23603 ts_tablet_manager.cc:1434] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 13:06:23.410277 23610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06de1406fed544b39bf6d0ab441df770. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:23.428884 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 159435us
W20260709 13:06:23.433151 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 106810us
I20260709 13:06:23.434826 23605 tablet_copy_client.cc:806] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.454430 23605 tablet_copy_client.cc:670] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
W20260709 13:06:23.492312 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 47778.8us
W20260709 13:06:23.509768 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45218.4us
I20260709 13:06:23.510185 22578 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:23.518755 23611 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:23.550839 23610 tablet_copy_client.cc:806] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.551550 23610 tablet_copy_client.cc:670] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.576999 22506 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:23.587589 23111 raft_consensus.cc:1217] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:23.577332 23614 tablet_copy_client.cc:323] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:06:23.583428 22517 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-f4d35c45e33c4336b33461cdbe7f7b6f received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:23.611331 22517 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-f4d35c45e33c4336b33461cdbe7f7b6f on tablet f4d35c45e33c4336b33461cdbe7f7b6f with peer 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:23.637387 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 85607.4us
I20260709 13:06:23.655190 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet ee6d9e2f597948e7b4670b3606ebf448 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:06:23.656060 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet ee6d9e2f597948e7b4670b3606ebf448 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-ee6d9e2f597948e7b4670b3606ebf448
I20260709 13:06:23.635288 23600 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:23.657986 23610 tablet_copy_client.cc:538] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:24.390594 23610 tablet_bootstrap.cc:492] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:24.770874 23646 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:24.773895 23645 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:24.773520 23647 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:24.772698 23646 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:24.774778 23645 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:24.778156 23646 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:24.775745 23647 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:24.781741 23645 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:24.782701 23647 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:24.784889 23610 tablet_bootstrap.cc:492] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:24.785202 22592 tablet_copy_source_session.cc:215] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:24.786175 23610 tablet_bootstrap.cc:492] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:24.787077 23610 ts_tablet_manager.cc:1403] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.397s	user 0.028s	sys 0.021s
I20260709 13:06:24.787099 22592 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:55062 (request call id 20) took 1132 ms. Trace:
I20260709 13:06:24.787837 22592 rpcz_store.cc:276] 0709 13:06:23.654679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.654967 (+   288us) service_pool.cc:224] Handling call
0709 13:06:24.786962 (+1131995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.798933 23610 raft_consensus.cc:359] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:24.800426 23610 raft_consensus.cc:740] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:24.801719 23610 consensus_queue.cc:260] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:24.884681 23646 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:24.885360 23646 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:24.887640 23646 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:24.888168 23646 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:24.889389 23646 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:24.891813 23646 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:24.892495 23646 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:24.902278 23646 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:24.933444 23647 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.000349 23647 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.004143 23647 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.005048 23647 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.005687 23647 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.050920 23646 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.051707 23646 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:25.052429 23646 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.126084 23649 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.126904 23649 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.129400 23649 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.148705 23601 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.318216 23649 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.318406 23601 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.318923 23649 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.202945 23610 ts_tablet_manager.cc:1434] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.415s	user 0.001s	sys 0.008s
W20260709 13:06:25.324945 23610 ts_tablet_manager.cc:1467] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Tablet startup took 537ms
I20260709 13:06:25.216935 23647 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.232731 23652 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.328567 23652 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.331125 23652 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:25.281924 22580 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.624s	user 0.022s	sys 0.011s
W20260709 13:06:25.287031 22471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.716s	user 0.017s	sys 0.031s
W20260709 13:06:25.295819 22472 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.719s	user 0.013s	sys 0.048s
W20260709 13:06:25.342379 22472 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.766s	user 0.013s	sys 0.049s
I20260709 13:06:25.328969 23649 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.257453 23646 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.246433 23651 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:06:25.341986 22471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.772s	user 0.018s	sys 0.032s
W20260709 13:06:25.348155 22580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.686s	user 0.023s	sys 0.011s
I20260709 13:06:25.352978 23651 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.357204 23654 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.357789 23654 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.360599 23651 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.360662 23654 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.361097 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 19) took 1750 ms. Trace:
I20260709 13:06:25.361596 22580 rpcz_store.cc:276] 0709 13:06:23.610991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.613373 (+  2382us) service_pool.cc:224] Handling call
0709 13:06:23.639557 (+ 26184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.657063 (+ 17506us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:25.352060 (+1694997us) log.cc:844] Serialized 14 byte log entry
0709 13:06:25.358655 (+  6595us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:25.358906 (+   251us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:25.360784 (+  1878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.360867 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.361007 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":162756,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":1698542,"threads_started":2,"wal-append.queue_time_us":6765}
W20260709 13:06:25.381762 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.791s	user 0.026s	sys 0.051s
W20260709 13:06:25.382241 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.801s	user 0.026s	sys 0.051s
I20260709 13:06:25.385247 23660 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.386163 23660 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.389832 23660 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:25.390429 22548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.819s	user 0.000s	sys 0.056s
I20260709 13:06:25.390353 23661 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:25.391036 22548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.823s	user 0.000s	sys 0.057s
I20260709 13:06:25.391120 23661 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.393397 23661 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.393957 23661 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:25.394495 23661 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.385547 23659 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.395488 23659 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.396726 23661 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.398198 23659 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.399868 23661 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.400583 23661 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.402519 23661 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.408758 23663 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.409377 23663 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.409776 23661 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.410836 23661 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.411703 23601 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.412518 23663 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.414367 23661 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:25.325456 23610 ts_tablet_manager.cc:1469] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Trace:
0709 13:06:23.122351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.122499 (+   148us) service_pool.cc:224] Handling call
0709 13:06:23.265493 (+142994us) ts_tablet_manager.cc:934] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
0709 13:06:23.408922 (+143429us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:23.464195 (+ 55273us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:23.464330 (+   135us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:23.542258 (+ 77928us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:23.542559 (+   301us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:23.550362 (+  7803us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:23.550435 (+    73us) inbound_call.cc:177] Queueing success response
0709 13:06:24.390161 (+839726us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:24.787451 (+397290us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:24.795317 (+  7866us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:24.796232 (+   915us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":26797,"mutex_wait_us":1145,"raft.queue_time_us":164,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":2231,"tablet-copy.queue_time_us":142034,"tablet-download-pool.queue_time_us":156,"tablet-download-pool.run_cpu_time_us":1429,"tablet-download-pool.run_wall_time_us":89356,"thread_start_us":129608,"threads_started":2}
I20260709 13:06:25.415940 23662 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.420580 23662 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.424249 23662 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.427721 23650 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.430142 23650 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.433771 23650 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.434713 23650 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.435564 23650 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.438382 23650 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.444895 23650 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.446415 23650 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.442271 23654 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.448793 23654 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.451131 23654 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.442911 23667 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.439891 23666 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.455276 23663 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.455765 23661 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.448833 23650 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.460516 23660 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.443166 23657 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.461987 23555 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.468289 23665 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.465888 23661 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.470057 23555 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.475386 23555 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.470201 23665 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.467628 23659 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.539004 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:25.463435 23667 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.567509 23667 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.464959 23657 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.570030 23657 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.465579 23660 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.595255 23672 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:25.599037 23672 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.466012 23663 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:25.495787 23650 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.611032 23667 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.576870 23654 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.725167 23650 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.579113 23555 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.725608 23667 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.726231 23555 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.625815 23653 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.469609 23666 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.610992 23657 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.626942 23661 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.606624 23659 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.629199 23660 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.578639 23662 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:25.645520 23664 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:25.646147 23656 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.647200 23665 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.650719 23673 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.663880 23668 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.722277 23675 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:25.735165 23676 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.727448 23650 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.750048 22425 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.737123 23667 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.754076 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.725814 23654 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.749708 23657 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.744932 23662 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.776937 23657 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.740818 23670 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.778494 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.749538 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.747162 23653 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:25.749675 23665 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.789625 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.778762 23667 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.788759 23670 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.794512 23555 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.781329 23662 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.757377 23656 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.800140 23662 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:25.797780 23665 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.798146 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.798987 23657 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.777964 23675 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.802309 23669 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.797096 23667 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.812239 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.819885 22579 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.812902 23670 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.813280 23659 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.803357 23662 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.814201 23663 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.786034 23673 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:25.754326 23664 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.811978 23666 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.754118 23668 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.818774 23669 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.835184 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.835712 22579 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.834321 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.837412 23650 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.837841 22580 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.827163 23657 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.838086 23650 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.838915 23662 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.830057 23670 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.834029 23656 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.791574 23676 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.840222 23667 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.843191 23654 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.850054 23678 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.852186 23678 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.852660 23673 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.852803 23653 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.842926 23670 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.850436 23665 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.855967 23674 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.857457 23669 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.857188 23674 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.856175 23650 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.849447 23666 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:25.851485 23657 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.850111 23680 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.862881 23680 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.863237 23674 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.854460 23654 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.865304 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.865819 22577 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.867792 23678 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.863785 23674 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.868659 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.868932 23674 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.869318 22579 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.858836 23675 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.870576 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.870899 23674 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.871230 22582 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.872138 23664 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.872680 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.873343 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.872908 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.874702 22577 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.872958 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.879983 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:25.880940 22399 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:25.881770 22399 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:25.882480 23671 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.882851 23671 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.883205 23671 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.883582 23673 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.883279 22399 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:25.886456 22399 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:25.884876 23673 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.888068 23673 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.888113 23555 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.888432 22399 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:25.888738 23555 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.889143 23555 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.889252 23667 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.865188 23653 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:25.890403 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:25.889662 23667 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.894474 23668 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.893399 23667 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.896255 23661 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.897531 23653 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.896835 23661 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.900447 23663 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.902256 23110 raft_consensus.cc:1217] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:25.911218 22399 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:25.877895 23654 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:25.864130 23666 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.890698 23662 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.904644 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:25.923425 23111 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.906243 23659 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.885893 23669 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.909463 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.912025 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:25.925069 23112 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.912319 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.912750 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.912982 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.912772 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.900802 23675 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.910228 23660 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.914611 23663 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:25.890944 23657 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.920866 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.921100 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.911460 23664 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:25.886368 23681 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.920867 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.942014 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.943235 22427 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:25.944159 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.913852 23624 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.935417 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.937182 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.945407 22428 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:25.924145 23678 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.938678 23657 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.940330 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.947926 23624 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.950502 22573 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.946281 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.926285 23669 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.930442 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.953189 22575 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.953298 23624 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.953532 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.951959 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:25.951256 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.946693 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.954701 23111 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.932381 23675 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.953800 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.955960 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.957158 22577 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.957504 23657 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.940857 23660 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.955880 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:25.958566 23110 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.949911 23678 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.926867 23659 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.924912 23662 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.960811 22431 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:25.957362 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:25.953485 23077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.017s	sys 0.016s
I20260709 13:06:25.963018 23663 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:25.961706 22399 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:25.951475 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.945484 23664 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:25.972095 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:25.967309 23077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.017s	sys 0.016s
I20260709 13:06:25.967510 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.974053 22580 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.969597 23674 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.970495 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.954325 23669 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.959401 23678 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.972872 23110 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:25.930490 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:25.974838 22581 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:25.975562 23611 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:25.961661 23660 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.964753 22427 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:25.980618 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.008348 23664 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.008046 23673 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.977344 23680 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.008805 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.011430 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.009071 23662 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:25.978747 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:25.976514 22399 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:25.977387 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.015741 23107 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:26.017856 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:25.970960 23653 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.017637 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.021423 23673 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:25.989907 23666 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.024785 22443 tablet_copy_service.cc:342] P e32ba8e6132b4f8e98a99066b6fffe05: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-06de1406fed544b39bf6d0ab441df770 received from {username='slave'} at 127.0.0.1:34614
I20260709 13:06:26.025043 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:25.949309 23681 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.025385 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.012944 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:26.042069 22430 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:25.977839 22574 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:26.028354 22426 raft_consensus.cc:2393] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:26.031662 23680 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.030164 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.022497 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:25.976778 22573 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:26.012657 23611 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.035035 22398 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:26.018039 23555 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:25.976454 23674 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.029605 23659 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:26.043077 22443 tablet_copy_service.cc:434] P e32ba8e6132b4f8e98a99066b6fffe05: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-06de1406fed544b39bf6d0ab441df770 on tablet 06de1406fed544b39bf6d0ab441df770 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:26.045089 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.029968 23671 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.046681 23113 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:26.038118 22575 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:26.047283 22331 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33176 (request call id 260) took 2444 ms. Trace:
I20260709 13:06:26.047819 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:26.049173 23674 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.050320 22432 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:26.051017 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.051227 23555 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.044955 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.051474 23673 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.053586 22331 rpcz_store.cc:276] 0709 13:06:23.600773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.600971 (+   198us) service_pool.cc:224] Handling call
0709 13:06:26.045382 (+2444411us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b24001d5bc8. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0069ecd970 00007f0069edaa8f 00007f0072cdfe14 00007f00711a02a4 00007f00711a0232 00007f00711a0161 00007f00711a00dc
0709 13:06:26.045600 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208,"reported_tablets":1,"spinlock_wait_cycles":3148544}
I20260709 13:06:26.046108 23680 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.056752 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.058132 22398 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.045939 22581 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:26.059561 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.060812 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.062919 22582 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.059538 22398 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:26.065358 23656 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.065819 23656 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.066285 23656 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.067004 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.068629 22398 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:26.077751 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.056918 23653 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.069936 23650 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.070134 23665 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.058998 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:26.059266 23680 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.057529 23673 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.082912 23673 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:26.081027 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 80204us
I20260709 13:06:26.081310 23650 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.070019 23611 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.084343 23650 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.082420 23653 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.061821 23555 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.065801 23681 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:26.090559 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:26.091827 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:26.094135 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:26.086292 23555 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.094801 22433 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:26.095151 23555 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.095708 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:26.086436 23653 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.082931 23683 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:06:26.096309 22433 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:26.108258 23656 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.111824 22425 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.112123 23656 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.112906 22424 raft_consensus.cc:2393] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:26.108175 23671 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.086009 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.117125 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.117727 23106 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:26.118896 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:26.119575 23113 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.110105 23670 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.118853 22398 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.106318 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.144104 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.149827 23112 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:26.149678 22546 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.103529 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.151036 23676 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.142827 23113 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:26.154003 22398 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.119680 23077 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.157011 23676 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.150417 23657 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.157773 23676 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:26.122483 23670 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.159500 23647 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.159801 23670 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.150997 22573 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:26.160863 23670 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:26.160176 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 51624.2us
I20260709 13:06:26.158129 23672 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:26.142758 23654 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.164057 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.164808 23657 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.165153 23601 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.125591 23614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6d9e2f597948e7b4670b3606ebf448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:26.159998 23647 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.163201 22546 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.094823 23669 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.171104 23620 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.166298 23642 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:26.159895 23676 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.165629 23601 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.167960 23647 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.171871 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.177490 22546 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.183820 23079 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:26.122459 22574 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:26.185127 23079 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:26.171811 23678 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.165766 23681 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.191156 23079 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:26.193267 23079 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:26.191921 23624 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.193739 23643 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.193904 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.194142 23611 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.181594 23601 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.194622 22573 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:26.194826 23611 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.149379 23667 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.194366 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:26.197795 22428 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:26.195211 23611 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.199218 23611 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.180254 23661 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.192293 23672 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.205874 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:26.189719 23620 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.205348 23079 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:26.210427 22547 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:26.212881 22546 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.200165 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:26.213558 23079 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:26.209642 22399 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.200440 23645 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.216852 22399 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.181200 23673 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.215476 22547 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:26.221083 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.226034 23682 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.226472 23642 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.223289 22399 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.204838 23672 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.217233 23645 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.213768 23620 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.232247 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.217418 23683 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.223877 23656 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.220782 23671 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.224205 23663 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.227662 23665 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.233074 23645 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.231809 23672 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.231480 23666 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.234190 23664 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.259217 23555 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.256078 23657 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:26.267706 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 892551us
I20260709 13:06:26.237005 23683 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.272459 23533 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.257378 23663 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.257862 23671 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.255604 23656 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.259814 23665 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.274016 23533 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.277427 23671 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.268998 23666 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.269515 23664 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.273468 23657 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.274855 23683 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.296814 22546 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.308704 23677 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:26.300981 23533 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:26.295332 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 81855.9us
I20260709 13:06:26.278704 23663 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.284801 23665 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.285772 23656 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.277624 23685 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:06:26.285633 23678 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.317037 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:06:26.386942 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 69982.9us
I20260709 13:06:26.301872 23664 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:26.380461 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 107968us
I20260709 13:06:26.313019 23657 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:26.355093 22603 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd600 after lost signal to thread 21315
I20260709 13:06:26.295302 23666 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.388192 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:26.413628 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.428392 23624 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.430611 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.315798 23669 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.452142 23672 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.433431 23624 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.411280 23667 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.421108 23660 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.426306 23642 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.425899 23681 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.470767 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.486210 23634 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:06:26.478648 22603 debug-util.cc:398] Leaking SignalData structure 0x7b080018c760 after lost signal to thread 22365
W20260709 13:06:26.508051 23076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.724s (SENT) [suppressed 2 similar messages]
I20260709 13:06:26.474947 23673 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.477871 23675 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:26.480221 23650 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.484762 23660 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.488811 23642 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.506150 23681 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.520201 23642 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.411952 23677 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.519593 23660 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.514124 23555 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.524878 22427 raft_consensus.cc:2393] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:06:26.524044 22603 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7980 after lost signal to thread 22457
I20260709 13:06:26.508105 23634 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.526026 23619 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.529260 23686 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.532991 23674 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:26.556324 22603 debug-util.cc:398] Leaking SignalData structure 0x7b08000eac00 after lost signal to thread 22532
W20260709 13:06:26.567412 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 339766us
I20260709 13:06:26.568291 22547 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:26.569314 22547 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:26.576032 23670 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.578532 23670 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:26.579293 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 168190us
I20260709 13:06:26.581892 23675 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.582429 23675 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.582801 23675 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:26.563230 22603 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad220 after lost signal to thread 22533
I20260709 13:06:26.599555 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:26.600284 22576 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.602535 23656 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:26.604882 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:26.560696 23619 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.559324 23686 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.615600 22576 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:26.597443 23650 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.628413 23533 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.630203 22506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:06:26.574164 23601 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.629778 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:26.614391 23672 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:26.642097 22576 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.636917 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:26.642745 22577 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:26.624528 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 116505us
I20260709 13:06:26.634286 23546 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.645587 23546 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.635447 22506 raft_consensus.cc:606] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:26.635202 23533 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.642168 22507 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:26.621896 23686 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.654973 23546 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.659598 23546 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:26.661399 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:26.661850 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:26.662148 23113 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.663331 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:26.666275 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:26.630584 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:26.630093 23679 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.636003 23656 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:26.649505 22603 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1f00 after lost signal to thread 22606
I20260709 13:06:26.689864 22504 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.674872 23533 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.691766 23533 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:26.692251 23533 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:26.667033 22507 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:26.695122 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:26.667776 23546 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.641058 23634 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.683667 22577 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:26.688908 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:26.646307 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:26.695847 23111 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.699103 23546 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.625382 23647 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.630345 23695 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.697552 23113 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:26.704567 22576 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:26.705685 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:26.707266 23533 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.682675 22581 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:26.716179 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 419422us
I20260709 13:06:26.717095 22506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:06:26.706537 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:26.708418 22575 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.705570 23634 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.733019 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:26.741946 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:26.696563 23685 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:26.723327 22398 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.747180 22579 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.749081 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:26.702267 23645 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.757347 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:26.743693 22603 debug-util.cc:398] Leaking SignalData structure 0x7b080034b1e0 after lost signal to thread 23137
I20260709 13:06:26.764016 22508 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.764169 23657 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.764528 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:26.765666 23546 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:26.762768 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.714665 23695 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:26.714411 23619 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.791493 23696 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.799542 23111 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:26.800869 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.802265 23654 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.802882 23654 raft_consensus.cc:697] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:26.803894 23654 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:26.762024 23611 consensus_meta.cc:287] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.003s
I20260709 13:06:26.788798 23546 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.759002 23673 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.797761 22399 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.814965 23636 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.766040 23674 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.817636 23611 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.818333 23607 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.819363 23546 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.758796 23677 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.795918 23656 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.819643 23107 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:26.697886 23679 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.789274 23695 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.756279 23076 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:26.836628 22399 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:26.865928 23697 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.792240 23696 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.722168 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:26.826327 23673 raft_consensus.cc:697] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:26.887823 23705 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.870507 23656 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:26.904363 23546 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.921768 23546 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.923276 23679 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.923810 23546 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.826128 23628 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.824312 23619 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:26.761034 23634 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.832315 23666 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.937541 23546 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:26.943696 23546 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.944563 23703 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:26.944762 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:26.945525 22425 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:26.919862 23676 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.947420 23108 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.945654 23546 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.918185 23677 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:26.926100 23697 raft_consensus.cc:697] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:26.934324 23643 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.963796 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:26.930878 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 195605us
I20260709 13:06:26.970892 23108 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.948025 23601 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:26.933250 23700 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.955476 23677 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.976051 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.933876 23619 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.981029 23108 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.918865 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:26.956349 23676 raft_consensus.cc:697] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:26.988838 23546 consensus_queue.cc:1059] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:26.871228 23607 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.973616 23693 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:26.976109 23647 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.867417 23636 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.983857 23614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59024 (request call id 132) took 3755 ms. Trace:
I20260709 13:06:26.996006 23546 raft_consensus.cc:3055] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.006677 23546 raft_consensus.cc:740] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:26.983328 23657 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:26.988031 23671 consensus_meta.cc:287] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.003s
I20260709 13:06:26.945207 23703 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:26.997588 23645 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:27.006779 23663 consensus_meta.cc:287] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.002s
I20260709 13:06:27.018337 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.017307 23546 consensus_queue.cc:260] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.040091 23636 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.041378 23636 consensus_queue.cc:1059] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:27.042997 23636 raft_consensus.cc:3055] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.043432 23636 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:27.045595 23111 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.999284 23601 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:26.995265 23656 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.057729 22499 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:27.058799 23694 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:06:27.025079 23611 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:26.993427 23700 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:26.960834 23628 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:27.012974 23679 consensus_queue.cc:1059] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:06:27.067456 23546 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.014931 23671 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.067574 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:26.995784 23673 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.074966 22581 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:26.959373 23705 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.075946 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.157758 22430 raft_consensus.cc:2393] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:27.165845 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.193627 22502 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:27.199328 22575 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:27.201478 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.077296 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.202926 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.204077 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.205083 22576 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.217835 23106 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.222282 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:27.224882 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:27.226246 23546 consensus_queue.cc:1059] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:27.234647 23607 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.236536 22433 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.239305 23107 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:27.225158 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:27.242353 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.246693 23546 raft_consensus.cc:3055] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.247975 23546 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:27.249505 23546 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.250875 23546 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.254027 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:27.255338 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.256304 22502 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:27.257867 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.260600 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:27.262357 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:27.236251 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34614 (request call id 31) took 1212 ms. Trace:
I20260709 13:06:27.112185 23619 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.094502 23628 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:27.302685 22579 consensus_meta.cc:287] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.008s
I20260709 13:06:27.078516 23634 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.303275 22579 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:27.265583 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.303977 23661 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:27.080880 23642 consensus_meta.cc:287] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
I20260709 13:06:27.304807 23661 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:27.089905 23653 consensus_meta.cc:287] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.989s	user 0.014s	sys 0.006s
I20260709 13:06:27.306490 23653 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.307725 23661 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.036465 23663 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:27.111115 23664 consensus_meta.cc:287] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.678s	user 0.003s	sys 0.006s
W20260709 13:06:27.076344 23665 consensus_meta.cc:287] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.689s	user 0.003s	sys 0.006s
I20260709 13:06:27.317145 23665 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.085798 23666 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.327131 23682 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:27.094743 23671 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.062048 23675 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.063535 23676 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.125978 23677 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:27.105573 23680 consensus_meta.cc:287] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 1.018s	user 0.011s	sys 0.008s
I20260709 13:06:27.338038 23680 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.339639 22429 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:06:27.096498 23681 consensus_meta.cc:287] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.001s
W20260709 13:06:27.103554 23683 consensus_meta.cc:287] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.785s	user 0.002s	sys 0.009s
I20260709 13:06:27.271736 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 887) took 1335 ms. Trace:
I20260709 13:06:27.272014 23657 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:27.272657 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:27.273253 23660 consensus_meta.cc:287] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.000s
I20260709 13:06:27.272953 23667 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:27.274209 22506 raft_consensus.cc:606] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:06:27.274799 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 55231.2us
I20260709 13:06:27.287479 23672 consensus_queue.cc:1059] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:27.359285 23672 raft_consensus.cc:3055] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.359716 23672 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:27.293407 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.293560 23678 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:27.300841 23659 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:27.044466 23636 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.373580 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:27.005605 23614 rpcz_store.cc:276] 0709 13:06:23.218166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.218544 (+   378us) service_pool.cc:224] Handling call
0709 13:06:23.346098 (+127554us) ts_tablet_manager.cc:934] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
0709 13:06:26.124122 (+2778024us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:26.455339 (+331217us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:26.455471 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:26.889880 (+434409us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:26.943230 (+ 53350us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:26.967637 (+ 24407us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:26.973320 (+  5683us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":69363,"tablet-copy.queue_time_us":96035,"thread_start_us":255253,"threads_started":2}
I20260709 13:06:27.319963 22576 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:27.374017 23678 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.375002 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.382886 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.383137 23657 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.387439 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.373520 23636 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.321841 23664 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.322902 23605 tablet_copy_client.cc:538] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.325971 23662 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:27.311297 23663 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:27.324553 23624 consensus_meta.cc:287] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.843s	user 0.005s	sys 0.007s
I20260709 13:06:27.341799 23680 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.344980 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.350812 23681 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.350692 22574 raft_consensus.cc:2393] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:27.352432 22433 rpcz_store.cc:276] 0709 13:06:25.936276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.105054 (+168778us) service_pool.cc:224] Handling call
0709 13:06:27.235934 (+1130880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.237182 (+  1248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.270924 (+ 33742us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540038aed0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:27.271357 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2582064384}
I20260709 13:06:27.357676 23660 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:27.267979 22427 rpcz_store.cc:276] 0709 13:06:26.023450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.052119 (+ 28669us) service_pool.cc:224] Handling call
0709 13:06:27.235577 (+1183458us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540038aed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:27.235955 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013007104}
I20260709 13:06:27.368492 23659 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:27.365419 23653 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.392071 23675 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.393246 23662 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.396346 23647 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:27.402100 23664 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.028465 23693 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.124938 23696 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:26.973790 23697 consensus_queue.cc:237] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.113299 23700 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.070389 23703 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.104538 23705 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.129925 23695 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.475281 23657 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.476540 23695 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.392813 23678 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.352214 23683 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.327883 23682 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.118700 23686 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.393272 23665 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.404666 22580 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.427099 23662 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.430226 23659 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:27.432986 23077 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:27.442669 23681 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:27.448355 22577 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:27.449561 23660 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:27.458259 22575 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:27.387305 23672 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.404654 23624 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.463881 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:27.305197 23642 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.480911 23113 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.482836 23683 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.487910 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:27.482882 23620 consensus_meta.cc:287] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 1.227s	user 0.010s	sys 0.006s
I20260709 13:06:27.511300 22503 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:27.513236 22579 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:27.514302 23112 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:27.514906 23642 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.515340 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:27.514683 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 82054.7us
I20260709 13:06:27.514952 23647 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.519419 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:27.520267 23108 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:27.517503 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.515672 23110 raft_consensus.cc:2393] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:27.526180 23584 raft_consensus.cc:3055] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.526655 23584 raft_consensus.cc:740] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:27.526486 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.528760 23693 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.525584 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.529292 23584 consensus_queue.cc:260] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.547024 23110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59024 (request call id 150) took 1132 ms. Trace:
I20260709 13:06:27.547057 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.548604 23107 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:27.581522 22471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.038s	sys 0.055s
W20260709 13:06:27.581939 22471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.038s	sys 0.055s
W20260709 13:06:27.583648 22472 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.003s	sys 0.020s
I20260709 13:06:27.547534 23110 rpcz_store.cc:276] 0709 13:06:26.414376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.425372 (+ 10996us) service_pool.cc:224] Handling call
0709 13:06:27.544387 (+1119015us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54005573d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:27.546941 (+  2554us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309556480}
I20260709 13:06:27.585647 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:27.581413 23109 raft_consensus.cc:1240] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.581436 22399 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:27.581820 22578 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
W20260709 13:06:27.601598 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 131355us
I20260709 13:06:27.602515 22399 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:27.602793 22580 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:27.603360 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 905) took 1004 ms. Trace:
I20260709 13:06:27.603722 22580 rpcz_store.cc:276] 0709 13:06:26.598855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.607523 (+  8668us) service_pool.cc:224] Handling call
0709 13:06:27.293161 (+685638us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfdeee 0000000000375939 00007f0071d711e0 00007f0071e3a0c4 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:27.603292 (+310131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5926272}
I20260709 13:06:27.604749 23665 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:27.583171 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:27.607053 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.608337 23678 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:27.608631 23106 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.608922 23678 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:27.609692 22576 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.610539 22577 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.610958 22576 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.527519 23620 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:27.603665 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:27.611691 22577 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.610126 23678 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.613703 23665 raft_consensus.cc:697] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:27.607056 23112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59024 (request call id 148) took 1193 ms (client timeout 1584 ms). Trace:
I20260709 13:06:27.621035 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:27.548143 23682 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:27.614341 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:27.619920 23112 rpcz_store.cc:269] 0709 13:06:26.413543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.414627 (+  1084us) service_pool.cc:224] Handling call
0709 13:06:27.598255 (+1183628us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54005069d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:27.606999 (+  8744us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2481922944}
I20260709 13:06:27.630652 23686 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:27.624811 22574 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:06:27.627324 22472 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.004s	sys 0.020s
I20260709 13:06:27.638383 22577 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.643122 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.644411 22581 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:27.652163 23108 raft_consensus.cc:2393] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:27.654763 22500 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:27.655421 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.647316 23624 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:27.671051 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 67543.6us
I20260709 13:06:27.671970 22399 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:27.672899 22399 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:27.664373 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:27.676720 23650 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:27.677350 23650 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:27.676887 22573 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:27.666145 22505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.016s	sys 0.011s
W20260709 13:06:27.678876 22545 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.013s	sys 0.016s
I20260709 13:06:27.680359 23676 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:27.690899 23676 raft_consensus.cc:697] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:27.680616 23690 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:27.692026 23676 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.694913 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:27.697904 22505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.017s	sys 0.011s
I20260709 13:06:27.697140 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:27.700461 23657 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:27.690941 23614 tablet_copy_client.cc:806] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.702042 23614 tablet_copy_client.cc:670] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.703188 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.703760 22578 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:27.707989 22545 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.013s	sys 0.017s
I20260709 13:06:27.678500 23650 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.717293 23672 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.716215 22576 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.727731 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.689484 23584 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.741972 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.753551 22508 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:27.737493 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:27.758062 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 800445us
I20260709 13:06:27.762405 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.763931 23709 consensus_queue.cc:1059] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:27.736038 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:27.765466 23709 raft_consensus.cc:3055] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.765759 22507 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
W20260709 13:06:27.730225 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51402.6us
I20260709 13:06:27.742367 22580 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.729435 22503 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:27.768380 23709 raft_consensus.cc:740] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:27.768792 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.764302 22504 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:27.758879 22575 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.754314 23706 consensus_queue.cc:1059] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:06:27.766063 23689 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:27.779320 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.779959 23689 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.780802 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.780972 23689 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:27.782284 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.774230 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.784125 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.788538 22508 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:27.790890 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.775413 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.782308 23689 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.801946 23689 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.797282 22399 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:27.793010 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.792747 23620 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:27.811151 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.816823 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:27.812495 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.814154 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.766960 23665 consensus_queue.cc:237] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.815848 23673 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:27.819115 22399 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:27.796773 23647 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:27.830636 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.840371 22579 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.847731 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:27.852681 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.854256 22579 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.853962 23709 consensus_queue.cc:260] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.855535 23709 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:27.859717 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 319241us
I20260709 13:06:27.842535 23673 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:27.878715 23666 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:27.879295 23666 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:27.879673 23666 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.879997 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.897415 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.889559 23611 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:27.903746 23718 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.131s	user 0.001s	sys 0.001s
I20260709 13:06:27.904829 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.861699 23624 consensus_queue.cc:1059] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:06:27.904907 23611 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:27.917222 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.914884 23611 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.933930 22582 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:27.940837 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:27.917586 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 80473.9us
I20260709 13:06:27.941425 22508 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:27.943521 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.954942 22579 raft_consensus.cc:2410] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:27.955595 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.956636 22506 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:27.957628 23605 tablet_bootstrap.cc:492] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:06:27.959179 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.960744 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.961633 22577 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:27.964816 23672 raft_consensus.cc:3055] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.965495 23672 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:27.966578 23672 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:27.966955 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.981209 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.983099 22576 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.983481 22427 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.986539 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:27.991603 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.991866 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:27.948117 23666 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.968706 23673 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:27.955448 23708 raft_consensus.cc:3055] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.232962 22576 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.003075 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:28.238137 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.056861 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:28.110855 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 72050.2us
I20260709 13:06:27.992247 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:28.047549 22582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 913) took 1424 ms (client timeout 1608 ms). Trace:
I20260709 13:06:28.233778 22578 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.232023 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 55) took 1585 ms. Trace:
I20260709 13:06:27.992415 22508 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:28.168265 23104 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:28.077658 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:28.059046 23636 consensus_meta.cc:287] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.006s
I20260709 13:06:28.069365 22432 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.257652 23666 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:28.113070 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:28.249949 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.254397 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.045148 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:28.183820 23729 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:06:28.261480 22428 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.193617 22427 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:28.071565 23719 log.cc:927] Time spent T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.181s	user 0.000s	sys 0.007s
I20260709 13:06:27.992890 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:28.246672 22582 rpcz_store.cc:269] 0709 13:06:26.623297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.623749 (+   452us) service_pool.cc:224] Handling call
0709 13:06:27.387149 (+763400us) spinlock_profiling.cc:243] Waited 921 us on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:28.047325 (+660176us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400086e54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:28.047456 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1047959680}
I20260709 13:06:27.998675 23647 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.254s
I20260709 13:06:28.046397 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:28.180953 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:28.188386 23654 raft_consensus.cc:1064] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:27.993341 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:28.259069 23611 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:28.294569 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:28.812088 22579 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:28.688865 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:28.736464 23709 consensus_meta.cc:287] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.880s	user 0.012s	sys 0.000s
I20260709 13:06:28.818010 23672 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.805977 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.806931 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:28.807634 22433 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:28.243597 23708 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:28.807334 23654 consensus_queue.cc:237] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:28.808878 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:28.809747 23611 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:28.810073 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.810402 23601 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:28.312168 22573 consensus_meta.cc:287] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 13:06:28.248067 22505 rpcz_store.cc:276] 0709 13:06:26.646848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.647036 (+   188us) service_pool.cc:224] Handling call
0709 13:06:26.647357 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:27.757971 (+1110614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.761773 (+  3802us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:27.795803 (+ 34030us) log.cc:844] Serialized 26 byte log entry
0709 13:06:27.909693 (+113890us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:27.914789 (+  5096us) log.cc:844] Serialized 14 byte log entry
0709 13:06:27.917129 (+  2340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.172669 (+255540us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180010c480. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d35522 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:06:28.230617 (+ 57948us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b180010c480. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d032a6 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419
0709 13:06:28.231315 (+   698us) spinlock_profiling.cc:243] Waited 880 us on lock 0x7b54001851d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:28.231379 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.231454 (+    75us) raft_consensus.cc:1685] finished
0709 13:06:28.231476 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.231823 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9785,"prepare.queue_time_us":4906,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":54928,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":6044,"spinlock_wait_cycles":36797312,"thread_start_us":1114002,"threads_started":2,"wal-append.queue_time_us":252213}
W20260709 13:06:28.798416 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.141270 22430 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.300318 22506 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
W20260709 13:06:28.698475 23650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.024s	sys 0.028s
I20260709 13:06:28.485188 23687 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.314294 22424 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:28.298282 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.803946 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 349669us
I20260709 13:06:28.816274 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.851058 23611 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:28.350503 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.805646 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:28.819245 22582 raft_consensus.cc:2393] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:28.683609 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:28.504940 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 52907.9us
I20260709 13:06:28.797911 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:28.854195 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.452754 23689 consensus_meta.cc:287] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.650s	user 0.015s	sys 0.000s
I20260709 13:06:28.322225 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.822989 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:28.854969 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.807379 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:28.802840 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 349580us
I20260709 13:06:28.830605 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.834619 22429 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.835279 22425 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:28.524993 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 526196us
I20260709 13:06:28.857807 22576 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:28.835397 22431 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.837149 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.849627 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.836037 23601 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:28.847915 23650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.026s	sys 0.029s
I20260709 13:06:28.859704 23620 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.862792 23113 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.861991 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.858148 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.863598 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.831130 22500 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:28.865572 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:28.868522 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.868673 22576 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:28.839769 22503 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:28.869702 22424 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:28.869640 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.871587 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.872236 22429 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:28.872430 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:28.873149 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.873373 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.874290 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.874873 22429 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:28.875411 22426 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.875768 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.875963 22433 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:28.876706 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.877130 22433 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.877394 22504 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:28.836565 22573 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:28.876789 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.853569 23611 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:28.854859 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.885303 22574 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.888337 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 935) took 1372 ms. Trace:
I20260709 13:06:28.890565 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.868664 23647 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:28.891494 22428 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:28.892100 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.890633 22573 rpcz_store.cc:276] 0709 13:06:27.513644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.536826 (+ 23182us) service_pool.cc:224] Handling call
0709 13:06:28.886186 (+1349360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:28.894937 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.895879 22582 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.903252 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:28.886587 23733 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:28.898299 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.881044 23620 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:28.887609 23708 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:28.849851 23687 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:28.889958 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:28.892434 23076 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:28.932047 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.996218 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:29.005296 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.008213 23601 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:29.018411 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.019186 23687 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:29.019243 22427 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:29.021042 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 1740) took 1660 ms. Trace:
W20260709 13:06:29.021091 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 140992us
I20260709 13:06:29.022250 23733 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:29.025287 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.026006 22500 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:29.026124 23076 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:29.026707 22575 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:29.027014 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.028438 22500 raft_consensus.cc:3055] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:29.029994 22500 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:28.973097 23109 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:29.030933 22500 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:29.032047 22500 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.033596 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.034060 22429 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:29.021271 23601 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:29.022054 22574 rpcz_store.cc:276] 0709 13:06:27.360815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.660523 (+299708us) service_pool.cc:224] Handling call
0709 13:06:27.801244 (+140721us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdf8c 00007f0069cfdef6 0000000000375939 00007f0071d711e0 00007f0071e3a0c4 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:28.885058 (+1083814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.888820 (+  3762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.020783 (+131963us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400088250. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:29.020948 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2490203776}
W20260709 13:06:29.039638 22396 connection.cc:256] RPC call timeout handler was delayed by -1.1160570009999446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:06:29.040171 22396 connection.cc:256] RPC call timeout handler was delayed by -1.042257000999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 13:06:29.040509 22396 connection.cc:256] RPC call timeout handler was delayed by -1.0224877629999582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260709 13:06:29.045954 22508 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:29.047468 22580 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.010435 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:28.894294 23678 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:29.054288 23678 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:29.054664 23601 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:29.055313 23601 raft_consensus.cc:697] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:29.034325 22499 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:28.995699 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.934180 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:28.979827 22507 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:29.057021 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 835) took 1061 ms. Trace:
I20260709 13:06:29.056264 23708 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.057549 22507 rpcz_store.cc:276] 0709 13:06:27.995509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.321848 (+326339us) service_pool.cc:224] Handling call
0709 13:06:29.056967 (+735119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.058537 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:28.890080 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 810) took 1158 ms. Trace:
I20260709 13:06:28.997798 23665 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:29.009922 22501 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:29.039880 23620 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:29.053700 23733 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:29.056380 23601 consensus_queue.cc:237] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:29.057013 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:28.898116 23647 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:29.054630 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:28.985428 23611 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:29.076299 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.056437 23678 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:29.055536 22502 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:29.089985 22504 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:29.062007 22499 raft_consensus.cc:3055] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:29.093401 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 259746us
W20260709 13:06:29.104645 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.075838 23665 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:29.059126 23689 consensus_queue.cc:1059] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:29.060789 22503 rpcz_store.cc:276] 0709 13:06:27.725211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.786559 (+ 61348us) service_pool.cc:224] Handling call
0709 13:06:28.046186 (+259627us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:28.880854 (+834668us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3986176}
I20260709 13:06:29.118397 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.094880 22499 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:29.122251 22433 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:29.124058 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.124904 22506 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:29.119092 22504 raft_consensus.cc:2376] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2. Re-sending same reply.
I20260709 13:06:29.128649 22508 raft_consensus.cc:3055] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:29.129230 22508 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:29.132634 23709 consensus_queue.cc:1059] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:29.133356 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.134002 22503 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:29.134999 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:29.100365 23676 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:29.142460 22499 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:29.143626 22499 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.136400 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:29.148711 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 45714.6us
W20260709 13:06:29.154002 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 46159.9us
W20260709 13:06:29.154408 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 51353.6us
I20260709 13:06:29.121407 23620 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:06:29.251389 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 98558us
W20260709 13:06:29.251701 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 207915us
W20260709 13:06:29.253715 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 97235.1us
I20260709 13:06:29.254354 23605 tablet_bootstrap.cc:492] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:29.255112 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:29.255131 23680 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:29.224654 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.256808 23680 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:29.257344 23680 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:29.265110 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 109155us
I20260709 13:06:29.250464 22508 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:29.268831 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.275152 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 124183us
I20260709 13:06:29.255307 23104 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:29.257504 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:29.286432 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.255388 23605 tablet_bootstrap.cc:492] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:29.152395 23738 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:06:29.268427 23689 raft_consensus.cc:3055] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:29.303136 23109 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:29.307729 23741 raft_consensus.cc:3055] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:29.308779 22575 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.292101 23620 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.267668 23676 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:29.308251 23741 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:29.319593 22508 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.323632 23751 consensus_queue.cc:1059] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:29.333082 23680 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:29.295794 23689 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:29.336057 23636 raft_consensus.cc:3055] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:29.347359 23753 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:29.337399 23605 ts_tablet_manager.cc:1403] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 1.431s	user 0.022s	sys 0.035s
I20260709 13:06:29.354914 23689 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:29.356568 23647 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:29.345467 23636 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:29.374645 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:29.375433 22580 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:29.365948 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.381374 22503 raft_consensus.cc:2393] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:29.382383 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.383554 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.383893 23636 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:29.385311 23636 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.337001 23620 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:29.387030 23665 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:29.387704 22545 leader_election.cc:336] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.541s (SENT)
I20260709 13:06:29.387789 23620 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:29.401191 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.388216 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:29.402030 22508 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.403499 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.406399 22504 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:29.405632 22508 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:29.371959 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:29.411767 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.412372 22504 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:06:29.382679 23076 leader_election.cc:336] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.800s (SENT)
W20260709 13:06:29.407851 23758 log.cc:927] Time spent T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:06:29.415761 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.420959 22504 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:29.409709 23620 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.423070 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.409158 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.435542 22499 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.415091 23687 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:29.440977 22500 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:29.427415 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.427794 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.421252 23689 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:29.429427 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 46784.4us
I20260709 13:06:29.430164 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:29.431169 22582 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.431739 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.432366 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:29.432713 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45041.8us
I20260709 13:06:29.432986 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.433509 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:29.434069 23620 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:29.417081 22575 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:29.434831 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 1736) took 1118 ms. Trace:
I20260709 13:06:29.428097 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:29.449668 23745 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:29.465231 22577 raft_consensus.cc:2376] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2. Re-sending same reply.
I20260709 13:06:29.468048 22433 rpcz_store.cc:276] 0709 13:06:28.316459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.877908 (+561449us) service_pool.cc:224] Handling call
0709 13:06:28.878178 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.122656 (+244478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.434575 (+311919us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54003acad4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:29.434768 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560874368}
I20260709 13:06:29.450215 23109 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.436111 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:29.451059 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.457697 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:29.470460 22576 raft_consensus.cc:2393] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:29.421495 23654 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.462541 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:29.471653 22578 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:06:29.468748 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.441742 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 839) took 1378 ms. Trace:
I20260709 13:06:29.479979 23079 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:29.480904 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:29.451339 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.423667 23708 consensus_queue.cc:1059] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:06:29.489475 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.485950 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:29.450843 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:29.489041 22433 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:29.462033 23665 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:06:29.494563 22425 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:29.495062 23079 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:29.498240 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.499006 22424 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:29.499979 23104 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:29.475123 22573 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:29.499464 23605 raft_consensus.cc:359] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:29.450491 23751 consensus_queue.cc:1059] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:29.481329 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.489104 23620 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:29.494388 23614 tablet_copy_client.cc:538] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:29.491808 23733 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:29.528457 22581 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:29.528549 22425 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:29.526382 23079 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:06:29.530701 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.492417 22499 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:29.475951 23654 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:29.521404 23605 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
W20260709 13:06:29.541194 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63275.7us
I20260709 13:06:29.530282 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.536695 22426 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:29.590713 22424 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:29.476315 22500 rpcz_store.cc:276] 0709 13:06:28.063456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.027973 (+964517us) service_pool.cc:224] Handling call
0709 13:06:29.028291 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.441449 (+413158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.441667 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.532202 23733 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:29.536521 23601 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:29.532969 23750 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:29.607221 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.533293 23678 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:06:29.589998 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:29.597968 23733 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.542953 23673 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:06:29.607671 23601 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:29.584712 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44157.4us
I20260709 13:06:29.741714 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:29.780364 23763 log.cc:927] Time spent T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:06:29.738328 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 194255us
W20260709 13:06:29.696877 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.724898 23743 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.861510 22545 leader_election.cc:336] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.628s (SENT)
I20260709 13:06:29.867888 22505 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
W20260709 13:06:29.808689 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 223524us
I20260709 13:06:29.887667 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:29.684752 23647 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.776397 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.724668 23744 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:29.770987 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:29.719923 23076 leader_election.cc:336] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.873s (SENT)
I20260709 13:06:29.877048 23601 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.895097 23743 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:29.898222 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:29.884722 22575 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.784569 23654 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:29.907697 23769 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.778069 23766 consensus_queue.cc:1059] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 13:06:29.891368 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:29.909874 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:29.907508 23744 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:29.921890 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.937052 22507 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:29.702363 23605 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:29.917035 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:29.916859 23708 consensus_queue.cc:1059] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:06:29.932307 23769 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:29.955709 23766 raft_consensus.cc:3055] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:29.955606 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 47569.9us
I20260709 13:06:29.956285 23751 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:29.932734 22426 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.906832 23647 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:29.922904 22501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 72) took 2660 ms (client timeout 1551 ms). Trace:
I20260709 13:06:29.964689 22431 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:29.911006 22500 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:29.971098 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:29.971820 23766 raft_consensus.cc:740] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:29.974267 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:29.974676 22580 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:29.973635 23708 raft_consensus.cc:3055] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:29.974877 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:29.978849 23689 consensus_meta.cc:287] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.003s
I20260709 13:06:29.978664 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:29.926124 23768 consensus_queue.cc:1059] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:06:29.980183 22432 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:29.908347 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:29.963894 23601 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:29.986440 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 293434us
W20260709 13:06:29.991012 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.984506 22507 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:29.999531 22504 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.006001 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:29.972348 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 48523us
I20260709 13:06:29.989387 23708 raft_consensus.cc:740] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:29.993584 23751 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:30.065949 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 56492.6us
I20260709 13:06:30.066524 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:30.067451 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:29.974865 23772 consensus_queue.cc:1059] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 13:06:30.074666 22545 leader_election.cc:336] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.524s (SENT)
I20260709 13:06:30.078118 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:30.065814 22427 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:30.076493 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:30.005388 23689 raft_consensus.cc:3055] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.068660 23750 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.083647 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:30.150424 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:30.151296 22431 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:30.072556 23768 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.088651 23766 consensus_queue.cc:260] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.080965 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:30.075559 23751 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:30.154234 23766 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.097774 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:30.099161 23743 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:30.099561 22507 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:30.156663 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:30.101984 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 364069us
I20260709 13:06:30.103520 23601 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:30.104797 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:30.157349 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.107146 23744 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:30.108686 23647 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:29.984772 22501 rpcz_store.cc:269] 0709 13:06:27.253091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.253594 (+   503us) service_pool.cc:224] Handling call
0709 13:06:29.901310 (+2647716us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54001761d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:29.909326 (+  8016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3580654976}
I20260709 13:06:30.158631 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.159371 22507 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:30.159477 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.160238 22501 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:30.161281 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.162436 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.163585 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.109691 23747 raft_consensus.cc:3055] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.164642 23747 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:30.160133 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:30.165693 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.165521 23747 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.166953 23747 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.113384 23733 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.169055 23113 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:30.170185 23733 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:30.151010 23709 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.081465 23740 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:30.077586 23764 consensus_queue.cc:1059] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:06:30.172421 23764 raft_consensus.cc:3055] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:30.150478 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 74087.8us
I20260709 13:06:30.172870 23764 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:30.173897 23764 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.175189 23764 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:30.118445 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.176611 23770 consensus_queue.cc:1059] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:30.150645 23689 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:30.123489 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:30.124491 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:30.126754 22575 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:30.157415 22500 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:30.153757 23768 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.156808 23751 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.187878 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:30.100346 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:30.196378 22579 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.157541 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.197790 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:30.178687 23689 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:30.212399 22396 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.164250 22501 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:30.225143 23647 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.212522 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.227051 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:30.227232 22575 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.227761 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.228436 22500 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:30.229094 23605 ts_tablet_manager.cc:1434] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.862s	user 0.029s	sys 0.057s
I20260709 13:06:30.226321 23647 raft_consensus.cc:697] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:30.213672 23689 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.230386 23647 consensus_queue.cc:237] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.231035 23614 tablet_bootstrap.cc:492] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
W20260709 13:06:30.217721 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.232677 23678 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.234081 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:30.219580 23770 raft_consensus.cc:3055] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.214957 23768 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:30.231863 23605 ts_tablet_manager.cc:1467] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Tablet startup took 872ms
I20260709 13:06:30.229429 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.258991 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.259618 22500 raft_consensus.cc:2376] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2. Re-sending same reply.
I20260709 13:06:30.260562 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.261273 22500 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:30.260612 22331 catalog_manager.cc:5697] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.262213 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.262861 22500 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:30.262548 22331 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.264683 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.215903 23766 consensus_queue.cc:1059] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
W20260709 13:06:30.268688 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 194034us
I20260709 13:06:30.269510 23766 raft_consensus.cc:3055] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.269940 23766 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:30.270754 23766 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.246201 22426 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.272260 23766 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.274858 22579 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:30.148907 23708 consensus_queue.cc:260] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.254153 23743 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.279400 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.279237 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.279831 23079 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:30.282270 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:30.264585 22331 catalog_manager.cc:5697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:30.289618 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51611.4us
I20260709 13:06:30.254411 23770 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:30.295622 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:30.296597 22424 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:30.297339 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.300894 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:30.291016 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:30.256318 23605 ts_tablet_manager.cc:1469] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Trace:
0709 13:06:22.970282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.970766 (+   484us) service_pool.cc:224] Handling call
0709 13:06:23.002194 (+ 31428us) ts_tablet_manager.cc:934] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
0709 13:06:23.211289 (+209095us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:23.381444 (+170155us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:23.381571 (+   127us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:23.424851 (+ 43280us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:23.425129 (+   278us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:23.425930 (+   801us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:23.426005 (+    75us) inbound_call.cc:177] Queueing success response
0709 13:06:27.890656 (+4464651us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:29.371643 (+1480987us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:29.449771 (+ 78128us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:29.465932 (+ 16161us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":278,"raft.queue_time_us":17320,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7806,"tablet-copy.queue_time_us":30596,"tablet-download-pool.queue_time_us":7676,"tablet-download-pool.run_cpu_time_us":5832,"tablet-download-pool.run_wall_time_us":3822180,"thread_start_us":170175,"threads_started":3}
I20260709 13:06:30.302492 23775 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.306355 23751 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.306720 23770 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.307952 23770 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.318106 23680 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.297271 23733 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:30.298341 23708 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.301860 22331 catalog_manager.cc:5697] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.318739 23680 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:30.327368 23680 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.328025 22331 catalog_manager.cc:5697] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.333391 22502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:57734
W20260709 13:06:30.346704 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.363540 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 64957.5us
W20260709 13:06:30.370363 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.327997 23741 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.384117 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:30.299757 23765 consensus_queue.cc:1059] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:06:30.334489 22502 raft_consensus.cc:606] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:30.331878 23775 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:30.335067 23733 raft_consensus.cc:697] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:30.385558 22331 catalog_manager.cc:5697] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.350126 23751 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:30.384532 23743 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:30.400101 22331 catalog_manager.cc:5697] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.393661 22502 raft_consensus.cc:614] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:30.384219 23772 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:30.406745 22331 catalog_manager.cc:5697] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.396564 23741 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.393028 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:30.399273 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:30.400940 23765 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:30.394332 23775 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:30.400204 23620 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:30.408118 23680 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.419184 22501 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:30.414034 23077 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:30.419792 23620 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.420732 23744 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.422051 23620 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:30.423290 23767 raft_consensus.cc:3055] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.424232 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.422015 23077 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:30.425876 23744 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:30.426254 23744 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.426573 23744 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.423731 23767 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:30.427747 23767 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.414168 23765 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:30.425063 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 854) took 1020 ms. Trace:
I20260709 13:06:30.428997 23765 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.429061 22508 rpcz_store.cc:276] 0709 13:06:29.404916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.414362 (+  9446us) service_pool.cc:224] Handling call
0709 13:06:30.424071 (+1009709us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:30.425006 (+   935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2848128}
I20260709 13:06:30.430234 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.431492 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.432013 22508 raft_consensus.cc:2376] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2. Re-sending same reply.
I20260709 13:06:30.432585 23733 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:30.433138 22545 leader_election.cc:336] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.546s (SENT)
I20260709 13:06:30.433986 23744 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.425091 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.435600 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 848) took 1048 ms. Trace:
I20260709 13:06:30.436054 23744 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:30.436764 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.436888 23077 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:30.416329 22331 catalog_manager.cc:5697] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.491300 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:30.494182 22545 leader_election.cc:336] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.573s (SENT)
I20260709 13:06:30.494732 22545 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.492647 22331 catalog_manager.cc:5697] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.411368 23772 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.413825 23775 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.499972 22331 catalog_manager.cc:5697] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:30.505326 23784 log.cc:927] Time spent T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:06:30.505983 23772 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:30.435914 22499 rpcz_store.cc:276] 0709 13:06:29.387295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.606488 (+219193us) service_pool.cc:224] Handling call
0709 13:06:30.424928 (+818440us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:30.435527 (+ 10599us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226274688}
I20260709 13:06:30.406231 23743 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.502822 23620 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:30.511809 22518 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-1dcd5807b34a410c9196ed1b6e80ace3 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:06:30.510360 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.512576 22518 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-1dcd5807b34a410c9196ed1b6e80ace3 on tablet 1dcd5807b34a410c9196ed1b6e80ace3 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:30.512907 22502 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:30.514029 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.514603 22502 raft_consensus.cc:2376] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2. Re-sending same reply.
I20260709 13:06:30.515547 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.516137 22502 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.521139 22508 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
W20260709 13:06:30.522048 23778 log.cc:927] Time spent T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:06:30.500771 23733 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.527218 22507 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:30.530403 22508 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.532596 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 852) took 1414 ms. Trace:
I20260709 13:06:30.532878 22508 rpcz_store.cc:276] 0709 13:06:29.118507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.529295 (+1410788us) service_pool.cc:224] Handling call
0709 13:06:30.529988 (+   693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.530889 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.532537 (+  1648us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:30.527868 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 73550.9us
I20260709 13:06:30.536144 22428 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.536295 23743 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:30.536880 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 1752) took 1057 ms. Trace:
I20260709 13:06:30.537250 22428 rpcz_store.cc:276] 0709 13:06:29.479066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.479193 (+   127us) service_pool.cc:224] Handling call
0709 13:06:30.535784 (+1056591us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:30.535975 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.536650 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.536828 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6525184}
W20260709 13:06:30.538056 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 87349.3us
W20260709 13:06:30.538637 22545 leader_election.cc:336] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.575s (SENT)
I20260709 13:06:30.540408 22545 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:30.541039 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 174004us
W20260709 13:06:30.541405 22545 leader_election.cc:336] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.584s (SENT)
I20260709 13:06:30.541924 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.543265 23076 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.541460 23104 raft_consensus.cc:1217] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:30.541524 23743 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:30.544994 22577 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.545101 23743 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.546030 22499 raft_consensus.cc:3055] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.546420 22499 raft_consensus.cc:740] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:30.546478 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:30.547214 23743 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:30.547744 23743 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:30.547856 22582 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.548032 23767 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.547251 22499 consensus_queue.cc:260] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:30.549676 22505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 79) took 1648 ms (client timeout 1514 ms). Trace:
W20260709 13:06:30.550117 22505 rpcz_store.cc:269] 0709 13:06:28.901237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.933889 (+ 32652us) service_pool.cc:224] Handling call
0709 13:06:30.549482 (+1615593us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54001829d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:30.549607 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802917632}
I20260709 13:06:30.550688 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 906) took 1011 ms. Trace:
I20260709 13:06:30.551388 23782 raft_consensus.cc:3055] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.551066 22425 rpcz_store.cc:276] 0709 13:06:29.539583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.544641 (+  5058us) service_pool.cc:224] Handling call
0709 13:06:29.590137 (+ 45496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.596836 (+  6699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.596865 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.596911 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:29.596937 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.596998 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.550495 (+953497us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b5400275e50. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:30.550617 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13137664}
I20260709 13:06:30.551923 23782 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:30.533190 23765 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.551774 22505 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:30.553584 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:30.553736 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 858) took 1419 ms. Trace:
I20260709 13:06:30.550266 22499 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.555428 22396 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:30.555361 22505 rpcz_store.cc:276] 0709 13:06:29.134114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.551003 (+1416889us) service_pool.cc:224] Handling call
0709 13:06:30.551389 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.553436 (+  2047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.553649 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:30.555545 22474 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:30.557508 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.558202 22506 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.558701 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 852) took 1170 ms. Trace:
I20260709 13:06:30.558971 22506 rpcz_store.cc:276] 0709 13:06:29.388336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.483628 (+ 95292us) service_pool.cc:224] Handling call
0709 13:06:30.557364 (+1073736us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:30.558644 (+  1280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11681664}
I20260709 13:06:30.559944 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.560030 23751 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:30.554229 22580 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:30.563651 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:30.565332 23751 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:30.569630 23752 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.570257 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 955) took 1145 ms. Trace:
I20260709 13:06:30.570654 22574 rpcz_store.cc:276] 0709 13:06:29.425078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.429490 (+  4412us) service_pool.cc:224] Handling call
0709 13:06:29.473010 (+ 43520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.481808 (+  8798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.484918 (+  3110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.492020 (+  7102us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:29.494171 (+  2151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.504824 (+ 10653us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.570081 (+1065257us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b5400198a50. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:30.570200 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87560448}
I20260709 13:06:30.567780 23620 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.572739 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:30.573383 22576 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:30.573446 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:30.573877 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55062 (request call id 47) took 1112 ms. Trace:
I20260709 13:06:30.574357 23104 raft_consensus.cc:2393] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:30.574241 22576 rpcz_store.cc:276] 0709 13:06:29.461752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.470937 (+  9185us) service_pool.cc:224] Handling call
0709 13:06:30.572569 (+1101632us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:30.573820 (+  1251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3644672}
I20260709 13:06:30.575975 23769 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:30.577093 23076 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:30.577781 23079 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:30.578379 23076 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:30.579257 23647 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.552872 23782 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:30.579749 23647 raft_consensus.cc:697] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:06:30.580417 23751 consensus_queue.cc:1175] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" responder_term: 1 status { last_received { term: 1 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 1 index: 2 } }
I20260709 13:06:30.580777 23647 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.580394 23790 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:30.583076 23790 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:30.583470 23790 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.584792 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.586082 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.586844 22506 raft_consensus.cc:2393] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:30.587661 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.590440 23776 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:30.593515 22506 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:30.594390 22474 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:30.606009 22545 leader_election.cc:336] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.720s (SENT)
I20260709 13:06:30.605139 22581 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:30.606475 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:30.608907 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 67021.2us
I20260709 13:06:30.595546 23776 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:30.612205 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.609787 22396 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.616052 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 840) took 1230 ms. Trace:
I20260709 13:06:30.613725 22506 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:30.616433 22505 rpcz_store.cc:276] 0709 13:06:29.385154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.565512 (+1180358us) service_pool.cc:224] Handling call
0709 13:06:30.595595 (+ 30083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.611523 (+ 15928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.611565 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:30.615796 (+  4231us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:30.615833 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.615890 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.616000 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:30.607991 23751 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:30.615226 23776 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.615227 23769 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.615583 23741 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.617237 23620 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.622128 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.624035 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.613555 23779 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:30.579772 23076 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:30.632467 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 846) took 1245 ms. Trace:
I20260709 13:06:30.632997 22504 rpcz_store.cc:276] 0709 13:06:29.386772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.422489 (+ 35717us) service_pool.cc:224] Handling call
0709 13:06:30.632276 (+1209787us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b5400182ed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:30.632400 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324230528}
I20260709 13:06:30.634164 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.635455 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.620280 23751 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:30.636749 23751 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.637246 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.637868 22500 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.638749 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.638839 22502 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
W20260709 13:06:30.632421 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 52718.7us
I20260709 13:06:30.640599 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.634271 23779 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:30.641410 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:30.641784 23779 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:30.644151 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.645534 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.645679 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.646632 22508 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.651444 22507 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:30.652323 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.654179 22499 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:30.653988 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.654769 23636 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:06:30.656273 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.658401 22399 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:30.644637 23765 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:30.656418 23113 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 3. Ops: []
I20260709 13:06:30.665936 22503 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.666144 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:30.666785 22573 raft_consensus.cc:2376] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2. Re-sending same reply.
I20260709 13:06:30.667276 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55062 (request call id 48) took 1134 ms. Trace:
I20260709 13:06:30.668105 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:30.668676 22428 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.669046 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:30.655635 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 855) took 1536 ms. Trace:
I20260709 13:06:30.653252 23647 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:30.661576 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.660002 23774 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:30.662186 23680 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:30.663626 23733 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.664654 23106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 245) took 1130 ms. Trace:
I20260709 13:06:30.676234 22581 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.696179 22578 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:30.629812 22506 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:30.682931 22396 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.667583 22573 rpcz_store.cc:276] 0709 13:06:29.533308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.539196 (+  5888us) service_pool.cc:224] Handling call
0709 13:06:30.665972 (+1126776us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:30.667218 (+  1246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2951424}
I20260709 13:06:30.685969 22507 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.698279 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.699352 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.700941 22576 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.687697 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:30.675190 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.702200 22501 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.702966 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.703178 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.689487 22574 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.690025 23779 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.672389 23782 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:30.709692 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.667779 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 858) took 1244 ms. Trace:
I20260709 13:06:30.703778 22501 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.707787 23673 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.718441 22507 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.682714 22502 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
W20260709 13:06:30.709968 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 62972.2us
I20260709 13:06:30.704104 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:30.720001 22545 leader_election.cc:336] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.782s (SENT)
I20260709 13:06:30.691120 23680 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:30.698849 23743 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.723059 23079 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:30.695955 23647 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:30.721524 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.724077 22545 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.718482 22504 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.727766 22428 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:30.705996 23733 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:30.732220 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.731351 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.733031 22504 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:30.733108 22507 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:30.713447 23779 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:30.734645 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.682740 22499 rpcz_store.cc:276] 0709 13:06:29.119207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.530508 (+1411301us) service_pool.cc:224] Handling call
0709 13:06:30.545891 (+ 15383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.654589 (+108698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.655580 (+   991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:30.737272 22504 raft_consensus.cc:2393] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:30.737758 22576 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.737721 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.739826 23077 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:30.740783 22396 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.745014 22581 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.733215 23733 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.767009 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:30.768282 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:30.769414 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:30.770048 22574 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
W20260709 13:06:30.772037 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.720091 22503 rpcz_store.cc:276] 0709 13:06:29.423711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.487510 (+ 63799us) service_pool.cc:224] Handling call
0709 13:06:30.656119 (+1168609us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:30.666445 (+ 10326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8383360}
I20260709 13:06:30.772718 22500 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.772702 23113 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.773653 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.774514 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.775125 22501 raft_consensus.cc:2376] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2. Re-sending same reply.
I20260709 13:06:30.775679 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.775990 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.776300 22500 raft_consensus.cc:2376] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2. Re-sending same reply.
I20260709 13:06:30.777308 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.778383 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.779019 22500 raft_consensus.cc:2376] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2. Re-sending same reply.
I20260709 13:06:30.767323 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 857) took 1633 ms. Trace:
I20260709 13:06:30.779538 22508 rpcz_store.cc:276] 0709 13:06:29.133656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.539885 (+1406229us) service_pool.cc:224] Handling call
0709 13:06:30.646323 (+106438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.651381 (+  5058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.767074 (+115693us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540021a7d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:30.767248 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244149632}
I20260709 13:06:30.747368 22507 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:30.780836 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.781634 22508 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:30.782436 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.783018 22508 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.783882 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.741343 23745 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:30.736244 23765 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:06:30.742107 23620 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:30.749154 22545 leader_election.cc:336] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.616s (SENT)
I20260709 13:06:30.790727 22545 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.746464 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.729050 23680 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.784454 22508 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:30.772351 22574 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.790079 22424 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.794246 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:30.798645 22506 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.794539 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:30.795567 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.781118 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.799546 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.800012 22508 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.751444 23752 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.800026 22507 raft_consensus.cc:2376] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2. Re-sending same reply.
W20260709 13:06:30.800593 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.802794 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.801352 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 60653.8us
I20260709 13:06:30.796176 22504 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:30.803375 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.803045 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.733932 23676 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:06:30.803123 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.804311 23752 raft_consensus.cc:697] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:30.798070 23779 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:30.806481 23746 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.811543 23654 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:30.812052 23779 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:30.811383 23752 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.817137 22573 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.819160 23783 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.810323 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:30.813066 22399 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:30.794613 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.731305 23743 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.813997 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.794533 22501 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.698897 23106 rpcz_store.cc:276] 0709 13:06:29.534095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.535840 (+  1745us) service_pool.cc:224] Handling call
0709 13:06:29.628634 (+ 92794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.984745 (+356111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.986023 (+  1278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.989924 (+  3901us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:29.994683 (+  4759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.664377 (+669694us) spinlock_profiling.cc:243] Waited 96.3 ms on lock 0x7b54004a4a54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:30.664426 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.664564 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221497728}
I20260709 13:06:30.830317 22507 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:30.830878 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:30.813220 23738 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:30.831900 23779 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:30.833151 23800 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
I20260709 13:06:30.833350 23673 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:30.836416 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.813344 23769 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 13:06:30.861285 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51069.1us
I20260709 13:06:30.862087 22396 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:30.841640 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.839920 22504 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:30.790187 23775 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.845116 22508 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.804631 23788 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:06:30.820361 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.805927 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:30.847107 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.822798 23783 raft_consensus.cc:3055] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.853623 22579 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:30.854372 23743 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:30.820289 23678 consensus_queue.cc:1059] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:30.856590 23647 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:30.805835 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 63598.5us
I20260709 13:06:30.803664 23776 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:30.857947 23751 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.858440 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:30.801944 23665 raft_consensus.cc:3055] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:30.858989 23765 raft_consensus.cc:2764] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:30.859745 23614 tablet_bootstrap.cc:492] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:30.811813 23774 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:30.838001 23790 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:30.873122 22504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:06:30.953624 22331 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33162 (request call id 242) took 1451 ms. Trace:
I20260709 13:06:30.954125 22504 raft_consensus.cc:606] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:30.876796 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.870609 23673 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.874401 22505 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
W20260709 13:06:30.883031 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.882730 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 845) took 1496 ms. Trace:
I20260709 13:06:30.961977 22508 rpcz_store.cc:276] 0709 13:06:29.386508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.881969 (+1495461us) service_pool.cc:224] Handling call
0709 13:06:30.882239 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.882425 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.882451 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:30.882488 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:30.882515 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.882564 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.882675 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:30.883314 22506 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:30.964462 22506 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:30.917140 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.965381 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.965739 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.906314 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:30.915977 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:30.944170 22507 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
W20260709 13:06:30.945674 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 56718.9us
I20260709 13:06:30.883191 23788 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.877475 23104 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:30.950814 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 132724us
I20260709 13:06:30.865125 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:30.875002 23076 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:30.881508 23775 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:30.880285 23773 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:30.884253 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:30.890172 23687 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.883728 23783 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:30.992738 23773 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:30.996117 23773 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.945025 23665 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:30.996376 23783 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:30.997836 23783 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.001087 23665 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:31.001646 22499 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:30.958014 22327 catalog_manager.cc:5697] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:31.002396 23665 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.959048 22501 raft_consensus.cc:2393] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:06:31.007318 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 132427us
I20260709 13:06:30.946241 23678 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:30.953100 23751 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:31.009130 23752 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:30.876945 22500 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
W20260709 13:06:30.972366 22472 connection.cc:256] RPC call timeout handler was delayed by -1.6642933869999297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:06:31.010104 22472 connection.cc:256] RPC call timeout handler was delayed by -1.6093933869999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:06:31.010449 22472 connection.cc:256] RPC call timeout handler was delayed by -1.60039338699994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:06:31.010715 22472 connection.cc:256] RPC call timeout handler was delayed by -1.5940933869999299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:06:31.010982 22472 connection.cc:256] RPC call timeout handler was delayed by -1.5697933869998906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 13:06:30.977229 22505 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:30.954600 22504 raft_consensus.cc:614] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:30.938917 23680 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:31.012081 23666 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.982635 23109 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:31.012691 22425 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:30.994513 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 88309.5us
I20260709 13:06:31.014119 22577 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:31.016201 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:31.009706 23752 raft_consensus.cc:697] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:06:31.011240 22472 connection.cc:256] RPC call timeout handler was delayed by -1.4842933869999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:06:31.019171 22472 connection.cc:256] RPC call timeout handler was delayed by -1.4356933869999011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:06:31.019517 22472 connection.cc:256] RPC call timeout handler was delayed by -1.422193386999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 13:06:31.019801 22472 connection.cc:256] RPC call timeout handler was delayed by -1.4185933869999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 13:06:31.017479 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.020097 22472 connection.cc:256] RPC call timeout handler was delayed by -1.3969933869999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 13:06:31.020442 22472 connection.cc:256] RPC call timeout handler was delayed by -1.3681933869999057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 13:06:31.018375 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 855) took 1609 ms. Trace:
I20260709 13:06:30.973428 23788 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:31.020772 22472 connection.cc:256] RPC call timeout handler was delayed by -1.3483933869999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:06:31.022790 22472 connection.cc:256] RPC call timeout handler was delayed by -1.3465933869999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
W20260709 13:06:31.023115 22472 connection.cc:256] RPC call timeout handler was delayed by -1.2727933869999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 13:06:31.023387 22472 connection.cc:256] RPC call timeout handler was delayed by -1.2403933869999264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 13:06:31.023645 22472 connection.cc:256] RPC call timeout handler was delayed by -1.2034933869999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
W20260709 13:06:31.023921 22472 connection.cc:256] RPC call timeout handler was delayed by -1.1719933869999295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 13:06:31.024180 22472 connection.cc:256] RPC call timeout handler was delayed by -1.1620933869999135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:06:31.024436 22472 connection.cc:256] RPC call timeout handler was delayed by -1.1521933869998975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 13:06:31.024724 22472 connection.cc:256] RPC call timeout handler was delayed by -1.1350933869999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 13:06:31.025573 22472 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:31.025877 23680 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:30.993862 22503 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:31.020992 22508 rpcz_store.cc:276] 0709 13:06:29.408640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.962988 (+1554348us) service_pool.cc:224] Handling call
0709 13:06:30.963340 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.986893 (+ 23553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.986922 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.018139 (+ 31217us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:31.018177 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.018233 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.018326 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.029074 22506 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:31.011236 23790 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:30.993510 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:31.070648 23776 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:31.071373 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 76250.4us
I20260709 13:06:30.953992 22331 rpcz_store.cc:276] 0709 13:06:29.497440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.497593 (+   153us) service_pool.cc:224] Handling call
0709 13:06:30.948490 (+1450897us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:30.646158 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:30.649663 (+  3505us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:30.649723 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:06:30.649757 (+    34us) tablet.cc:662] Decoding operations
0709 13:06:30.659660 (+  9903us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:30.659747 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:30.659772 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:06:30.708088 (+ 48316us) tablet.cc:701] Row locks acquired
0709 13:06:30.708127 (+    39us) write_op.cc:260] PREPARE: finished
0709 13:06:30.708283 (+   156us) write_op.cc:270] Start()
0709 13:06:30.708423 (+   140us) write_op.cc:276] Timestamp: P: 1783602390708227 usec, L: 0
0709 13:06:30.708459 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:06:30.712876 (+  4417us) log.cc:844] Serialized 4374 byte log entry
0709 13:06:30.917705 (+204829us) op_driver.cc:464] REPLICATION: finished
0709 13:06:30.919124 (+  1419us) write_op.cc:301] APPLY: starting
0709 13:06:30.919206 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:30.919496 (+   290us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:30.919683 (+   187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:30.921177 (+  1494us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:30.921478 (+   301us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:06:30.921524 (+    46us) write_op.cc:312] APPLY: finished
0709 13:06:30.921890 (+   366us) log.cc:844] Serialized 83 byte log entry
0709 13:06:30.929420 (+  7530us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.929544 (+   124us) write_op.cc:454] Released schema lock
0709 13:06:30.929619 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:30.930026 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.930052 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":1074,"apply.run_cpu_time_us":3575,"apply.run_wall_time_us":10870,"num_ops":11,"prepare.queue_time_us":71254,"prepare.run_cpu_time_us":13338,"prepare.run_wall_time_us":92770,"raft.queue_time_us":25706,"raft.run_cpu_time_us":1773,"raft.run_wall_time_us":16127,"replication_time_us":196999,"thread_start_us":87551,"threads_started":4,"wal-append.queue_time_us":19946}]]}
I20260709 13:06:31.022243 23740 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:06:31.072829 22396 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:31.062244 23788 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:31.073378 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 56026.8us
I20260709 13:06:31.074962 23754 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:31.075495 23774 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:31.076579 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.063297 23752 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:31.078490 23745 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:31.080083 23650 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.064169 23614 tablet_bootstrap.cc:492] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:06:31.081346 23614 ts_tablet_manager.cc:1403] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.851s	user 0.034s	sys 0.026s
I20260709 13:06:31.082914 22508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:57734
I20260709 13:06:31.083568 22508 raft_consensus.cc:606] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:31.083933 22508 raft_consensus.cc:614] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:31.095681 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 70156.2us
I20260709 13:06:31.030558 22502 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:31.132539 22506 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.129583 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:31.139026 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.140275 22508 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.145777 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:31.146971 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.150159 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.151101 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.151880 22508 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:31.118672 23772 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.145340 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.155797 22505 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:06:31.115479 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 95316.4us
I20260709 13:06:31.142169 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:31.134845 23673 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:06:31.181568 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.182265 22505 raft_consensus.cc:2368] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3.
I20260709 13:06:31.134253 23680 consensus_queue.cc:1059] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:31.158160 23772 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:31.190245 22506 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:31.191098 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.191666 22506 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:31.192332 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.180776 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:31.199275 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:31.200856 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.202075 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.202757 22508 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:31.205121 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.205988 22505 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:31.160441 23676 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:06:31.170665 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.216965 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.195740 23772 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.237191 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.221511 22506 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:31.181473 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.242449 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.243453 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:31.245528 22508 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:31.246632 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.244589 22472 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:31.247378 22508 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:31.248136 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.249801 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:31.250599 22426 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:31.250818 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:31.251438 22433 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 3. Ops: []
I20260709 13:06:31.251737 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:31.251881 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:31.252405 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:31.253093 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:31.253484 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:31.254238 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:31.254484 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:31.255064 22433 raft_consensus.cc:2376] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2. Re-sending same reply.
I20260709 13:06:31.255607 22428 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:31.256669 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:31.256013 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:31.254997 22431 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:06:31.237025 23808 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:06:31.260908 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:31.218065 23672 consensus_queue.cc:1059] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:31.255491 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:31.265583 22506 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:31.264279 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.259357 22502 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:31.274253 22429 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:31.258201 22430 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:31.251461 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:31.252738 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:31.280068 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:31.276837 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.238922 23752 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:31.291846 22433 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:31.312167 22506 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:31.292255 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.313369 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.293561 22579 raft_consensus.cc:2955] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:31.295076 23666 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:31.308648 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 175001us
W20260709 13:06:31.309048 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.313763 22507 raft_consensus.cc:2376] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2. Re-sending same reply.
I20260709 13:06:31.273944 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.262916 23814 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
W20260709 13:06:31.347365 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 98635.7us
W20260709 13:06:31.422952 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.459692 22545 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:31.459709 23738 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:31.313933 22506 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.313930 22505 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:31.464051 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.293406 23614 raft_consensus.cc:359] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:31.469954 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.470384 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:31.507313 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.507827 22505 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:06:31.394052 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 178221us
I20260709 13:06:31.461037 22396 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:31.397066 22427 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:31.547209 22426 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
W20260709 13:06:31.547873 23820 log.cc:927] Time spent T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:06:31.549528 23813 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:06:31.550000 22503 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:31.540290 23665 consensus_meta.cc:287] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:06:31.551523 22503 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.536427 22506 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
W20260709 13:06:31.350455 23799 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.002s
I20260709 13:06:31.270535 23636 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:31.565280 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 293884us
I20260709 13:06:31.566282 22472 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:31.567989 22424 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:06:31.571480 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 62044.4us
I20260709 13:06:31.400427 23782 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:31.457541 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:31.526645 23614 raft_consensus.cc:740] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:06:31.455886 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:31.433900 23773 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:31.400638 23751 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.382015 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 102734us
I20260709 13:06:31.353246 23775 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.234s
I20260709 13:06:31.445273 23744 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.207s
I20260709 13:06:31.669873 22503 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:31.566385 23636 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:31.529408 22499 raft_consensus.cc:2376] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2. Re-sending same reply.
I20260709 13:06:31.582221 23650 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:31.677498 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.679226 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.717280 22425 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:31.668653 22501 raft_consensus.cc:2376] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2. Re-sending same reply.
I20260709 13:06:31.679540 23776 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.680791 23636 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.666055 23077 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:31.674230 23751 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:31.762516 23788 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.777694 23783 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.778343 23783 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:31.719797 23825 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:31.781059 23825 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:31.781553 23825 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:31.789629 23827 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:31.816056 22505 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:31.822021 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.846352 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.847234 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 387569us
I20260709 13:06:31.754215 23776 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:31.719702 23614 consensus_queue.cc:260] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:31.808491 23752 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:31.965895 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 399701us
I20260709 13:06:31.723749 23782 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.987253 23782 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:31.987665 23782 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.987816 22472 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:31.989403 22472 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:31.990536 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:31.991672 23838 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.992074 23838 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:31.992769 23829 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:31.993546 23829 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.993883 23829 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:31.994211 23829 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:31.995433 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.966239 22545 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:31.854377 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 270514us
W20260709 13:06:31.968600 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 507596us
W20260709 13:06:31.970413 22548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.024s	sys 0.044s
W20260709 13:06:31.997665 22548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.024s	sys 0.045s
I20260709 13:06:31.974803 23825 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:31.981017 23828 log.cc:927] Time spent T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:06:31.968820 23783 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:31.981452 23769 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.985303 23837 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:06:32.008126 22472 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:32.013798 22472 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:31.992405 23838 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.013898 23826 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:32.011102 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 44940.2us
W20260709 13:06:32.054620 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.066267 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 46964.5us
W20260709 13:06:32.099220 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 79141.2us
W20260709 13:06:32.102082 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 88360.3us
I20260709 13:06:32.103060 22472 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:06:32.109259 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 111398us
I20260709 13:06:32.110989 23773 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:32.111517 22546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.022s	sys 0.028s
W20260709 13:06:32.111843 22546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.022s	sys 0.028s
W20260709 13:06:32.112408 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.112432 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49351.7us
I20260709 13:06:32.122931 22576 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.123457 22581 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:32.027304 23783 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.126375 22396 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:32.125967 22546 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.601s (SENT) [suppressed 107 similar messages]
I20260709 13:06:32.029718 23826 raft_consensus.cc:697] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:32.015381 23769 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:32.131860 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 64524.7us
I20260709 13:06:32.136812 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.023358 23782 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:32.141826 22577 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.143548 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:32.145224 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:32.143962 23772 consensus_meta.cc:287] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.895s	user 0.010s	sys 0.000s
I20260709 13:06:32.155608 23843 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:32.156252 22546 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.616s (SENT)
W20260709 13:06:32.141229 23672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.028s	sys 0.030s
I20260709 13:06:32.125041 23744 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:32.156328 22472 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:32.139758 23745 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:32.157380 22396 leader_election.cc:400] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3.
I20260709 13:06:32.158701 22546 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.162403 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.139634 23109 raft_consensus.cc:2955] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:32.163452 22503 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:32.166990 22472 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:32.156394 23852 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:32.160759 23672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.028s	sys 0.031s
I20260709 13:06:32.159720 23751 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:32.155586 23846 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.267066 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:32.145390 23835 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:06:32.268222 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 111990us
I20260709 13:06:32.266464 23741 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:32.274019 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 107623us
I20260709 13:06:32.274473 22576 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:32.168081 23614 ts_tablet_manager.cc:1434] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 1.082s	user 0.010s	sys 0.005s
W20260709 13:06:32.175851 22545 connection.cc:256] RPC call timeout handler was delayed by -1.3623310059999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260709 13:06:32.160095 23772 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:32.123343 23765 raft_consensus.cc:2955] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:32.166332 23843 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.284660 23782 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.166630 23825 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:32.217887 23744 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:06:32.276439 22546 leader_election.cc:336] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.625s (SENT)
I20260709 13:06:32.165452 23814 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 13:06:32.325291 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:32.290969 23614 ts_tablet_manager.cc:1467] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Tablet startup took 1209ms
I20260709 13:06:32.277251 23752 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:32.291668 22396 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.286901 23840 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:32.168542 23834 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.287s
I20260709 13:06:32.327827 23744 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.328028 23840 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:32.330595 23840 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:32.331218 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 44602.9us
I20260709 13:06:32.332190 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:32.332522 22502 consensus_meta.cc:287] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.000s
I20260709 13:06:32.332974 22502 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:32.333570 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 900) took 1141 ms. Trace:
I20260709 13:06:32.334247 23757 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.335093 23757 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:32.305359 23745 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.305891 23841 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.306308 23774 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:32.309839 23740 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:32.313196 23845 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.206s	user 0.002s	sys 0.000s
I20260709 13:06:32.314169 23754 raft_consensus.cc:3055] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.360627 23754 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:32.361550 23754 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.362754 23754 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.292306 23750 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:32.364845 23750 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:32.316692 23847 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.317940 23849 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.367085 23825 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.384624 23849 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:32.385149 23849 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.384835 23825 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.323033 23782 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.285619 23751 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.293563 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:32.333915 22396 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.336426 22508 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:06:32.337579 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 61170.3us
W20260709 13:06:32.389616 22546 leader_election.cc:336] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.629s (SENT)
I20260709 13:06:32.390105 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:32.326149 23614 ts_tablet_manager.cc:1469] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Trace:
0709 13:06:23.218166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.218544 (+   378us) service_pool.cc:224] Handling call
0709 13:06:23.346098 (+127554us) ts_tablet_manager.cc:934] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
0709 13:06:26.124122 (+2778024us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:26.455339 (+331217us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:26.455471 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:26.889880 (+434409us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:26.943230 (+ 53350us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:26.967637 (+ 24407us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:26.973320 (+  5683us) inbound_call.cc:177] Queueing success response
0709 13:06:27.690632 (+717312us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4c001ef5c0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b0eea20 00007f006b0ffa29 00007f006b0a45e6 00007f006b0b9b13 00007f006b0b9945 00007f006b12c7ad 00007f0071e00198 00007f0071e00137 00007f0071e0009c 00007f0071e00038 00007f0071dff300
0709 13:06:30.230652 (+2540020us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:31.081679 (+851027us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:31.200995 (+119316us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:31.201610 (+   615us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":69363,"raft.queue_time_us":2697,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":8673,"spinlock_wait_cycles":52917632,"tablet-copy.queue_time_us":96035,"tablet-download-pool.queue_time_us":218,"tablet-download-pool.run_cpu_time_us":1983,"tablet-download-pool.run_wall_time_us":1781115,"thread_start_us":255253,"threads_started":2}
I20260709 13:06:32.342505 22424 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.341666 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 942) took 1093 ms. Trace:
W20260709 13:06:32.346601 23788 consensus_meta.cc:287] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.000s
I20260709 13:06:32.347261 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 913) took 1005 ms. Trace:
I20260709 13:06:32.348135 22427 raft_consensus.cc:3055] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:32.166846 23826 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:32.350291 23822 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 1.064s	user 0.003s	sys 0.004s
I20260709 13:06:32.400730 23741 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.350873 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:32.400974 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:32.341820 23843 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.357990 23772 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.318840 23776 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.359707 23745 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:32.366428 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.409232 22428 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:32.333899 22502 rpcz_store.cc:276] 0709 13:06:31.191960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.353349 (+161389us) service_pool.cc:224] Handling call
0709 13:06:32.333501 (+980152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.398837 22427 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:32.351816 23636 consensus_meta.cc:287] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.000s
I20260709 13:06:32.401695 22577 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:32.330596 23744 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.393329 23782 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:32.408314 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 993) took 1310 ms. Trace:
W20260709 13:06:32.416626 22546 leader_election.cc:336] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.713s (SENT)
W20260709 13:06:32.424831 22546 leader_election.cc:336] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.775s (SENT)
I20260709 13:06:32.391225 23750 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.428188 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:32.410952 23751 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.367928 23841 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:32.374536 23740 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.366317 23774 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.417343 22578 rpcz_store.cc:276] 0709 13:06:31.098030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.098188 (+   158us) service_pool.cc:224] Handling call
0709 13:06:31.098554 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.125696 (+ 27142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.125729 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.138467 (+ 12738us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.276138 (+137671us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:31.276177 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.276245 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.349631 (+1073386us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:32.401480 (+ 51849us) raft_consensus.cc:1685] finished
0709 13:06:32.401502 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.408240 (+  6738us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3147,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":16533,"spinlock_wait_cycles":9933184,"thread_start_us":99641,"threads_started":1,"wal-append.queue_time_us":125559}
W20260709 13:06:32.431602 23817 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.202s	user 0.010s	sys 0.016s
I20260709 13:06:32.432175 23846 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:32.465827 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:32.419914 23782 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.426578 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:32.421324 23769 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.414968 23636 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:32.477605 23854 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.479329 23636 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.480273 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:32.480997 23104 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:32.399221 22499 rpcz_store.cc:276] 0709 13:06:31.341646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.972728 (+631082us) service_pool.cc:224] Handling call
0709 13:06:31.973092 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.976070 (+  2978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.976104 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.976659 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.146051 (+169392us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:32.152597 (+  6546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.160208 (+  7611us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.341887 (+181679us) raft_consensus.cc:1685] finished
0709 13:06:32.347006 (+  5119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.347195 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2503,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":146,"thread_start_us":160476,"threads_started":1,"wal-append.queue_time_us":347379}
I20260709 13:06:32.483862 23841 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.484817 22499 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:32.485595 23750 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.472757 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 995) took 1373 ms. Trace:
I20260709 13:06:32.487195 22575 rpcz_store.cc:276] 0709 13:06:31.099740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.103574 (+  3834us) service_pool.cc:224] Handling call
0709 13:06:31.199899 (+ 96325us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:32.403298 (+1203399us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfde9c 00007f0069cfda5b 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:32.413837 (+ 10539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.433723 (+ 19886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.451651 (+ 17928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.471026 (+ 19375us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:32.472467 (+  1441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.472562 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.472694 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29651072}
I20260709 13:06:32.395223 22426 rpcz_store.cc:276] 0709 13:06:31.247843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.251205 (+  3362us) service_pool.cc:224] Handling call
0709 13:06:32.341427 (+1090222us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540043c454. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:32.341587 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491790080}
I20260709 13:06:32.471148 22427 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.458935 23751 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:32.494738 22427 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.496577 23751 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.474330 23774 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:32.418398 23776 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:06:32.429601 23678 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.429152 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:32.502374 23772 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.502703 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 880) took 1364 ms. Trace:
I20260709 13:06:32.432559 23745 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:32.506408 23825 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:32.503202 22500 rpcz_store.cc:276] 0709 13:06:31.138691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.154395 (+ 15704us) service_pool.cc:224] Handling call
0709 13:06:32.420153 (+1265758us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:32.502633 (+ 82480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14613888}
I20260709 13:06:32.471328 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:32.417902 23814 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:06:32.419895 23733 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:06:32.502971 23772 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:32.508284 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:32.510159 23636 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:32.510764 23636 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.513710 23751 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.514287 23751 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:32.501852 23740 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:32.530913 23848 log.cc:927] Time spent T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.249s	user 0.004s	sys 0.000s
I20260709 13:06:32.532254 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 911) took 1273 ms. Trace:
I20260709 13:06:32.532680 22504 rpcz_store.cc:276] 0709 13:06:31.258823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.765371 (+506548us) service_pool.cc:224] Handling call
0709 13:06:31.993205 (+227834us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:31.993412 (+   207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.993737 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.993762 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.994215 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.134135 (+139920us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:32.162642 (+ 28507us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.417737 (+255095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.417813 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.515917 (+ 98104us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:32.532010 (+ 16093us) raft_consensus.cc:1685] finished
0709 13:06:32.532046 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.532190 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6071,"prepare.queue_time_us":28474,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":1444,"raft.queue_time_us":143258,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":35793,"spinlock_wait_cycles":93685120,"thread_start_us":397608,"threads_started":3,"wal-append.queue_time_us":154089}
W20260709 13:06:32.536166 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 111368us
W20260709 13:06:32.537106 22546 leader_election.cc:336] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.895s (SENT)
I20260709 13:06:32.540998 23824 raft_consensus.cc:3055] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.541538 23824 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:32.542447 23824 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:32.555953 22545 leader_election.cc:336] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.028s (SENT)
I20260709 13:06:32.559558 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:32.510244 23772 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.544368 23636 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:32.563436 22546 leader_election.cc:336] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.518s (SENT)
I20260709 13:06:32.566349 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:32.567042 22579 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
W20260709 13:06:32.568758 22545 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.043s (SENT)
W20260709 13:06:32.571787 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 404859us
W20260709 13:06:32.574610 22545 connection.cc:256] RPC call timeout handler was delayed by -1.2132968760000722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 13:06:32.575264 22545 leader_election.cc:336] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.057s (SENT)
W20260709 13:06:32.575896 22545 connection.cc:256] RPC call timeout handler was delayed by -1.1953048400000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:06:32.576341 22545 connection.cc:256] RPC call timeout handler was delayed by -1.1052968760000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260709 13:06:32.576668 22545 connection.cc:256] RPC call timeout handler was delayed by -1.0933313169999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 13:06:32.577111 22545 connection.cc:256] RPC call timeout handler was delayed by -1.0340724150000824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 13:06:32.579509 22545 leader_election.cc:336] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.847s (SENT)
I20260709 13:06:32.579602 22472 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:32.579957 22545 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.565430 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:32.607260 22545 leader_election.cc:336] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.895s (SENT)
I20260709 13:06:32.607775 22545 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:32.624702 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 52059.6us
I20260709 13:06:32.639853 23833 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.640013 23104 raft_consensus.cc:1217] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:06:32.641733 22545 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.941s (SENT)
W20260709 13:06:32.642362 22545 leader_election.cc:336] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.975s (SENT)
I20260709 13:06:32.642809 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:32.644423 22546 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.941s (SENT)
I20260709 13:06:32.645301 22546 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.655180 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:32.655330 22546 leader_election.cc:336] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.002s (SENT)
I20260709 13:06:32.655586 23846 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.655088 23833 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:32.657613 22545 leader_election.cc:336] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.991s (SENT)
I20260709 13:06:32.660494 22545 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.658401 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:32.637322 23740 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.635392 23636 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:32.636790 23825 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.691291 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:32.691530 22472 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:32.702828 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 310384us
W20260709 13:06:32.702965 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45432.4us
W20260709 13:06:32.703877 22545 leader_election.cc:336] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.002s (SENT)
I20260709 13:06:32.704401 22545 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.746047 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:32.706698 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:32.713223 22545 leader_election.cc:336] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.028s (SENT)
I20260709 13:06:32.749454 22472 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:06:32.750901 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.752736 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.750845 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:32.751932 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:32.766781 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53623.2us
W20260709 13:06:32.767731 22545 leader_election.cc:336] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.146s (SENT)
I20260709 13:06:32.768088 22545 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.768841 23825 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.769629 23775 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:06:32.770233 22545 leader_election.cc:336] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.156s (SENT)
I20260709 13:06:32.765447 22577 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:32.771647 22472 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:32.662452 23772 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:32.692031 23846 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.704166 23854 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:32.692404 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 428047us
I20260709 13:06:32.746474 23847 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.759756 23833 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:32.783128 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 449265us
I20260709 13:06:32.747229 23620 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.765555 23851 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:32.784790 22546 leader_election.cc:336] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.135s (SENT)
I20260709 13:06:32.794495 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:32.703712 23740 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.797895 22472 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:32.774907 23783 raft_consensus.cc:2764] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:32.770253 23775 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:32.805892 22545 leader_election.cc:336] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.193s (SENT)
I20260709 13:06:32.810052 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.812551 22396 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.819962 23113 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:32.784677 23846 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:32.823781 22545 leader_election.cc:336] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.215s (SENT)
I20260709 13:06:32.824275 22545 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.825122 23854 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.825405 23846 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:32.796970 23636 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.827059 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:32.796653 23803 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.834003 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 941) took 1586 ms. Trace:
I20260709 13:06:32.834466 22428 rpcz_store.cc:276] 0709 13:06:31.247609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.257453 (+  9844us) service_pool.cc:224] Handling call
0709 13:06:32.833802 (+1576349us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540043ab54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:32.833933 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2638056320}
W20260709 13:06:32.846321 22508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 887) took 1683 ms (client timeout 2211 ms). Trace:
W20260709 13:06:32.846808 22508 rpcz_store.cc:269] 0709 13:06:31.162861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.247912 (+ 85051us) service_pool.cc:224] Handling call
0709 13:06:32.846072 (+1598160us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54004259d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:32.846252 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500623232}
I20260709 13:06:32.850986 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:32.851198 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:32.852846 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:32.854597 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:32.855268 22507 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:32.856400 23851 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.856987 23851 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:32.805773 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:32.832274 23636 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:32.826355 23772 consensus_queue.cc:1059] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:32.881335 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48965.3us
I20260709 13:06:32.816622 23847 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.828665 23788 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:32.886348 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 62587.6us
W20260709 13:06:32.887149 22545 leader_election.cc:336] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.217s (SENT)
I20260709 13:06:32.887553 22545 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.804778 23620 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.877135 23636 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:32.881700 23829 consensus_meta.cc:287] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.872s	user 0.007s	sys 0.004s
W20260709 13:06:32.898712 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 107475us
I20260709 13:06:32.925050 22399 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:32.925845 23757 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:32.925981 23840 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.927551 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:32.927811 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45789.2us
I20260709 13:06:32.928571 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:32.883186 23744 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.929329 23744 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.931339 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:32.931547 23744 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.882257 23814 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:06:32.892988 23754 consensus_meta.cc:287] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260709 13:06:32.937239 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 103) took 1067 ms. Trace:
I20260709 13:06:32.937696 22502 rpcz_store.cc:276] 0709 13:06:31.870300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.481256 (+610956us) service_pool.cc:224] Handling call
0709 13:06:32.481633 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.482025 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.482057 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.482628 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.796905 (+314277us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:32.808702 (+ 11797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.811867 (+  3165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.936994 (+125127us) raft_consensus.cc:1685] finished
0709 13:06:32.937012 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.937178 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4956,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":104,"thread_start_us":303502,"threads_started":1,"wal-append.queue_time_us":451073}
I20260709 13:06:32.940359 23620 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:32.941174 23858 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.924198 23847 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.943414 23847 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.943763 23847 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.944114 22573 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.926273 23757 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.947117 23834 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:32.959223 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:32.964862 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 918) took 1503 ms. Trace:
W20260709 13:06:33.039143 23750 consensus_meta.cc:287] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.553s	user 0.005s	sys 0.006s
I20260709 13:06:32.957801 23751 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.950372 23835 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.966737 23824 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.958405 23814 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:32.883123 23773 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.969246 23745 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.970153 23775 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.974556 23736 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:32.975517 23858 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.877143 22575 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:32.877410 23856 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.145s
I20260709 13:06:32.976387 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:32.923395 23829 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:32.891855 23788 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:32.947530 23862 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:32.932909 23740 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:32.946645 23872 log.cc:927] Time spent T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:06:32.952868 23849 consensus_meta.cc:287] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
W20260709 13:06:32.955847 23838 consensus_meta.cc:287] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.928s	user 0.003s	sys 0.004s
I20260709 13:06:32.869199 23851 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:32.999792 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-ee6d9e2f597948e7b4670b3606ebf448 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:06:32.969305 22398 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:33.039415 23855 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.041504 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:33.054507 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:32.938903 22427 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:33.056248 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.130842 22431 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:32.966063 22396 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:33.085973 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 198908us
I20260709 13:06:33.054801 23757 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.054044 23834 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:33.085738 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.103958 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.155814 22574 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:33.087599 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.091012 23751 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.131549 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.132781 23887 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.145694 23773 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:33.140328 22429 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.140453 22576 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:32.960129 23782 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.125116 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1006) took 1811 ms. Trace:
I20260709 13:06:33.151079 22508 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.144927 22433 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:33.153318 22506 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:33.148898 22545 leader_election.cc:336] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.243s (SENT)
I20260709 13:06:33.138870 23849 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.156798 22507 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.162285 22578 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:33.113907 23736 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:33.175145 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 209143us
W20260709 13:06:33.137733 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 168484us
I20260709 13:06:33.180014 22576 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.146348 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-ee6d9e2f597948e7b4670b3606ebf448 on tablet ee6d9e2f597948e7b4670b3606ebf448 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:33.140627 23851 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.170303 22545 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:33.173244 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 320853us
I20260709 13:06:33.137508 23838 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.183362 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:33.145627 23738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.019s	sys 0.035s
I20260709 13:06:33.186673 22396 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:33.193343 22508 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.168933 23773 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:33.193742 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:33.167438 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.177163 23745 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.192730 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.201263 22504 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:33.201869 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53005.4us
I20260709 13:06:33.166838 23887 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.203150 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:33.203840 22433 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.204663 23847 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.086532 22503 rpcz_store.cc:276] 0709 13:06:31.461165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.316705 (+855540us) service_pool.cc:224] Handling call
0709 13:06:32.317166 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.317571 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.317599 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.318133 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.774865 (+456732us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:32.779756 (+  4891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.785895 (+  6139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.964639 (+178744us) raft_consensus.cc:1685] finished
0709 13:06:32.964656 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.964800 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66376,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":110,"thread_start_us":454588,"threads_started":1,"wal-append.queue_time_us":513538}
I20260709 13:06:33.171875 22580 rpcz_store.cc:276] 0709 13:06:31.313346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.364526 (+1051180us) service_pool.cc:224] Handling call
0709 13:06:32.364929 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.365161 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:32.777508 (+412347us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.092596 (+315088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.099347 (+  6751us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:33.099416 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.099512 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.114418 (+ 14906us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":446660,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":5609,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7503,"thread_start_us":672235,"threads_started":2,"wal-append.queue_time_us":380609}
I20260709 13:06:33.207537 23866 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:33.195731 23774 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.215200 23866 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:33.215641 23866 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.215549 23774 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.216574 23841 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.216991 23841 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.217344 23841 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.207727 23825 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.218581 23077 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:33.192055 23738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.019s	sys 0.035s
I20260709 13:06:33.220454 23740 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.220891 23740 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.221253 23740 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.221666 22396 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:33.223232 22396 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:33.165199 23751 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.223081 23775 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.215850 23887 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:33.212211 22545 leader_election.cc:336] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.210s (SENT)
I20260709 13:06:33.204180 23883 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.243470 23883 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.244740 23829 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.160610 23855 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:33.246047 23883 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:33.246394 23751 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:33.247462 22503 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.247786 23855 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.248754 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.195293 23878 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.249922 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:33.250489 22428 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.250223 23878 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.253547 23849 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.255700 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.255990 22472 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:33.256894 23782 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.225505 22429 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:33.187074 22474 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.257530 23782 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.257826 23856 raft_consensus.cc:3055] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.258257 23856 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:33.228092 22433 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
W20260709 13:06:33.259369 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 72366.9us
I20260709 13:06:33.224751 23754 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.240528 22545 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:33.259941 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:06:33.260792 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48671.7us
I20260709 13:06:33.260924 23774 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:33.261500 23774 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:33.199977 23834 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.262423 23835 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:33.262568 23858 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:33.263267 23765 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.258927 23883 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.255723 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:33.264097 23883 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.264241 23109 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:33.264551 23883 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.264767 23788 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.265046 23883 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.256038 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:33.268859 23832 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.253427 23106 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Advancing to term 2
I20260709 13:06:33.273165 22473 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.275063 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:33.275507 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.275089 22396 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:33.198496 23773 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.242365 23079 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:33.274008 23814 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.277992 23765 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:33.281062 23079 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:33.281479 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.278218 23751 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.257267 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:33.291265 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.291991 22576 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.290647 22578 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:33.295202 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.255591 23736 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.298195 22428 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:33.191192 23851 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.301142 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:33.301795 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 916) took 1901 ms. Trace:
I20260709 13:06:33.278463 23849 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:33.304136 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 46953.3us
I20260709 13:06:33.302753 22505 rpcz_store.cc:276] 0709 13:06:31.400159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.123583 (+723424us) service_pool.cc:224] Handling call
0709 13:06:32.123880 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.273818 (+149938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.273846 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.274298 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.783754 (+509456us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:33.008693 (+224939us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.301485 (+292792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.301572 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.301614 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:33.301626 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.301743 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31121,"prepare.queue_time_us":345323,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":159813,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":6977,"thread_start_us":1063872,"threads_started":4,"wal-append.queue_time_us":616436}
I20260709 13:06:33.310513 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.311154 22504 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:33.311157 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.312382 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:33.282743 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.297674 23887 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.283634 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 910) took 2053 ms. Trace:
I20260709 13:06:33.263375 23774 consensus_queue.cc:1059] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:33.261147 23754 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:33.315380 22576 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:33.289558 23744 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.292284 23855 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.318689 22507 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:06:33.310561 22579 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.008s	sys 0.014s
I20260709 13:06:33.329404 22505 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:33.329514 22579 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.008s	sys 0.014s
I20260709 13:06:33.297534 23847 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:33.331269 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.300746 23788 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.320425 22506 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.334002 22505 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:33.334857 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.335789 23890 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.312439 23886 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.323069 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:33.308948 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.308779 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:33.349617 23851 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.349807 22574 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:33.351107 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.326892 23744 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.314904 23841 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.309814 23849 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.301517 23814 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.337541 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.338271 23636 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:33.324963 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.303174 23839 consensus_queue.cc:1059] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:33.339251 23890 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.342002 23765 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.344697 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.322012 23887 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.358129 23744 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.362438 23754 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.312687 23826 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:33.357409 23803 consensus_queue.cc:1059] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:33.339737 23855 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.352450 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:33.287964 23782 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.340624 22545 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:33.356755 22506 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:33.335958 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.319481 22501 rpcz_store.cc:276] 0709 13:06:31.228550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.757077 (+528527us) service_pool.cc:224] Handling call
0709 13:06:32.334464 (+577387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.334862 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.334891 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.335437 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.661828 (+326391us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:32.661898 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.698407 (+ 36509us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.160836 (+462429us) raft_consensus.cc:1685] finished
0709 13:06:33.163077 (+  2241us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.259640 (+ 96563us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54003c8050. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:33.279647 (+ 20007us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49324,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"spinlock_wait_cycles":882900736,"thread_start_us":310324,"threads_started":1,"wal-append.queue_time_us":450630}
W20260709 13:06:33.418438 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 82546.8us
I20260709 13:06:33.419852 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.338891 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.358104 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.328131 23751 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.425103 23751 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.427352 23751 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.372946 23890 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.428984 23841 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.336884 23878 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:33.444420 23782 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.445892 23752 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:33.446127 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.448391 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.450923 23636 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.362687 22426 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:33.351400 23869 log.cc:927] Time spent T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.307s	user 0.001s	sys 0.002s
W20260709 13:06:33.370035 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47047.1us
I20260709 13:06:33.371172 22507 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:33.352417 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.319725 23825 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:06:33.375396 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.259099 23856 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.359778 23849 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.347970 23883 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.361086 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.421510 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.352804 23842 consensus_queue.cc:1059] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:06:33.433365 23744 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.437518 23620 raft_consensus.cc:3055] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.438345 23076 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:33.442189 23866 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.361955 23814 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.362425 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.452564 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 112010us
I20260709 13:06:33.478689 23751 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.460027 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:33.457310 22432 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:33.436004 23740 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.456843 23846 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.484724 23838 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.453231 23891 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.493501 22545 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.532896 22545 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:33.534317 22545 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.454604 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.496312 23814 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.536548 22578 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:33.487608 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:33.481350 23783 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:33.543957 23783 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.545163 23866 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.487699 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.486267 23620 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:33.496836 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:33.531258 23776 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.528906 23847 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.549943 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 72) took 1213 ms. Trace:
I20260709 13:06:33.529075 23751 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:33.528607 23803 raft_consensus.cc:3055] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.561123 22425 rpcz_store.cc:276] 0709 13:06:32.336870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.339488 (+  2618us) service_pool.cc:224] Handling call
0709 13:06:32.384850 (+ 45362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.385271 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.385302 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.385797 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.788987 (+403190us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:32.789046 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.789124 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.350824 (+561700us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:33.535977 (+185153us) raft_consensus.cc:1685] finished
0709 13:06:33.536002 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.549878 (+ 13876us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1033,"raft.queue_time_us":1398,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":6898,"spinlock_wait_cycles":75135744,"thread_start_us":395810,"threads_started":1,"wal-append.queue_time_us":493666}
I20260709 13:06:33.548142 23856 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.490473 23757 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.550827 23842 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:33.536952 23891 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.563500 22574 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:33.567514 23620 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.568413 22501 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:33.549687 23887 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.557183 22500 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:06:33.541144 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 102891us
I20260709 13:06:33.558595 23846 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:33.567665 23894 log.cc:927] Time spent T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:06:33.574672 22424 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:33.564332 23824 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:06:33.569032 23839 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.546366 23890 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.563673 23803 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:33.569301 23842 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:33.571496 23891 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.592722 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.593420 22500 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:33.594305 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.595036 22500 raft_consensus.cc:2393] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:33.590756 23842 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.599483 23803 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.600764 23803 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.579046 23620 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.578275 23833 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.611451 23842 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.615109 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.629616 22502 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:33.601462 23776 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:33.619202 23788 raft_consensus.cc:3055] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.590972 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.591591 23839 raft_consensus.cc:697] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:33.622965 23891 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:33.627061 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 163176us
I20260709 13:06:33.590278 23849 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.633299 23840 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.634658 22327 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 3, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 3 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.637169 23832 raft_consensus.cc:3055] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.639026 23890 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.619814 23855 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.602974 23751 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.715112 22427 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.645735 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:33.649196 23757 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:33.649770 23740 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.650499 23106 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:33.651487 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:33.652846 23852 raft_consensus.cc:3055] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.653913 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.654633 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.654913 22426 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.656765 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:33.658195 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:33.660863 22499 raft_consensus.cc:2393] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:33.663929 22431 raft_consensus.cc:1240] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.665130 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.671826 23783 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.673929 23744 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.642405 23834 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.688989 22472 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:33.695938 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:33.698784 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.699617 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.642921 23788 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:33.738123 22578 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.704895 22424 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.706929 22327 catalog_manager.cc:5697] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 3, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 3 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:33.741080 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 52192.1us
I20260709 13:06:33.741943 22472 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:33.741397 22327 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.712180 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.743093 22433 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:33.743151 22472 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:33.620299 23773 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.717336 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.747534 23773 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:33.748039 22429 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:33.708369 23883 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:33.748955 22501 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.751092 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.751801 23849 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:33.753018 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.753328 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:33.753978 23106 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.755208 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.755688 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:33.700572 22474 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.756619 22499 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 2: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:06:33.756809 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 56314.3us
I20260709 13:06:33.758323 23849 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.758010 23788 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.758752 23849 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.744761 22430 raft_consensus.cc:2393] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:33.744789 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.762399 22425 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:33.761241 22472 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:33.745201 23839 consensus_queue.cc:237] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.745733 23855 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.759575 22576 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.761366 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.765960 22581 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:33.766552 22327 catalog_manager.cc:5697] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 2, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.763712 23836 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:33.763994 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:33.774353 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.774587 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.775040 22581 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.768743 23788 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.770205 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.728403 23678 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.771849 22472 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:33.774981 23855 raft_consensus.cc:697] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:33.759156 23849 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.745381 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:33.738107 23852 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:33.769796 23883 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.769584 23740 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.780237 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.797250 23883 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:33.761948 22503 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:33.783263 23678 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.768312 22327 catalog_manager.cc:5697] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 3, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 3 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.731788 23842 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:33.775832 23836 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:33.801862 23836 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.710512 23832 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:33.705864 23840 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:33.797441 22575 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.803584 23840 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.804803 23840 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.780373 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.747912 23891 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:33.779320 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.768999 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.800908 23890 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.802591 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.727296 23814 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:33.799659 22327 catalog_manager.cc:5697] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.808437 22579 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.778057 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:33.822786 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 44804.4us
I20260709 13:06:33.824048 22396 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.808933 22578 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:33.827310 22327 catalog_manager.cc:5697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 2, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.808053 23890 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:33.819254 22431 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:33.803596 23832 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.828722 23754 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:33.829030 23745 consensus_queue.cc:1059] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.829550 23867 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:33.831600 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 141107us
I20260709 13:06:33.852154 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:33.810640 22576 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:33.832427 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.854305 22578 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.853857 23108 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:33.820631 23883 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.831245 23106 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:33.836045 22327 catalog_manager.cc:5697] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.838279 22579 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:33.839044 23678 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:33.840869 23852 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.841109 23754 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:33.780897 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 135244us
I20260709 13:06:33.798182 23855 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.847801 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:33.848032 23745 raft_consensus.cc:3055] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.858774 22398 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:33.857230 22581 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:33.862087 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.852946 23788 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.834235 22396 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:33.887420 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53260.5us
I20260709 13:06:33.889045 22579 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:33.889812 22474 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.894037 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:33.896024 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.840405 23890 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.897671 22474 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.866446 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:33.867873 22582 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.901600 22428 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.901866 22473 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:33.901036 23079 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:33.851159 23842 consensus_queue.cc:1059] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:33.908720 23079 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:06:33.925670 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 391404us
I20260709 13:06:33.928303 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.929204 22579 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:33.928407 22545 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:33.898908 23109 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:33.886541 23788 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.992727 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 63655.6us
I20260709 13:06:33.902046 23891 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.901600 23678 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.939985 22578 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:34.000392 22396 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:33.901948 23856 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.901036 23783 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.866911 23824 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:33.886502 23745 raft_consensus.cc:740] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:34.007997 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.015656 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 87325.2us
I20260709 13:06:34.016603 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:33.933523 23886 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.931739 23744 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.923614 23866 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.021785 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:34.058475 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.933121 23847 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:33.994061 23858 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.924355 23620 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:33.926594 23803 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.931102 23636 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:34.023793 23824 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:33.866850 23846 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.140s
I20260709 13:06:34.003453 23852 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.005339 23788 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.058162 23866 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.007112 23856 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.005774 23887 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.013638 23829 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:34.014041 23757 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.006026 23851 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:34.018319 23903 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:34.065235 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:34.073074 23744 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:34.102427 23757 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.072446 23908 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.100838 23866 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.113200 23851 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.099452 23856 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.092195 23858 raft_consensus.cc:697] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:34.077245 23620 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.112322 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:34.124583 23757 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.116175 23903 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.138446 23825 consensus_queue.cc:1059] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.114598 23636 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.137421 23851 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:34.077445 23904 consensus_queue.cc:1059] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:06:34.152496 23896 log.cc:927] Time spent T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:06:34.154392 23636 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:34.111925 22579 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:34.111003 23887 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.137482 23832 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:34.145203 23900 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:06:34.178483 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.178428 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 157972us
I20260709 13:06:34.117040 23829 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.157620 22499 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.156535 23908 raft_consensus.cc:3055] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.190023 22546 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:34.145320 23858 consensus_queue.cc:237] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.177078 23636 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:34.175622 23077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.061s	sys 0.076s
I20260709 13:06:34.100656 23745 consensus_queue.cc:260] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.180258 23782 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.178644 23814 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:34.206383 23620 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:34.204555 22546 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:34.188637 23908 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:06:34.201998 23077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.062s	sys 0.076s
W20260709 13:06:34.241551 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.301314 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 97564.6us
I20260709 13:06:34.303102 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:34.304246 22505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.034s	sys 0.040s
W20260709 13:06:34.214547 22500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.023s	sys 0.032s
I20260709 13:06:34.313616 22546 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:34.314339 22505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.034s	sys 0.041s
I20260709 13:06:34.190268 23904 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:06:34.300673 23839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.029s	sys 0.041s
I20260709 13:06:34.300020 23620 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.196012 23744 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.331679 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:34.329618 23620 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:34.332916 23620 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.313069 23745 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:34.321027 22500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.023s	sys 0.033s
I20260709 13:06:34.204238 23636 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:34.327656 23839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.029s	sys 0.041s
I20260709 13:06:34.344925 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:34.348461 23849 consensus_meta.cc:287] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.542s	user 0.003s	sys 0.004s
W20260709 13:06:34.350917 23901 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:06:34.328842 23903 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:34.362465 23839 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.357146 23814 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.364974 23788 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:34.368191 23836 consensus_meta.cc:287] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
W20260709 13:06:34.371001 23906 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:06:34.343287 23824 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:34.378196 23814 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.383596 23814 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:34.360672 23849 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.389660 23849 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:34.321060 23751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.021s	sys 0.052s
I20260709 13:06:34.376116 23842 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:34.400835 23842 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:34.401312 23842 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.380106 23836 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.407660 23836 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:34.411139 23757 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.412580 23754 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:34.413028 23912 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 13:06:34.413334 23905 log.cc:927] Time spent T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:06:34.426668 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:34.428658 23829 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:34.418280 23109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59008 (request call id 441) took 1124 ms. Trace:
I20260709 13:06:34.436627 23109 rpcz_store.cc:276] 0709 13:06:33.294088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.296791 (+  2703us) service_pool.cc:224] Handling call
0709 13:06:34.418061 (+1121270us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54006982d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:34.418219 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158136192}
I20260709 13:06:34.438843 23826 raft_consensus.cc:1064] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:34.439930 23803 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:34.369376 22500 raft_consensus.cc:2955] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:06:34.426059 23917 log.cc:927] Time spent T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:06:34.429394 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:34.355440 23908 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.404728 23887 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:34.454684 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.455888 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:34.460923 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:34.463687 22574 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
W20260709 13:06:34.405524 23751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.021s	sys 0.052s
W20260709 13:06:34.422183 22575 consensus_meta.cc:287] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.618s	user 0.004s	sys 0.006s
I20260709 13:06:34.448633 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.449674 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:34.478782 23775 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:34.480732 23743 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.481189 23743 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:06:34.481369 23899 log.cc:927] Time spent T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.449s	user 0.003s	sys 0.004s
I20260709 13:06:34.482111 23743 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.482508 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 113) took 1150 ms. Trace:
I20260709 13:06:34.473533 22507 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:34.484422 22504 rpcz_store.cc:276] 0709 13:06:33.332551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.332676 (+   125us) service_pool.cc:224] Handling call
0709 13:06:33.332994 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.353163 (+ 20169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.353190 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.373347 (+ 20157us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.574600 (+201253us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:33.574642 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.655459 (+ 80817us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b4800282858. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0071d4baa1 00007f0071d42b37 00007f0071d429ca 00007f0071e3a26f 00007f0071e39f37 00007f0071e4e55c 00007f0071e4e508 00007f0071e4e488 00007f0071e4e443 00007f0071e4d6ec 00007f0070d77a96
0709 13:06:33.738840 (+ 83381us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b54001761d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:33.738896 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.463758 (+724862us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:34.482292 (+ 18534us) raft_consensus.cc:1685] finished
0709 13:06:34.482314 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.482440 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":1322,"raft.run_wall_time_us":296866,"spinlock_wait_cycles":135260672,"thread_start_us":157343,"threads_started":1,"wal-append.queue_time_us":455327}
I20260709 13:06:34.472965 22575 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:34.504354 23076 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:34.513891 23840 consensus_meta.cc:287] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.000s
I20260709 13:06:34.516986 23636 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:34.518918 23834 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:34.535477 23754 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:34.522323 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:34.520394 23743 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.544191 23834 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.544234 22398 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:34.551116 23774 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.549183 23834 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.553056 23834 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.523728 23752 consensus_queue.cc:1059] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:06:34.560509 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.542606 23754 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.574549 23620 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.454320 23826 consensus_queue.cc:237] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.587364 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:34.588562 22507 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.591099 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:34.592655 22399 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.004s	sys 0.048s
I20260709 13:06:34.592898 23776 raft_consensus.cc:3055] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:34.593258 23776 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:34.594099 23776 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.595237 23776 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:34.596566 22399 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.004s	sys 0.048s
W20260709 13:06:34.596868 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 879426us
W20260709 13:06:34.599788 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.601074 23841 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.601651 23841 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.603780 23841 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:34.590674 23736 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.606904 23736 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:34.607764 23852 consensus_meta.cc:287] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.001s
I20260709 13:06:34.608970 23736 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:34.598606 23773 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.609562 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:34.611133 23774 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:34.611683 23745 consensus_queue.cc:1059] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.542995 23856 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.612360 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:34.612809 23745 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.613212 23745 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:34.609946 23773 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.614248 23745 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.615278 23773 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:34.615916 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.611384 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:34.617180 22399 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:34.624191 23891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.039s	sys 0.084s
W20260709 13:06:34.652037 23891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.039s	sys 0.084s
I20260709 13:06:34.652369 23891 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:34.621095 22507 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:34.653573 23891 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:34.637807 23886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.035s
W20260709 13:06:34.658996 23886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.012s	sys 0.035s
I20260709 13:06:34.659431 23886 raft_consensus.cc:697] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:34.656906 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.681591 22396 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:34.689530 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.701959 23840 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:34.702689 23840 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.754390 23852 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.755084 23852 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.758934 23852 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:34.612010 23839 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:34.613163 23774 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.590204 23788 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:34.615605 23745 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.783232 22504 raft_consensus.cc:2393] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:06:34.788028 22581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.024s	sys 0.046s
W20260709 13:06:34.788525 22581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.024s	sys 0.046s
W20260709 13:06:34.805371 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.808192 23886 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.810406 23842 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.811906 23754 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:34.815272 23840 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:34.819707 23834 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:34.823397 23834 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:34.825634 23842 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:34.826946 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:34.829995 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:34.830730 23620 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:34.830927 23108 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:34.832440 23856 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:34.833850 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 216719us
W20260709 13:06:34.834537 23866 consensus_meta.cc:287] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.000s
I20260709 13:06:34.787429 23757 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:34.805681 23832 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.807045 23839 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:34.838284 23839 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:34.843107 23738 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:34.843887 23738 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:34.844620 22502 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.054s	sys 0.096s
W20260709 13:06:34.844978 22502 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.054s	sys 0.096s
W20260709 13:06:34.847384 22508 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.026s	sys 0.044s
W20260709 13:06:34.848026 22508 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.026s	sys 0.044s
W20260709 13:06:34.848503 22472 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.025s	sys 0.054s
W20260709 13:06:34.830230 22499 consensus_meta.cc:287] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.000s
I20260709 13:06:34.850884 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 921) took 1378 ms. Trace:
I20260709 13:06:34.848874 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:06:34.849665 22472 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.026s	sys 0.054s
W20260709 13:06:34.853629 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 172150us
W20260709 13:06:34.853346 22503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.002s	sys 0.010s
W20260709 13:06:34.856438 22503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.002s	sys 0.010s
W20260709 13:06:34.846560 23890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.012s
I20260709 13:06:34.834894 23745 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:34.854478 22508 rpcz_store.cc:276] 0709 13:06:33.472340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.472502 (+   162us) service_pool.cc:224] Handling call
0709 13:06:33.472850 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.473210 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.473236 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.478465 (+  5229us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.679408 (+200943us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b4800282858. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0071d4baa1 00007f0071d42b37 00007f0071d429ca 00007f0071e3a26f 00007f0071e39f37 00007f0071e4e55c 00007f0071e4e508 00007f0071e4e488 00007f0071e4e443 00007f0071e4d6ec 00007f0070d77a96
0709 13:06:33.996848 (+317440us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:34.850135 (+853287us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.850499 (+   364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.850579 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.850618 (+    39us) raft_consensus.cc:1685] finished
0709 13:06:34.850697 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.850826 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46554,"prepare.queue_time_us":113919,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":3388,"raft.run_cpu_time_us":7767,"raft.run_wall_time_us":203315,"spinlock_wait_cycles":3560832,"thread_start_us":1293968,"threads_started":2,"wal-append.queue_time_us":588064}
I20260709 13:06:34.850123 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 932) took 1365 ms. Trace:
I20260709 13:06:34.853356 23839 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:34.868106 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:34.858008 23754 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:34.853150 22499 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
W20260709 13:06:34.871829 22546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.001s	sys 0.009s
W20260709 13:06:34.886677 22546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.002s	sys 0.009s
W20260709 13:06:34.868340 22327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.011s
W20260709 13:06:34.887415 22327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.011s
W20260709 13:06:34.888322 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.003s	sys 0.012s
W20260709 13:06:34.888772 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.003s	sys 0.012s
W20260709 13:06:34.889091 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 864796us
W20260709 13:06:34.884895 22473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.019s	sys 0.026s
W20260709 13:06:34.891616 22473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.019s	sys 0.026s
W20260709 13:06:34.891952 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 754697us
I20260709 13:06:34.893656 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:34.890383 22545 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:34.908833 23108 raft_consensus.cc:2368] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:34.834923 23866 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:34.910367 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.910985 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:34.863003 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:34.915427 22576 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:34.915764 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:34.917273 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.918316 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:34.918815 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.919097 22581 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:34.919703 22508 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:34.865664 23738 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:34.920709 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.931727 22504 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:34.921520 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.914537 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:34.917274 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:34.933761 22578 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.867493 23838 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:34.936743 22507 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:34.936609 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.939601 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.941509 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:34.943243 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:34.944396 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 90398.9us
W20260709 13:06:34.945194 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.947088 22574 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:34.870748 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 335070us
I20260709 13:06:34.951749 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.953030 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:34.954113 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:34.948467 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:34.922439 22501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.000s	sys 0.040s
I20260709 13:06:34.961018 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:34.960350 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:34.962738 22474 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:34.958640 22473 leader_election.cc:400] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
W20260709 13:06:34.931998 23910 log.cc:927] Time spent T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:34.956260 22578 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:34.939523 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 930) took 1448 ms. Trace:
W20260709 13:06:34.943984 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.055153 22582 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
W20260709 13:06:35.022066 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 76224.9us
I20260709 13:06:35.059253 22399 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:35.014355 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49223.8us
W20260709 13:06:34.940896 23859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.006s	sys 0.015s
W20260709 13:06:35.064438 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 101756us
I20260709 13:06:35.046497 22473 leader_election.cc:403] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:34.963112 23883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.011s
I20260709 13:06:34.960457 23839 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:35.046268 22581 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:35.061398 22506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.024s
W20260709 13:06:35.161604 22506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.004s	sys 0.025s
I20260709 13:06:35.021519 22545 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:35.162622 23736 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.046602 23620 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:35.163357 23933 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
W20260709 13:06:34.976730 22501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.000s	sys 0.040s
I20260709 13:06:35.014218 23904 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:35.116127 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.981175 23926 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:35.017429 23847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.007s	sys 0.016s
W20260709 13:06:35.116077 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 55065.3us
I20260709 13:06:35.013881 23842 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.931330 23855 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:35.017629 23840 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:35.058365 23824 raft_consensus.cc:3055] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:35.165707 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 144271us
I20260709 13:06:34.938627 23890 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.169070 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 220629us
W20260709 13:06:35.161283 23883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.008s	sys 0.013s
I20260709 13:06:34.950170 23838 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:35.192369 23919 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.163288 23736 raft_consensus.cc:697] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:34.963999 23923 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.117622 23929 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.114405 22503 raft_consensus.cc:1240] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:35.158604 23859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.012s	sys 0.021s
W20260709 13:06:35.194731 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.117326 23856 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:35.168047 23832 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:35.176724 23847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.008s	sys 0.022s
W20260709 13:06:35.157979 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 81200.9us
I20260709 13:06:35.226693 22508 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:35.230489 22581 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
W20260709 13:06:35.264621 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 247829us
I20260709 13:06:35.175932 23620 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:35.208063 23824 raft_consensus.cc:740] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:06:35.268843 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.269415 22428 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:35.214668 23930 log.cc:927] Time spent T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260709 13:06:35.272291 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:35.192018 23926 raft_consensus.cc:697] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:35.178450 23904 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:35.231987 23863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.005s	sys 0.048s
I20260709 13:06:35.283494 22396 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:35.255450 23773 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:35.231494 23923 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:35.233692 23929 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:35.287390 22396 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:35.202411 23842 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:35.211656 23840 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:35.286548 22398 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:35.273247 23841 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.286001 23863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.005s	sys 0.049s
I20260709 13:06:35.287428 23886 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:34.866659 22502 rpcz_store.cc:276] 0709 13:06:33.483256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.661472 (+178216us) service_pool.cc:224] Handling call
0709 13:06:33.661833 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.662065 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:33.662394 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.845265 (+1182871us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.845326 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:34.845374 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.845451 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.845572 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14,"prepare.queue_time_us":169,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":162366,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":1460,"spinlock_wait_cycles":17792,"thread_start_us":1153447,"threads_started":2,"wal-append.queue_time_us":645006}
I20260709 13:06:35.330451 23886 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:35.298077 22432 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:35.056783 22500 rpcz_store.cc:276] 0709 13:06:33.482784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.595555 (+112771us) service_pool.cc:224] Handling call
0709 13:06:33.596097 (+   542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.596443 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.597873 (+  1430us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.652106 (+ 54233us) log.cc:844] Serialized 556 byte log entry
0709 13:06:34.359053 (+706947us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:34.856037 (+496984us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.867891 (+ 11854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.871637 (+  3746us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.886195 (+ 14558us) raft_consensus.cc:1685] finished
0709 13:06:34.886218 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.931357 (+ 45139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31148,"raft.queue_time_us":1181,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":10720,"thread_start_us":696882,"threads_started":1,"wal-append.queue_time_us":1155841}
I20260709 13:06:35.321563 23754 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:35.332420 22500 raft_consensus.cc:1240] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:35.333082 23754 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:35.333238 23886 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:35.335042 22500 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:35.335688 23620 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:35.337538 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:35.338171 23113 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:35.338976 23842 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:35.339416 22473 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:35.340071 23859 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:35.340620 23859 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:35.342087 23751 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.343335 23738 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:35.318755 23929 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.344568 23824 consensus_queue.cc:260] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:35.346114 23738 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:35.346876 23738 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.290452 23757 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.347309 23738 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:35.347647 23757 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:35.343304 23751 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:35.349538 23751 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.349814 23757 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:35.299783 23936 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:06:35.230990 23855 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:35.301656 23904 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:35.284026 23856 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:35.308630 23909 log.cc:927] Time spent T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:06:35.309482 23736 consensus_queue.cc:237] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:35.311041 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:35.313026 23954 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:35.221140 23941 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:06:35.209128 23890 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:35.279716 23847 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:35.340929 23840 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:35.298547 23943 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:06:35.298110 23938 log.cc:927] Time spent T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:06:35.326879 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 267727us
I20260709 13:06:35.316082 23923 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.192883 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.193977 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.194512 22503 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:36.195101 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.195521 22503 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:36.196084 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:35.342967 23859 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:35.326383 23866 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.196533 22503 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:35.314077 23773 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:35.341985 23841 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:35.417881 23738 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.198490 23773 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:35.387979 23733 raft_consensus.cc:3055] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:35.411667 23926 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.199084 23733 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:36.199664 23841 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.199950 23733 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.201221 23733 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.419934 23847 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.202303 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:35.436295 23743 consensus_meta.cc:287] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.886s	user 0.007s	sys 0.003s
W20260709 13:06:35.484198 23909 log.cc:927] Time spent T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:06:35.483240 23924 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.204762 23924 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.206972 23924 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:35.478259 23852 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:35.485183 23840 consensus_queue.cc:1059] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:36.207729 23852 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.208201 23840 raft_consensus.cc:3055] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.208654 23840 raft_consensus.cc:740] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:36.209545 23840 consensus_queue.cc:260] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.209982 23852 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.210716 23840 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:35.528527 23947 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:06:35.538204 23890 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:35.539634 23855 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:35.540365 23904 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.213964 23904 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.216146 23904 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:35.560503 23929 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:35.353294 22500 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:36.221071 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 937) took 1285 ms. Trace:
I20260709 13:06:36.221439 22500 rpcz_store.cc:276] 0709 13:06:34.935488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.335853 (+400365us) service_pool.cc:224] Handling call
0709 13:06:35.336141 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.220779 (+884638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.221008 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.412318 22504 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:35.575700 23931 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:35.627485 23832 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:35.540299 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.373545 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.806739 23941 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.853444 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.403921 22425 raft_consensus.cc:2368] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3.
I20260709 13:06:36.403662 23941 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:36.404052 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.404503 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 970) took 1132 ms. Trace:
I20260709 13:06:36.404971 22425 rpcz_store.cc:276] 0709 13:06:35.271626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.271816 (+   190us) service_pool.cc:224] Handling call
0709 13:06:35.853165 (+581349us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:36.404423 (+551258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8296192}
I20260709 13:06:36.405943 23941 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:35.858309 23751 consensus_meta.cc:287] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 13:06:35.914492 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.406975 22499 raft_consensus.cc:2368] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3.
I20260709 13:06:36.406659 23751 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.407645 23970 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.408566 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.409144 23751 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:35.987926 23956 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.458s	user 0.001s	sys 0.008s
I20260709 13:06:35.704980 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:36.086508 23959 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.555s	user 0.010s	sys 0.003s
W20260709 13:06:36.077432 23077 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.005s	sys 0.005s
W20260709 13:06:36.437052 23077 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.007s	sys 0.005s
W20260709 13:06:36.437407 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 1.00622e+06us
I20260709 13:06:35.488027 23106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 182) took 1179 ms. Trace:
W20260709 13:06:36.078217 23109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.017s	sys 0.034s
I20260709 13:06:36.441430 23106 rpcz_store.cc:276] 0709 13:06:34.306533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.308832 (+  2299us) service_pool.cc:224] Handling call
0709 13:06:34.336072 (+ 27240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.374334 (+ 38262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.376721 (+  2387us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:34.444955 (+ 68234us) log.cc:844] Serialized 26 byte log entry
0709 13:06:34.853288 (+408333us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:34.856965 (+  3677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.862481 (+  5516us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.477916 (+615435us) raft_consensus.cc:1685] finished
0709 13:06:35.477940 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.486292 (+  8352us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3726,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3518,"thread_start_us":401731,"threads_started":1,"wal-append.queue_time_us":519152}
W20260709 13:06:36.442819 23109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.018s	sys 0.035s
I20260709 13:06:36.443747 23109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 449) took 1022 ms. Trace:
I20260709 13:06:35.534492 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:35.535260 23113 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:36.217726 22399 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:36.219594 22503 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:36.497385 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 279733us
I20260709 13:06:36.498406 23738 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.498867 23738 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.499235 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 963) took 1272 ms. Trace:
I20260709 13:06:36.247867 22546 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:36.500139 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.500303 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.500855 22433 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.500916 22429 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:36.501950 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.502189 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.258035 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 931) took 2775 ms. Trace:
W20260709 13:06:36.271708 22431 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.012s	sys 0.027s
W20260709 13:06:36.305338 22396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.009s	sys 0.017s
W20260709 13:06:36.331137 22501 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.028s	sys 0.022s
I20260709 13:06:36.331943 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.335381 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:36.505833 22501 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.029s	sys 0.024s
I20260709 13:06:36.339841 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.342027 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.343499 22576 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
W20260709 13:06:36.347918 22504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 925) took 1415 ms (client timeout 1800 ms). Trace:
W20260709 13:06:36.507063 22504 rpcz_store.cc:269] 0709 13:06:34.932379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.936269 (+  3890us) service_pool.cc:224] Handling call
0709 13:06:36.347667 (+1411398us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b5400002dd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:36.347846 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085943040}
I20260709 13:06:36.507627 22430 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.373445 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 120) took 2251 ms. Trace:
W20260709 13:06:36.374786 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.385788 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 971) took 1113 ms. Trace:
I20260709 13:06:36.408270 23970 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:35.421025 22573 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:36.410904 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 928) took 1477 ms. Trace:
I20260709 13:06:36.411183 23107 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Advancing to term 3
I20260709 13:06:36.552613 22507 rpcz_store.cc:276] 0709 13:06:34.933282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.956515 (+ 23233us) service_pool.cc:224] Handling call
0709 13:06:34.956867 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.957253 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.957283 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:34.979767 (+ 22484us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.478817 (+499050us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:35.478861 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.478934 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.987087 (+508153us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:36.410585 (+423498us) raft_consensus.cc:1685] finished
0709 13:06:36.410617 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.410846 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":54907,"spinlock_wait_cycles":24153344,"thread_start_us":274415,"threads_started":1,"wal-append.queue_time_us":452701}
I20260709 13:06:36.552734 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55062 (request call id 98) took 1641 ms. Trace:
I20260709 13:06:36.555359 22573 rpcz_store.cc:276] 0709 13:06:34.911756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.921731 (+  9975us) service_pool.cc:224] Handling call
0709 13:06:35.310860 (+389129us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:36.552672 (+1241812us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5136256}
W20260709 13:06:36.412431 22398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.036s	sys 0.091s
W20260709 13:06:36.556658 22398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.234s	user 0.036s	sys 0.092s
I20260709 13:06:36.556703 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:36.557277 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 1.2707e+06us
I20260709 13:06:36.557564 22432 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:36.559449 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:36.407444 22499 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 938) took 1471 ms (client timeout 1550 ms). Trace:
I20260709 13:06:36.413552 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:36.560348 23866 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.561034 23866 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.395311 23744 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.241225 23855 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.560583 22432 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:36.564174 23744 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.187440 23838 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.393314 23835 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.247352 23840 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.259797 23841 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.574250 23841 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.573791 23107 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:36.241725 23847 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.424455 22502 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.183454 23856 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.247543 23743 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.586488 23743 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.576349 23841 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.259310 23773 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.591775 23743 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.591671 23773 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.592680 23743 raft_consensus.cc:1064] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:36.414340 23824 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.374074 23890 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.382910 23903 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.605370 23890 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.605916 23903 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.607535 23890 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.607846 23903 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.248628 23904 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.608989 23904 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.610756 23904 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.234284 23908 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.555099 23919 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:36.382421 23921 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.196251 23923 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.239310 23926 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:36.224771 23929 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.227738 23931 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:36.161324 23932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.012s	sys 0.041s
W20260709 13:06:36.390364 23937 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.973s	user 0.003s	sys 0.008s
W20260709 13:06:36.291675 23944 log.cc:927] Time spent T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.876s	user 0.002s	sys 0.006s
I20260709 13:06:36.622123 22577 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:36.436209 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 1819) took 1521 ms. Trace:
I20260709 13:06:36.622717 23826 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.622785 22580 rpcz_store.cc:276] 0709 13:06:34.915122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.921594 (+  6472us) service_pool.cc:224] Handling call
0709 13:06:35.704784 (+783190us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:36.436140 (+731356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13105408}
I20260709 13:06:36.623282 23826 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.444221 23109 rpcz_store.cc:276] 0709 13:06:35.421656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.422672 (+  1016us) service_pool.cc:224] Handling call
0709 13:06:35.428654 (+  5982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.428905 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.428940 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.429487 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.443333 (+1013846us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:36.443388 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.443469 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.443521 (+    52us) raft_consensus.cc:1685] finished
0709 13:06:36.443536 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.443683 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1013345,"threads_started":1,"wal-append.queue_time_us":672500}
I20260709 13:06:36.451824 23973 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.624388 23973 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.626149 23826 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.476977 23941 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.626682 23973 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.626880 23941 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.629276 23941 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:36.470329 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 984904us
I20260709 13:06:36.479460 23751 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.633252 23751 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.483184 23971 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:36.637053 23971 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.638187 23991 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.639567 23971 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.638792 23991 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.484874 23972 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.640416 23972 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:36.485688 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.643217 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.486227 23975 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.644078 23973 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.488412 23976 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:36.499213 23738 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.644604 23973 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.647043 23973 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.303516 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:36.505048 22396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.010s	sys 0.017s
I20260709 13:06:36.644732 23976 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.503271 22505 rpcz_store.cc:276] 0709 13:06:33.483021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.634905 (+151884us) service_pool.cc:224] Handling call
0709 13:06:33.635225 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.635553 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.635582 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.636048 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:06:34.321654 (+685606us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:34.333253 (+ 11599us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.333443 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.333514 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.257698 (+1924184us) raft_consensus.cc:1685] finished
0709 13:06:36.257725 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.257924 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11143,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":62220,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":154,"thread_start_us":685248,"threads_started":1,"wal-append.queue_time_us":1276634}
I20260709 13:06:36.348748 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 924) took 1416 ms. Trace:
W20260709 13:06:36.505391 22431 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.163s	user 0.013s	sys 0.028s
I20260709 13:06:36.508145 22506 rpcz_store.cc:276] 0709 13:06:34.121904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.463320 (+341416us) service_pool.cc:224] Handling call
0709 13:06:34.475918 (+ 12598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.476261 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.476286 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:34.497569 (+ 21283us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.162019 (+664450us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:35.162065 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.162136 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.373195 (+1211059us) raft_consensus.cc:1685] finished
0709 13:06:36.373220 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.373377 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":637993,"threads_started":1,"wal-append.queue_time_us":855751}
I20260709 13:06:36.499737 22503 rpcz_store.cc:276] 0709 13:06:35.226369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.197252 (+970883us) service_pool.cc:224] Handling call
0709 13:06:36.197558 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.497051 (+299493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.498984 (+  1933us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b54003eb554. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:36.499173 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50192768}
I20260709 13:06:36.644281 23975 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.513792 23970 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.509459 23924 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:36.508767 22424 rpcz_store.cc:276] 0709 13:06:35.271896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.272024 (+   128us) service_pool.cc:224] Handling call
0709 13:06:36.385573 (+1113549us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540038c2d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:36.385723 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2529788672}
W20260709 13:06:36.508495 22426 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 969) took 1237 ms (client timeout 1578 ms). Trace:
I20260709 13:06:36.658864 23975 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:36.658661 22426 rpcz_store.cc:269] 0709 13:06:35.271351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.273948 (+  2597us) service_pool.cc:224] Handling call
0709 13:06:36.339585 (+1065637us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:36.508409 (+168824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27023616}
I20260709 13:06:36.655910 23971 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:36.659921 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.659890 23971 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.660945 22426 raft_consensus.cc:2410] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:36.661881 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.662051 23971 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.519796 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:36.524698 22433 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:36.529237 22430 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:36.662521 23738 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.533476 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.663954 22429 raft_consensus.cc:2368] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3.
I20260709 13:06:36.664264 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.541920 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 117) took 2520 ms. Trace:
W20260709 13:06:36.546386 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 298592us
I20260709 13:06:36.663369 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.550423 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 1823) took 1619 ms. Trace:
I20260709 13:06:36.560004 23958 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.562399 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.563078 23866 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.564796 23855 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:36.078423 23736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.009s	sys 0.001s
I20260709 13:06:36.665220 22501 rpcz_store.cc:276] 0709 13:06:34.021227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.058056 (+ 36829us) service_pool.cc:224] Handling call
0709 13:06:34.101231 (+ 43175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.164353 (+1063122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.164389 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.164931 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.362551 (+197620us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:36.506338 (+1143787us) log.cc:844] Serialized 14 byte log entry
0709 13:06:36.541332 (+ 34994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.541623 (+   291us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.541680 (+    57us) raft_consensus.cc:1685] finished
0709 13:06:36.541692 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.541856 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":791659,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":185074,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":9164,"thread_start_us":2343112,"threads_started":4,"wal-append.queue_time_us":302555,"wal-append.run_cpu_time_us":2253,"wal-append.run_wall_time_us":1010789}
W20260709 13:06:36.669196 23736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.010s	sys 0.002s
I20260709 13:06:36.565488 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.566768 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.669749 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.566906 23835 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.568578 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:36.551347 23987 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.572962 23105 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:36.576400 23838 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:36.576838 23788 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.577433 23960 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.577813 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 929) took 1644 ms. Trace:
I20260709 13:06:36.577503 23847 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.578552 23957 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:36.581985 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 85696.4us
I20260709 13:06:36.567936 23840 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.665890 23958 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:36.567762 22499 rpcz_store.cc:269] 0709 13:06:34.935733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.948216 (+ 12483us) service_pool.cc:224] Handling call
0709 13:06:35.914240 (+966024us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:36.407383 (+493143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6306560}
I20260709 13:06:36.682937 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.665545 22427 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:36.683563 22499 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:36.683894 23958 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.581290 23744 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.226815 23832 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.595841 23773 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:36.596525 23743 raft_consensus.cc:1068] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: Unable to promote non-voter 9cea93fb03e04e48a6dabc4094ee7c93: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:36.599125 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:36.613996 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.613749 23921 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:36.615067 22575 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:36.616185 23923 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.616218 23926 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.619065 23931 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:36.619877 23932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.012s	sys 0.042s
I20260709 13:06:36.444614 23733 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:36.623657 22577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1034) took 2762 ms (client timeout 3294 ms). Trace:
I20260709 13:06:36.636459 23841 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.677109 23919 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:36.686172 23847 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.714785 23841 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.651537 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.651540 22508 rpcz_store.cc:276] 0709 13:06:34.932032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.937110 (+  5078us) service_pool.cc:224] Handling call
0709 13:06:34.937427 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.278246 (+340819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.348449 (+1070203us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54001824d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:36.348686 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664770304}
I20260709 13:06:36.716387 22505 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:36.653026 22545 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:36.643391 23972 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:36.717342 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 64409.2us
I20260709 13:06:36.718010 22545 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:36.694110 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.655407 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:36.656446 22472 connection.cc:256] RPC call timeout handler was delayed by -1.14796537299992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
I20260709 13:06:36.644299 23107 raft_consensus.cc:2410] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:36.657488 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.654894 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.657915 23924 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.658301 23976 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.663198 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 968) took 1392 ms. Trace:
I20260709 13:06:36.540655 23920 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.665266 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.665671 22576 rpcz_store.cc:276] 0709 13:06:34.930892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.941224 (+ 10332us) service_pool.cc:224] Handling call
0709 13:06:36.550241 (+1609017us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540016c1d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:36.550360 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3222344576}
I20260709 13:06:36.724973 22429 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:36.724439 22430 rpcz_store.cc:276] 0709 13:06:35.271064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.274062 (+  2998us) service_pool.cc:224] Handling call
0709 13:06:36.341837 (+1067775us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:36.663141 (+321304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26089728}
I20260709 13:06:36.665699 22546 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:36.725863 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.726104 22503 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
W20260709 13:06:36.726331 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 60736.5us
I20260709 13:06:36.726661 22430 raft_consensus.cc:2410] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:36.726953 23976 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.666940 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:36.727581 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.727886 23111 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.644573 23991 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.728612 23972 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.674691 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.653538 23973 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.662470 22426 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.729683 23972 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:36.730013 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.731117 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.731051 23972 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.732048 23972 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:36.731607 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.731930 23920 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.725781 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.733214 23973 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.734160 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.734412 23972 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.735246 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.735358 23973 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.655755 23751 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.735630 23972 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.680959 22547 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:36.736665 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 55788.5us
I20260709 13:06:36.737447 23835 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.737633 23920 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.685220 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.739004 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.725724 23924 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.704150 23960 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.672977 23855 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.671093 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.743726 22501 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:36.654027 23908 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.744688 23931 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.744730 23908 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.746997 23841 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.747236 23908 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.698143 23957 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:36.719395 22472 connection.cc:256] RPC call timeout handler was delayed by -1.0663818980000315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
I20260709 13:06:36.719426 22506 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:36.750069 23926 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.680411 22502 rpcz_store.cc:276] 0709 13:06:34.933527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.330747 (+397220us) service_pool.cc:224] Handling call
0709 13:06:35.331249 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.424264 (+1093015us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b540006a020. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006cd99dc0 00007f006ce241c0 00007f006ce25231 00007f006ce21d8f 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c
0709 13:06:36.577520 (+153256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.577751 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123068160}
I20260709 13:06:36.750499 23957 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.752353 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.752663 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.752822 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:36.753402 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.753520 22573 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:36.676975 23104 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.754761 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.755079 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.755543 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:36.756021 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.756832 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.757943 22426 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:36.759121 23921 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.759992 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.761749 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 97) took 1850 ms. Trace:
I20260709 13:06:36.758059 23855 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.760488 23107 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:36.762835 23855 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.673893 22504 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:36.765718 22503 raft_consensus.cc:2368] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3.
I20260709 13:06:36.766099 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:36.719970 22577 rpcz_store.cc:269] 0709 13:06:33.861183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.861916 (+   733us) service_pool.cc:224] Handling call
0709 13:06:34.426512 (+564596us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:36.623440 (+2196928us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b5400085f54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:36.623558 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5093171456}
I20260709 13:06:36.721598 23971 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.767163 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.767339 23971 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.767760 23971 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.768456 22502 raft_consensus.cc:1240] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.740173 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.718832 22545 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:36.771241 22581 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:36.771668 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 52909.1us
I20260709 13:06:36.715688 23733 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.723264 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.772274 23923 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.772720 23923 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.773092 23923 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.773237 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.760053 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.773912 23113 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:36.774660 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.775092 23743 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.773598 23733 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.775894 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:36.721956 23987 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.765118 23855 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.776690 22573 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:36.729079 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:36.778002 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 49006.1us
I20260709 13:06:36.778138 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:36.778774 22573 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.779114 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.779752 22501 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:36.765161 22499 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.731683 22425 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.781095 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:36.773662 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:36.680392 23788 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:36.767163 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:36.763085 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.782823 22432 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.776119 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.783459 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.783792 22424 raft_consensus.cc:2393] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:36.781672 22582 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.784669 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.733500 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.759140 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.785306 22430 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:36.785562 22506 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:36.748309 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.786239 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.786715 23788 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.786835 22428 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:36.787564 22581 raft_consensus.cc:2393] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:36.787861 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.774796 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:36.776628 23987 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.788836 22500 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:36.788944 23987 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.789938 22577 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:36.790242 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.791352 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.792310 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.796764 23832 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.797504 23832 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.792440 23733 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.767763 22504 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:36.789172 22424 raft_consensus.cc:2368] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3.
I20260709 13:06:36.771603 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.665033 23738 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.720705 22433 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:36.796963 22430 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.778792 22546 leader_election.cc:400] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3.
I20260709 13:06:36.799919 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.735802 22429 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.798094 22472 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:36.788542 22428 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:36.792436 22582 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:36.775193 22545 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:36.809803 23111 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:36.810547 22425 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:36.798624 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.817490 22472 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:36.715036 23919 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.815872 22546 leader_election.cc:403] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.788718 23971 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.821012 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:36.744251 23960 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:36.823148 22474 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:36.825107 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.826390 23079 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:36.827809 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:36.829185 22430 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:36.830400 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:36.832793 22429 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
W20260709 13:06:36.832973 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.833683 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.822988 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.835693 22582 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.837970 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:36.839221 22581 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:36.840837 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.846426 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.798182 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.847071 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:36.847458 22576 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:36.819535 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.848380 22426 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:36.781621 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.849323 22426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:36.819829 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.849885 23738 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.850279 22428 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:36.850454 23738 raft_consensus.cc:697] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:36.850916 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.820749 22503 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.849941 22426 raft_consensus.cc:606] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:36.852305 22426 raft_consensus.cc:614] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:36.852977 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 966) took 1582 ms. Trace:
I20260709 13:06:36.851639 22424 raft_consensus.cc:2393] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:36.855085 22433 raft_consensus.cc:2376] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3. Re-sending same reply.
I20260709 13:06:36.855551 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.856135 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.855849 22472 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:36.857143 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:36.856973 22430 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:36.857482 22472 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:36.858295 22424 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.860105 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.860826 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:36.861763 22578 raft_consensus.cc:2376] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2. Re-sending same reply.
I20260709 13:06:36.861933 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:36.860142 22581 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.862610 22582 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 1.
I20260709 13:06:36.683282 23840 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:36.866098 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:36.868695 22472 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:36.869117 22545 leader_election.cc:400] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3.
I20260709 13:06:36.869449 22545 leader_election.cc:403] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.823205 23924 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.846828 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.762177 22575 rpcz_store.cc:276] 0709 13:06:34.911407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.938395 (+ 26988us) service_pool.cc:224] Handling call
0709 13:06:35.038862 (+100467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.760880 (+1722018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.761485 (+   605us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400046354. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:36.761688 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3624424832}
I20260709 13:06:36.851419 23738 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.872814 22432 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:36.875288 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:36.876891 22579 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:36.877089 22424 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:36.876266 22430 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:36.820700 23926 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.878535 22425 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:36.870885 22545 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:36.879375 22472 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:36.879839 22433 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.881477 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:36.882386 23840 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.882850 23840 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.882915 22573 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:36.883275 23840 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.889179 23931 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:36.890535 23923 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:36.891803 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:36.893733 23104 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:36.894476 23931 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.894976 23931 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.895354 23931 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.822021 23832 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.899372 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.854079 23973 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.823254 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.863869 23920 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.902611 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.903204 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.814941 23733 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:36.905506 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.905818 22428 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:36.941118 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.941996 22428 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:36.943325 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.944784 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.890535 23976 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.910966 23926 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.906287 22545 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:36.904417 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.871754 23855 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.908298 22582 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.992892 22424 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:36.823446 23921 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3.
I20260709 13:06:36.910615 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.910847 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.924907 23106 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:37.006362 22504 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:37.006490 23113 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:36.853889 23744 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.912218 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.909300 22507 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:36.856681 23838 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.857302 23847 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.925360 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.916734 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:36.918530 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:36.912968 23924 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.920094 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.922274 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:36.877949 23751 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.879621 23890 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.895391 22398 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:36.905053 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:36.875507 23971 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.910465 23908 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3.
I20260709 13:06:36.924460 23987 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:36.994321 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 88141.5us
W20260709 13:06:36.995641 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.992964 23743 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.936149 23920 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.913749 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.005183 22574 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:37.174700 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:37.273435 22547 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:37.277400 22579 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
W20260709 13:06:37.314093 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 129408us
I20260709 13:06:37.314700 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.183746 22582 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:36.858839 22431 rpcz_store.cc:276] 0709 13:06:35.270356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.274082 (+  3726us) service_pool.cc:224] Handling call
0709 13:06:35.321931 (+ 47849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.654158 (+1332227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.654200 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.654686 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.821781 (+167095us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:36.823326 (+  1545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.852687 (+ 29361us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.852748 (+    61us) raft_consensus.cc:1685] finished
0709 13:06:36.852770 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.852914 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8850,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":1470570,"threads_started":2,"wal-append.queue_time_us":179437}
I20260709 13:06:37.300496 22425 raft_consensus.cc:2376] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3. Re-sending same reply.
I20260709 13:06:37.277895 22508 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:37.175659 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.092026 22581 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:37.279230 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:37.130021 22472 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.242s (SENT) [suppressed 35 similar messages]
I20260709 13:06:37.007392 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:37.321470 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 426140us
I20260709 13:06:37.323807 22579 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:37.326102 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:37.326349 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 196409us
I20260709 13:06:37.327469 22577 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.993574 23976 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:37.279641 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:37.331025 22507 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.994932 23926 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.329205 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.283037 23920 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.330260 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:37.283427 23743 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:36.935619 23973 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.223232 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.252141 23921 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.328156 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 54799.7us
W20260709 13:06:37.331976 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 52416.5us
I20260709 13:06:36.991549 23919 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:37.332800 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.386672 22545 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:37.026943 23840 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.388429 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.334594 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.126178 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.392449 23976 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:37.393422 22575 raft_consensus.cc:2393] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:37.393684 23976 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.394381 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.335047 23971 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.395625 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.335846 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.395929 23971 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:37.337512 22508 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.251669 23733 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:37.396377 23971 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.165071 23923 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:36.945010 22501 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:37.392545 23975 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:37.397399 23975 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:37.397771 23975 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:37.026285 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 128660us
I20260709 13:06:37.398960 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.399948 23076 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:37.308866 23832 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.402148 22578 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:37.403679 23971 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:37.405028 22582 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:06:37.405339 23999 log.cc:927] Time spent T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:06:37.404699 22575 raft_consensus.cc:2410] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:37.406543 23971 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:37.407052 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.408036 22575 raft_consensus.cc:2410] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:37.409003 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:37.409600 22575 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.410368 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.412052 22508 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:37.327729 23773 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:37.386610 22547 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:37.324662 23744 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:37.388599 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:37.334197 23970 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.328617 23847 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:37.315457 22427 raft_consensus.cc:2376] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2. Re-sending same reply.
I20260709 13:06:37.392688 22574 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:37.216176 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:37.415223 22576 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:37.338049 23926 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.380843 23743 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.420634 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.451805 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:37.550390 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.440328 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08002da960 after lost signal to thread 21312
I20260709 13:06:37.448892 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:37.419489 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 93658.9us
W20260709 13:06:37.461189 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 72721.3us
I20260709 13:06:37.444139 23773 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:37.390451 23921 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.569164 23113 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
W20260709 13:06:37.460640 23738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.017s	sys 0.025s
W20260709 13:06:37.572276 23738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.017s	sys 0.025s
I20260709 13:06:37.573081 23773 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:37.563113 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 142791us
W20260709 13:06:37.573824 23998 log.cc:927] Time spent T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 13:06:37.581067 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.451555 23971 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:37.586160 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:37.566681 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08002da980 after lost signal to thread 21315
I20260709 13:06:37.563997 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:37.466065 23832 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.610381 22396 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:37.616123 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.569854 23923 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:37.619843 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:37.620623 22581 raft_consensus.cc:2376] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3. Re-sending same reply.
I20260709 13:06:37.623884 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.591230 23971 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.624591 22581 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 1.
I20260709 13:06:37.633672 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:37.615329 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 214121us
I20260709 13:06:37.634996 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.562089 23847 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:37.638212 24003 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:37.638176 22581 raft_consensus.cc:2393] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:37.620385 23960 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:37.642184 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.617726 23832 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:37.563789 23744 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:37.643406 22581 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:37.625550 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:37.644860 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.648842 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:37.648097 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:37.649904 22504 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.646226 22547 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:37.636193 23971 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:37.653249 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.658681 22582 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:37.657634 22581 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:37.650964 22547 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:37.659857 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.660512 22581 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
W20260709 13:06:37.643954 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08002db060 after lost signal to thread 22365
I20260709 13:06:37.466454 24004 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:37.620565 23995 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:37.641530 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.645077 23960 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.644713 23832 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.669085 22504 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:37.657730 23923 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.634675 23076 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:37.651467 23921 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.660912 23919 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.667932 23856 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:06:37.673786 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:37.662326 23970 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.662467 23904 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:37.675218 24006 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:06:37.673472 24004 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:37.668233 23995 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.664799 23973 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.664526 23838 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:37.670492 23960 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.675922 23923 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:37.626929 24008 consensus_queue.cc:1059] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:06:37.684653 23989 raft_consensus.cc:2764] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:06:37.694852 23923 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.689016 23995 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.695989 23941 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:37.686038 23904 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.684648 23919 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:06:37.693647 23134 debug-util.cc:398] Leaking SignalData structure 0x7b080036b760 after lost signal to thread 22457
I20260709 13:06:37.702674 23941 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:37.708943 23904 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:37.711015 23975 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.712260 23744 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:37.686808 23970 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:37.713635 24005 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:06:37.694160 24004 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:37.694572 23931 consensus_meta.cc:287] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.799s	user 0.012s	sys 0.000s
I20260709 13:06:37.728103 23941 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.745291 23960 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.688405 24011 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:06:37.748921 24012 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:06:37.749125 23975 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.657867 22472 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:37.777482 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 165559us
W20260709 13:06:37.779457 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 121573us
I20260709 13:06:37.780025 22396 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:37.781589 22396 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:37.781791 22472 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:37.786279 24024 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:37.790129 22503 consensus_meta.cc:287] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.938s	user 0.007s	sys 0.003s
I20260709 13:06:37.805437 22503 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:37.806524 24024 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.808264 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.809449 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.810297 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.811249 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.811900 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.813225 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.806911 22431 raft_consensus.cc:1240] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.808000 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.803390 22573 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:37.816421 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.816920 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.817443 22427 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:37.821184 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.824645 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.823360 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.825752 22431 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:37.817924 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.827013 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.827240 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:37.828105 22431 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:37.828629 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.818706 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.830364 22429 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:37.830904 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:37.831549 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:37.818223 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:37.828893 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 209799us
I20260709 13:06:37.819486 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.832916 22575 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:37.833775 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:37.837631 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 177599us
I20260709 13:06:37.832108 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:37.832132 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 170548us
I20260709 13:06:37.839653 22424 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.840746 22474 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:37.843168 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:37.846280 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 161947us
I20260709 13:06:37.829282 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.847524 23079 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:37.848225 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.850082 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:37.850420 23079 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:37.816196 24024 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.825867 22427 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:37.852515 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:06:37.727452 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3ba0 after lost signal to thread 22458
I20260709 13:06:37.855916 23733 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.737248 23926 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.714612 23743 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:37.857465 23134 debug-util.cc:398] Leaking SignalData structure 0x7b080035bf80 after lost signal to thread 22532
I20260709 13:06:37.725805 23840 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.859262 23926 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:37.860886 22582 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:37.859401 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa9a0 after lost signal to thread 22606
W20260709 13:06:37.861596 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08001003e0 after lost signal to thread 22607
I20260709 13:06:37.860433 23744 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:37.862725 23744 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:37.863220 23744 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:37.863358 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08003cdba0 after lost signal to thread 23137
W20260709 13:06:37.863821 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08003cdb80 after lost signal to thread 23138
I20260709 13:06:37.863677 23744 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:37.725971 23920 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.870011 23840 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.873554 23840 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.874416 23931 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.875572 23920 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:37.876451 23840 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.870759 23923 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:37.877190 22579 raft_consensus.cc:2393] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:37.878356 23931 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.879343 23931 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.859284 23743 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.856546 23733 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:37.880172 23931 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.881049 23733 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.881942 23832 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.882761 23931 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.852299 22575 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:37.888705 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:37.889201 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:37.890110 23832 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.886994 23958 raft_consensus.cc:3055] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:37.892835 23958 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:37.893071 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.895720 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.880244 23923 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:37.895668 23832 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.896322 22546 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:37.898120 23832 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.907658 22546 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:37.907763 23923 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:37.929556 23923 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:06:37.929980 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 985061us
I20260709 13:06:37.930881 23832 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.884117 24024 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:37.931344 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:37.931658 23832 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.933632 23743 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.912519 23958 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.934893 23958 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.934785 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:37.935961 23743 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.938652 22425 raft_consensus.cc:1240] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 1. Current term is 3. Ops: []
I20260709 13:06:37.941257 24024 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:37.942071 24024 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.942600 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:37.922752 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1063) took 1065 ms. Trace:
I20260709 13:06:37.931200 23923 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:37.893191 22574 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.944456 22399 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:37.945183 22546 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:37.926142 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1060) took 1111 ms. Trace:
I20260709 13:06:37.945843 22577 rpcz_store.cc:276] 0709 13:06:36.814152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.814291 (+   139us) service_pool.cc:224] Handling call
0709 13:06:36.847857 (+ 33566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.333935 (+486078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.925519 (+591584us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54002d14d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:37.925899 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102587136}
I20260709 13:06:37.946581 23773 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.943969 22576 rpcz_store.cc:276] 0709 13:06:36.856774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.856908 (+   134us) service_pool.cc:224] Handling call
0709 13:06:37.922274 (+1065366us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400086954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:37.922512 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1282027904}
I20260709 13:06:37.947579 23840 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:37.948246 23840 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.948707 23840 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:37.948604 22399 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:37.953771 24024 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.955082 22580 raft_consensus.cc:1240] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.955247 22399 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:37.955953 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1067) took 1018 ms. Trace:
I20260709 13:06:37.956750 23859 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:37.957306 23859 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.957338 23835 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:37.957739 24024 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.957969 23835 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:37.958248 23908 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.959084 23908 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.959461 23835 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:37.961601 23835 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.961831 23908 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.962574 23908 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.963321 23908 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.965919 22580 rpcz_store.cc:276] 0709 13:06:36.937281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.939750 (+  2469us) service_pool.cc:224] Handling call
0709 13:06:37.954244 (+1014494us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:37.954600 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.955603 (+  1003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.955869 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26131840}
I20260709 13:06:37.957957 23859 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:37.966404 23908 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:37.967584 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:37.966626 23773 consensus_queue.cc:1059] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:06:37.973163 22545 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:37.974148 23736 raft_consensus.cc:3055] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:37.974645 23736 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:37.975826 23736 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.977118 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 951) took 1215 ms. Trace:
I20260709 13:06:37.974633 23743 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:37.978204 23743 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:37.977152 23736 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.977576 22503 rpcz_store.cc:276] 0709 13:06:36.761759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.766863 (+  5104us) service_pool.cc:224] Handling call
0709 13:06:37.976870 (+1210007us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b54003eb054. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:37.977009 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84347776}
I20260709 13:06:37.987888 23743 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.989374 22399 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:37.990729 24033 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:37.991314 24033 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:37.991647 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:37.991822 24033 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.992537 23931 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.992882 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:37.995117 23931 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:37.995762 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:37.996320 23931 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:37.996095 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:37.967535 22546 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.001389 23733 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.002055 23773 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.003242 23908 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.005499 23904 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:37.990670 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.008790 22505 raft_consensus.cc:2393] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:38.012807 23077 leader_election.cc:400] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3.
W20260709 13:06:38.013072 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45631.7us
I20260709 13:06:38.000551 24033 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.014314 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.017531 24033 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.018334 24024 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.917132 23941 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.020861 23859 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.023347 23859 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.023149 23840 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:38.024683 23908 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.024955 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.028594 22506 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:38.030706 22505 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:38.030561 23736 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:38.045094 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.033970 23733 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.034745 22503 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:38.023372 23941 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:38.036204 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.037209 23904 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:38.008514 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:38.055958 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 267571us
I20260709 13:06:38.062390 24026 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.063521 24026 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.064034 24026 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.064347 24026 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.065605 23970 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:38.063293 22331 catalog_manager.cc:5697] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:06:38.066198 23987 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:38.073580 23736 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.077517 22547 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.078630 23926 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.078374 23971 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.080555 22331 catalog_manager.cc:5697] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 3, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:38.082154 23960 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.082883 24007 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.084484 23840 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:38.084818 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 76494.8us
I20260709 13:06:38.076241 23736 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:38.069540 23077 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:38.088039 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 247606us
I20260709 13:06:38.086822 23931 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.096585 24025 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:38.097400 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.097796 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:38.098495 23920 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:38.098965 24025 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:38.099591 24025 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.100126 23847 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.100662 23751 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:06:38.102535 23919 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:38.099694 23924 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:38.104370 23890 raft_consensus.cc:3055] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.104683 22474 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.105144 23890 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:38.105485 22575 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:38.106160 22474 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.111033 24017 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.111414 23107 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:38.112597 22474 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:38.108314 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:38.113989 23926 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:38.114897 23106 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:38.108611 23855 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.116053 23855 raft_consensus.cc:697] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:38.090804 23904 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:38.106432 23971 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:38.106241 23890 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.127547 22499 raft_consensus.cc:1240] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.127878 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:38.129982 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:38.131783 23924 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:38.132171 23924 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:38.132550 23924 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:38.133140 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 76381.2us
I20260709 13:06:38.133502 22506 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.134270 24014 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.130797 22472 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.141058 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.141759 22505 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:38.142103 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 106423us
I20260709 13:06:38.143154 23743 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.145056 22399 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:38.146544 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:38.147559 23991 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:38.148306 23991 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.114004 24026 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.149127 23919 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:38.149763 22399 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:38.150480 23751 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:38.151041 24026 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.150739 23995 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.152397 22472 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.153035 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.154939 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:38.130820 23838 raft_consensus.cc:1064] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:38.114940 23926 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:38.162004 23744 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.163589 22424 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:38.165414 22505 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:38.167285 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.168118 23991 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.175648 22504 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.166457 23743 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:38.174726 23991 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:38.196270 23991 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.196398 22327 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43642 (request call id 130) took 4975 ms. Trace:
I20260709 13:06:38.181838 23924 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:38.199939 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 534467us
I20260709 13:06:38.200798 23104 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:06:38.202548 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 58275.5us
W20260709 13:06:38.172868 23838 raft_consensus.cc:1068] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Unable to promote non-voter 9cea93fb03e04e48a6dabc4094ee7c93: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:38.203536 23890 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.218274 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.219624 22546 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.220902 23743 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.221621 23743 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:38.205374 23995 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.117292 23855 consensus_queue.cc:237] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.170758 23926 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:38.180791 23920 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:38.214046 23740 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.225140 23920 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:38.215312 23744 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.217049 22503 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.217412 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.230789 22508 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
W20260709 13:06:38.224416 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 69586.7us
I20260709 13:06:38.230868 24025 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.231153 23991 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.233913 23926 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.216804 24026 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.235222 23926 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.235891 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:38.236901 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:38.237164 22474 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.229769 23924 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:38.239081 23919 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.238691 23838 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:38.216451 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 64145.2us
I20260709 13:06:38.227945 23920 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.229077 23740 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.240461 23838 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.243666 22504 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:38.239954 23991 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.243095 23838 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.257162 24026 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:38.257925 24026 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.261291 24026 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.266352 22546 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:38.267326 23971 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.267833 23971 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:38.268738 23971 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.270641 23743 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:38.271353 23743 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.273252 23079 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.274998 23743 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:38.250871 23740 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.252683 24025 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.196977 22327 rpcz_store.cc:276] 0709 13:06:33.220912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.221059 (+   147us) service_pool.cc:224] Handling call
0709 13:06:34.333792 (+1112733us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b5400250228. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f007078c161 00007f00708163af 00007f0070817b11 00007f0072d182d1 00007f0072d18b2f 00007f0072bd7d4b 00007f0072cdfc3e 00007f00711a02a4 00007f00711a0232 00007f00711a0161 00007f00711a00dc
0709 13:06:38.196095 (+3862303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:35.117337 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:35.313546 (+196209us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:35.313591 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:06:35.313609 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:35.418903 (+105294us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:35.418975 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:35.419005 (+    30us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:35.419706 (+   701us) tablet.cc:701] Row locks acquired
0709 13:06:35.419723 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:06:35.419904 (+   181us) write_op.cc:270] Start()
0709 13:06:35.420028 (+   124us) write_op.cc:276] Timestamp: P: 1783602395419850 usec, L: 0
0709 13:06:35.420052 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:06:35.500658 (+ 80606us) log.cc:844] Serialized 3194 byte log entry
0709 13:06:36.742269 (+1241611us) op_driver.cc:464] REPLICATION: finished
0709 13:06:36.991064 (+248795us) write_op.cc:301] APPLY: starting
0709 13:06:36.991147 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:37.144789 (+153642us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:37.163181 (+ 18392us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:37.224022 (+ 60841us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:37.228827 (+  4805us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:06:37.230705 (+  1878us) write_op.cc:312] APPLY: finished
0709 13:06:37.231073 (+   368us) log.cc:844] Serialized 65 byte log entry
0709 13:06:37.380527 (+149454us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:37.388614 (+  8087us) write_op.cc:454] Released schema lock
0709 13:06:37.391399 (+  2785us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:37.458884 (+ 67485us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:37.460713 (+  1829us) write_op.cc:454] Released schema lock
0709 13:06:37.713122 (+252409us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:37.723773 (+ 10651us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54001f1654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce1f32a 00007f006cda4f14 00007f006cda4ec3 00007f006cda4e38 00007f006cda4df3 00007f006cda40dc 00007f006cdcde16 00007f006cdb5cbb 00007f006cda039d 00007f006cda3d75
Metrics: {"mutex_wait_us":2164,"reported_tablets":15,"spinlock_wait_cycles":72994688,"child_traces":[["op",{"apply.queue_time_us":248552,"apply.run_cpu_time_us":24998,"apply.run_wall_time_us":454876,"num_ops":8,"prepare.queue_time_us":674061,"prepare.run_cpu_time_us":63911,"prepare.run_wall_time_us":1681383,"raft.queue_time_us":13395,"raft.run_cpu_time_us":37835,"raft.run_wall_time_us":1542007,"replication_time_us":1322021,"spinlock_wait_cycles":1293429760,"thread_start_us":1984266,"threads_started":5,"wal-append.queue_time_us":813027,"wal-append.run_cpu_time_us":8012,"wal-append.run_wall_time_us":1052262}]]}
I20260709 13:06:38.275590 24014 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.248638 23856 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.287797 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.291326 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:38.291652 24034 log.cc:927] Time spent T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:06:38.289602 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:38.290127 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:38.288043 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45245.4us
I20260709 13:06:38.299337 22424 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:38.301499 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.305104 23104 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:38.311429 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 85837.8us
I20260709 13:06:38.297572 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:38.311174 23113 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.025s	sys 0.018s
I20260709 13:06:38.316881 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.297600 23995 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:38.318912 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.319321 23995 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.320590 23991 consensus_queue.cc:1059] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:38.321719 23991 raft_consensus.cc:3055] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:38.322078 23991 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:38.322934 23991 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.324149 23991 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.301277 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:38.325559 22427 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:38.328640 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.315501 23107 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:38.334816 23995 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:38.318117 22424 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:38.318315 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.295893 24026 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:38.336400 22433 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:38.318809 22505 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:38.319626 22425 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:38.337687 24025 consensus_queue.cc:1059] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.339021 24025 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.343883 22472 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.294207 23838 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.350924 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:38.351709 22424 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.354871 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:38.355558 22425 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.356621 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.356033 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.340178 24025 raft_consensus.cc:3055] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:38.359604 24026 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.381513 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:38.384671 24030 raft_consensus.cc:3055] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.385155 24030 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:38.386078 24030 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.387562 24030 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.388681 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:38.390196 24007 consensus_queue.cc:1059] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:38.391392 24007 raft_consensus.cc:3055] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.391757 24007 raft_consensus.cc:740] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:38.392306 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.392874 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.392612 24007 consensus_queue.cc:260] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.393455 22429 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:38.394197 24007 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.394374 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.396514 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.397344 22433 raft_consensus.cc:2393] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:38.398434 23957 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:38.399317 22506 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:38.399076 23957 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.400568 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.401999 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.402297 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:38.403303 22426 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:38.404453 24033 consensus_queue.cc:1059] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:38.405560 23931 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:38.406189 23931 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.408181 23931 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:38.343122 23920 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.405560 24033 raft_consensus.cc:3055] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.404708 23743 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.353571 23995 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:06:38.361590 22505 raft_consensus.cc:1240] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:38.412227 22424 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:38.412626 22425 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:38.361879 22508 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:38.421386 22507 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:38.425762 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.427258 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.429597 22396 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.404744 23957 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:38.409238 24033 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:38.434657 24033 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.435734 23931 raft_consensus.cc:1064] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:38.359071 24025 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:38.432514 24024 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:38.432737 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 119201us
I20260709 13:06:38.433254 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.404379 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.361892 23971 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.427162 23920 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.443938 22581 raft_consensus.cc:2393] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:38.445430 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:38.429160 22575 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:38.431244 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.421108 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.435983 24033 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.458660 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:38.459889 22396 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.447844 23971 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.445617 22501 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.445518 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.469419 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:38.470639 22472 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.424300 23743 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.458479 23855 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:38.461410 22580 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.458362 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:38.440997 23856 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:06:38.472666 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.480487 22582 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:38.480692 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:38.482574 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:38.468055 23995 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.483968 22429 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:38.486423 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.476254 23920 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:38.488694 24025 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.492864 23838 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.492580 24007 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:38.479434 23919 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.493113 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:38.461875 23773 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:06:38.498979 22426 raft_consensus.cc:2376] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4. Re-sending same reply.
I20260709 13:06:38.500759 22502 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:38.509963 22429 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:38.493757 22573 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.511142 23920 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:38.515198 22575 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:38.529628 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.523169 22432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:38.533368 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.539685 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.529481 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.518734 24025 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.541602 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.551270 22581 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.542902 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.543470 23856 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:38.544242 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 48498.3us
I20260709 13:06:38.545099 23923 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.564378 22472 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:38.564271 23923 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:38.565013 24045 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:06:38.565789 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.565917 23920 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.566706 23923 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:38.567092 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.547533 22396 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:38.568212 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.568707 23077 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:38.569675 22396 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:38.569855 23989 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:38.570281 23989 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.570590 23989 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.513363 23987 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:38.571173 23987 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.568372 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:38.573083 23958 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.573767 23738 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.574262 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.574497 23738 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:38.575497 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.575814 23841 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.576232 23841 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:38.576562 23841 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.578341 23971 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:38.579846 23743 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:38.580265 22580 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:38.549216 22433 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:38.549381 22582 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.494262 23855 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.515288 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.522902 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:38.552750 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 65414us
I20260709 13:06:38.556917 23931 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.558960 22432 raft_consensus.cc:606] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:38.561187 24008 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:38.549528 24024 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:06:38.517071 22427 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:38.573908 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:38.594707 22472 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:38.595594 23838 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:38.596158 23838 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:38.597196 23838 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.597779 22574 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:38.598654 23890 raft_consensus.cc:1064] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:38.598773 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:38.599155 23890 raft_consensus.cc:1068] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Unable to promote non-voter 9cea93fb03e04e48a6dabc4094ee7c93: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:38.592177 23958 raft_consensus.cc:697] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:38.600664 22575 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:38.601284 22578 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:38.602267 22575 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:38.603835 23957 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.604640 22578 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:38.605247 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:38.589339 23919 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.589519 23926 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:38.608358 23855 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.608618 23926 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:38.609073 23926 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.613178 24011 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:38.614931 24011 consensus_queue.cc:1059] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:38.586326 22576 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:38.580214 24040 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:06:38.596096 24046 log.cc:927] Time spent T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:06:38.589716 23856 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.619438 22573 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:38.622054 22427 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:38.623961 23079 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.624974 23995 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:38.625470 23995 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:38.626189 24001 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.626379 23995 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.627745 23995 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.630654 23958 consensus_queue.cc:237] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:38.591542 22432 raft_consensus.cc:614] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:38.615906 24011 raft_consensus.cc:3055] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:38.641084 22576 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:38.643689 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.646001 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:38.650022 22578 raft_consensus.cc:1240] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:38.652088 23926 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.653677 22577 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.654960 23926 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:38.650074 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 76232.4us
I20260709 13:06:38.657363 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:38.659318 22576 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.647161 22425 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:38.650302 24033 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.665305 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:38.634920 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.666616 23104 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:38.672843 22581 raft_consensus.cc:2410] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:38.654769 24001 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.669096 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:38.674439 24008 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.681314 23113 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:38.681476 22396 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.661257 22575 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:38.648142 24011 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:38.680379 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:38.691346 22546 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:38.687691 24008 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:38.688195 23840 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.680408 23733 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:06:38.688228 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44635.2us
I20260709 13:06:38.684870 22396 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.697996 22424 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:38.680660 23923 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.670125 24033 raft_consensus.cc:697] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:38.705545 22581 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:38.713956 22396 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:38.692833 23840 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.708582 22573 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:38.663651 23926 consensus_queue.cc:1059] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:06:38.706187 23855 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.705823 23736 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.705199 23743 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:38.707947 24007 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:06:38.718201 23840 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.717128 23989 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.730242 24008 consensus_queue.cc:1059] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:06:38.756129 23736 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:38.775698 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 84418.6us
I20260709 13:06:38.776935 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:38.758325 23855 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:38.778046 22582 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:38.719055 24024 consensus_queue.cc:1059] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:06:38.760839 23971 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 13:06:38.806895 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 92776.6us
I20260709 13:06:38.808779 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.768328 23743 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.813688 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:38.834415 22579 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:06:38.817305 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48454.7us
I20260709 13:06:38.818867 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.760916 24011 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.824541 23855 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:38.801518 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 134747us
W20260709 13:06:38.849520 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 72632.3us
I20260709 13:06:38.858893 22546 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:38.858274 22433 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:38.851500 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.860438 22424 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:38.852036 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.843825 23904 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:38.849767 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.856860 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.819486 23841 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:38.884123 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.850348 22499 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:06:38.885551 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.851038 23743 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:38.852843 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.857093 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.816866 24033 consensus_queue.cc:237] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:38.884662 22580 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:38.876003 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:38.953276 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.961691 22427 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:38.954445 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 250907us
I20260709 13:06:38.889366 23904 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.963212 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.965862 22504 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:38.966800 23904 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.974524 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.975929 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.959110 24011 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.976884 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.994184 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:38.995437 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:38.984035 22503 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:06:38.996510 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 139637us
I20260709 13:06:38.988749 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:39.003778 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:39.005638 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:39.014648 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:39.015551 22504 raft_consensus.cc:2393] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:38.987434 23989 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:38.987417 24024 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:39.020815 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:39.023763 22504 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:39.023233 22508 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:38.999600 24007 consensus_queue.cc:1059] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:39.011750 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:39.036567 24061 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:39.037196 24061 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.038321 24026 raft_consensus.cc:3055] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:39.038803 24026 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:39.039319 24061 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:39.044852 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.027153 23960 raft_consensus.cc:3055] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:39.077186 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:39.080271 24053 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
W20260709 13:06:39.081681 24057 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:06:39.084035 24068 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:39.039757 24026 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:39.057044 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:39.091725 22501 raft_consensus.cc:2393] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:39.091912 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:39.093385 22545 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.055173 23841 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:39.028650 24024 consensus_queue.cc:1243] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer 10c2f471167442c0b75d8cd50ed8c40c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:39.071609 23960 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:39.096658 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 237803us
I20260709 13:06:39.096235 22505 raft_consensus.cc:2376] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3. Re-sending same reply.
W20260709 13:06:39.098737 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.078755 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:39.076719 23926 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:39.114167 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:39.117252 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:39.118006 22429 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 2: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:39.109575 24026 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.119052 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.119984 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.122742 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.125293 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:39.125626 22499 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:39.128110 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.129280 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.137912 22425 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:39.116797 23926 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:39.132298 23960 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.087186 23840 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.135509 22433 raft_consensus.cc:2393] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:39.136977 22429 raft_consensus.cc:2410] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:39.101778 23077 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:39.141925 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.116747 24024 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.136098 22472 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:39.149684 23926 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:39.141934 22426 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.111223 23904 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.150650 22425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:39.165220 22425 raft_consensus.cc:606] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.165795 22425 raft_consensus.cc:614] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:39.166823 22431 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:39.148777 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:39.168679 22433 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:39.160720 23733 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.169617 23733 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:39.149555 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:39.170058 23733 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.170552 22429 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:39.171981 22429 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:39.173642 22429 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:39.186163 22396 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.191991 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:39.197431 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 102077us
I20260709 13:06:39.168859 22431 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:39.193492 23995 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:39.213889 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.200987 23926 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.188971 24024 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:39.228130 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 92108.5us
I20260709 13:06:39.218029 24080 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:39.236856 23077 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.246397 24080 raft_consensus.cc:3055] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:39.246968 24080 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:39.231658 23904 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:39.250577 24014 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.251225 24014 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:39.242890 23987 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:39.255824 24054 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:39.252189 24014 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:39.274016 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:39.279472 22507 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:39.286095 22426 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:06:39.247880 24080 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:39.290822 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 90091.4us
I20260709 13:06:39.294231 23076 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.295039 24011 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:39.296723 24075 log.cc:927] Time spent T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:06:39.300192 24087 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:06:39.300719 24082 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:06:39.305028 24076 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:06:39.304935 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:39.304898 23738 raft_consensus.cc:3055] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:39.309791 24066 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.323263 22428 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:39.327143 24065 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.327641 24065 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.324668 24066 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.328516 24066 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.325934 23738 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:39.330133 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 216004us
I20260709 13:06:39.328001 24065 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.330745 24081 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:39.326263 23840 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:39.331336 24081 raft_consensus.cc:697] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:39.332422 24081 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:39.330328 23738 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.334142 23738 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:39.330036 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 236743us
I20260709 13:06:39.335798 22545 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.337150 22545 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.338086 24073 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.338773 24073 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.340935 23736 raft_consensus.cc:3055] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:39.341943 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.344287 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:39.330974 22546 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:39.350257 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.295141 24024 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:39.360435 22506 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.364768 22546 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:39.365411 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:39.360680 23736 raft_consensus.cc:740] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:39.363868 22545 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.368717 24073 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:39.370100 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:39.371088 23971 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.394819 22508 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.370713 24065 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.371634 23840 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:39.341282 24033 raft_consensus.cc:3055] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:39.377617 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.401173 22546 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:39.399647 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.406949 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.330444 24074 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.418980 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.397954 23744 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.405185 24026 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.404162 24080 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.403645 24033 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:39.424757 22545 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.403162 24073 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:39.415073 23743 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.414647 23904 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.414883 23987 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.425712 23744 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:39.432732 22545 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.422147 24061 consensus_queue.cc:1059] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:06:39.424232 23931 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.424644 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:39.438408 24096 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.425501 22499 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:39.428737 23958 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:39.432813 23971 raft_consensus.cc:697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:06:39.440222 24085 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:06:39.433497 23743 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:39.424430 23733 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:39.459429 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:39.459233 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:39.430757 24026 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:39.462706 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.435001 24070 consensus_queue.cc:1059] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:39.447932 23987 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.457409 23743 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.488720 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:39.482699 22582 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:39.492103 22579 raft_consensus.cc:2368] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3.
I20260709 13:06:39.457299 24077 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:39.494302 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.497406 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 64759.1us
I20260709 13:06:39.497922 24033 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.491905 22573 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:39.506623 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.513413 22577 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:39.497125 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:39.516158 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:39.516139 24065 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:39.528448 24052 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.713s	user 0.002s	sys 0.000s
I20260709 13:06:39.529181 23744 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:39.529840 24084 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:06:39.502714 24058 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:39.531663 24058 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:39.532182 24092 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 13:06:39.534195 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 109) took 1054 ms. Trace:
I20260709 13:06:39.534605 22430 rpcz_store.cc:276] 0709 13:06:38.479407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.479689 (+   282us) service_pool.cc:224] Handling call
0709 13:06:38.486980 (+  7291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.495100 (+  8120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.495127 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.524107 (+ 28980us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.754275 (+230168us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:38.754309 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.754378 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.527786 (+773408us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:39.533889 (+  6103us) raft_consensus.cc:1685] finished
0709 13:06:39.533913 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.534117 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64838912,"thread_start_us":179165,"threads_started":1,"wal-append.queue_time_us":266635}
I20260709 13:06:39.529868 22578 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:39.536619 22396 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.510138 24073 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:39.539777 24024 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.540649 24030 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.481911 23971 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.502570 23733 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:39.542196 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.545054 24058 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:39.546936 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:39.511376 23987 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:39.549829 22474 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:39.552328 23079 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:39.554759 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:39.548949 22506 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:39.557207 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:39.547367 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:39.559552 23920 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.559794 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:39.561847 22430 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:39.568341 22425 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:39.573487 23077 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:39.543005 24077 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:39.576846 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:39.577585 22499 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:39.578238 23079 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.578423 24100 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.580281 24015 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.569984 23856 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:39.584195 22425 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: [3.5-4.6]
W20260709 13:06:39.585609 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.587350 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.587931 22472 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:39.545094 24065 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.591168 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.588603 22399 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.588806 22581 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:39.587956 22424 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.588709 22577 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:06:39.592314 23733 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:39.576493 24088 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:39.600936 22577 pending_rounds.cc:85] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 2
I20260709 13:06:39.543618 24066 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.615366 23743 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.599681 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.616765 23733 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:39.617195 22427 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.617728 23733 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:39.618076 23076 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:39.620750 23740 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.620832 23076 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:39.621238 23740 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:39.592681 24007 consensus_queue.cc:1059] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:06:39.595155 24100 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.621680 22577 pending_rounds.cc:107] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:06:39.622239 22577 raft_consensus.cc:2917] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:06:39.622711 22577 raft_consensus.cc:2889] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:39.623379 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 76079.5us
I20260709 13:06:39.624151 22545 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.621621 23740 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.645802 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:39.637125 24100 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.647526 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:39.649117 22582 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:39.651335 24104 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.637001 24011 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.653766 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.658047 22424 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:39.610138 24080 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.655418 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:39.655422 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:39.661689 22546 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:39.665402 22577 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:06:39.668737 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 80890.1us
I20260709 13:06:39.642449 23923 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.642587 24070 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.656390 24011 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.654852 24073 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.659430 23773 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.661239 24104 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:39.684621 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:39.670712 22472 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:39.681674 23926 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.681825 23923 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:39.680550 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.691711 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:39.692085 23923 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:39.712446 23743 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:39.712996 22432 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:39.713565 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:39.689978 24099 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:06:39.693782 24061 raft_consensus.cc:3055] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:39.712996 22425 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:39.690217 24060 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:39.717116 24060 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:39.718012 24060 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:39.718393 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 47768.2us
I20260709 13:06:39.719412 24110 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.719862 24110 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:39.663793 23840 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:06:39.720683 23926 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.721244 23840 raft_consensus.cc:3055] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:39.721699 23840 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:39.696898 24112 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:39.683339 24011 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.722360 24112 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.722535 23840 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:39.723737 23840 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.678015 24026 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:39.682227 24007 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.699939 22427 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:39.725069 24007 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.726747 23736 consensus_queue.cc:260] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.702916 24100 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:39.705986 24111 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:39.729439 24111 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:39.729815 24111 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:39.730690 24111 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.731997 24111 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.709962 23960 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.720252 24110 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.721405 23926 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:39.724677 24112 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:39.701876 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:39.706590 24096 raft_consensus.cc:3055] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:39.732920 23104 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 LEARNER]: Advancing to term 3
I20260709 13:06:39.659636 23987 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:06:39.736783 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 52246.1us
I20260709 13:06:39.772001 22474 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:39.739127 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.737522 24061 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:39.741768 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:39.774392 22424 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:39.728269 23736 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:39.772907 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.772892 22428 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.688119 23920 raft_consensus.cc:697] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:39.778563 24116 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.783780 24122 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.724820 24026 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:06:39.798564 24026 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.799284 24026 consensus_queue.cc:1059] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:39.799891 22331 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43174 (request call id 251) took 6535 ms. Trace:
I20260709 13:06:39.800686 24122 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.802510 24033 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.769920 24096 raft_consensus.cc:740] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:39.785797 24113 consensus_queue.cc:1059] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:06:39.784893 24061 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.814258 23926 raft_consensus.cc:3055] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:39.748612 23856 raft_consensus.cc:697] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:39.814500 24061 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.815605 23740 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:39.804656 22428 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
W20260709 13:06:39.817203 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 158853us
I20260709 13:06:39.809227 23920 consensus_queue.cc:237] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.774186 23106 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:39.786535 24104 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:39.779023 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 59491.7us
I20260709 13:06:39.796679 24066 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:39.803395 24122 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:39.827970 22472 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:39.831403 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:39.832571 23113 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:39.814805 23926 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:39.815696 24007 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:39.880409 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:39.821058 24008 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:06:39.884829 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:39.885810 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:39.886044 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:39.865058 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 82478.5us
I20260709 13:06:39.869927 24122 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:39.800287 22331 rpcz_store.cc:276] 0709 13:06:33.264453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.264596 (+   143us) service_pool.cc:224] Handling call
0709 13:06:39.799824 (+6535228us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:38.342297 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:38.479041 (+136744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:38.481490 (+  2449us) write_op.cc:435] Acquired schema lock
0709 13:06:38.481515 (+    25us) tablet.cc:662] Decoding operations
0709 13:06:38.493620 (+ 12105us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:38.510951 (+ 17331us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:38.513924 (+  2973us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:38.537312 (+ 23388us) tablet.cc:701] Row locks acquired
0709 13:06:38.537360 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:06:38.537530 (+   170us) write_op.cc:270] Start()
0709 13:06:38.537687 (+   157us) write_op.cc:276] Timestamp: P: 1783602398537467 usec, L: 0
0709 13:06:38.537735 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:06:38.577718 (+ 39983us) log.cc:844] Serialized 980 byte log entry
0709 13:06:38.902261 (+324543us) op_driver.cc:464] REPLICATION: finished
0709 13:06:39.085472 (+183211us) write_op.cc:301] APPLY: starting
0709 13:06:39.085551 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:39.085679 (+   128us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:39.112177 (+ 26498us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:39.124919 (+ 12742us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:39.125200 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:39.125262 (+    62us) write_op.cc:312] APPLY: finished
0709 13:06:39.141778 (+ 16516us) log.cc:844] Serialized 29 byte log entry
0709 13:06:39.160794 (+ 19016us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:39.190085 (+ 29291us) write_op.cc:454] Released schema lock
0709 13:06:39.202537 (+ 12452us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:39.230243 (+ 27706us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:39.231978 (+  1735us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56720,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":125906,"apply.run_cpu_time_us":3000,"apply.run_wall_time_us":134244,"num_ops":2,"prepare.queue_time_us":193536,"prepare.run_cpu_time_us":4947,"prepare.run_wall_time_us":277153,"replication_time_us":336280,"thread_start_us":71852,"threads_started":2}]]}
I20260709 13:06:39.875488 22428 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:39.834542 23107 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:39.886751 22429 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:39.833683 23995 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:06:39.884517 22547 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:39.873064 22545 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:39.887719 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:39.902647 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:39.902702 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:39.903342 22577 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:39.904166 24007 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.909179 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:39.917392 22429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:39.928071 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:39.928717 22428 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:39.929674 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:39.888281 22474 leader_election.cc:400] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3.
W20260709 13:06:39.932914 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 45901.7us
I20260709 13:06:39.937799 22433 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:39.938966 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:39.939607 22433 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:39.825872 24116 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.946766 22500 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:39.949072 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:39.884639 24060 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.955914 22507 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:39.878029 24066 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:06:39.957471 22429 raft_consensus.cc:606] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:39.960958 22429 raft_consensus.cc:614] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:39.900511 23971 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.941430 24025 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.904685 24007 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:39.966177 22582 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.932133 24099 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.940660 23923 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.941151 23743 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.950604 24081 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:39.950951 24073 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.964088 22427 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:39.962651 23104 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:40.074450 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.975625 24025 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.972532 24060 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:40.060869 23971 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:40.082204 23743 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.096956 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:40.084890 24052 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:06:40.087571 22427 pending_rounds.cc:85] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 1
I20260709 13:06:40.079602 23923 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.096941 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:39.967738 24091 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:06:39.962841 23926 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.079466 24128 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:39.978879 24011 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.099059 24025 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.109242 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:40.097044 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:39.966604 23856 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.104754 23743 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.111313 22427 pending_rounds.cc:107] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:40.115422 22503 raft_consensus.cc:3055] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:40.126034 22427 raft_consensus.cc:2889] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.126324 22503 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:40.112594 23923 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.102725 23740 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:40.122020 23926 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.962946 24096 consensus_queue.cc:260] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.123147 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:40.144601 24060 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.145404 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:40.146919 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:40.147785 22501 raft_consensus.cc:2393] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:40.148864 24096 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.101738 24073 raft_consensus.cc:697] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:40.097288 24081 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.156313 22431 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:06:40.169097 24126 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:06:40.169399 24130 raft_consensus.cc:3055] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:40.123803 24128 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:40.171059 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 61903.4us
I20260709 13:06:40.138756 23971 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.172250 24130 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:40.153687 22503 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.159874 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:40.188202 24011 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.191910 22472 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:40.209208 24111 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.209648 24111 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.210024 24111 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.193167 24113 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:40.218847 24124 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:40.223057 22503 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.231611 24116 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.223255 22501 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.249815 24015 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:40.217085 24127 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:40.250312 24015 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:40.250676 24127 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.251362 24015 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:40.226821 24114 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.278s	user 0.001s	sys 0.001s
I20260709 13:06:40.273938 22502 raft_consensus.cc:2410] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:40.243290 24130 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.279783 24130 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.280925 23743 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.283067 23743 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:40.226423 24113 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.283777 24113 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:40.240664 24121 log.cc:927] Time spent T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:06:40.217478 24007 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.245399 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:40.290998 22503 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:40.246574 24081 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:40.249440 23960 consensus_meta.cc:287] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
W20260709 13:06:40.267037 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.306546 22430 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:40.269521 24015 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.270929 24104 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.291428 22503 pending_rounds.cc:85] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 1
I20260709 13:06:40.278564 23923 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.244902 24073 consensus_queue.cc:237] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.287181 22328 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33162 (request call id 243) took 7142 ms. Trace:
I20260709 13:06:40.289160 22545 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:40.291800 24025 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:40.305591 24110 consensus_meta.cc:287] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.004s
W20260709 13:06:40.278091 24138 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:06:40.313545 24118 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.310768 22328 rpcz_store.cc:276] 0709 13:06:33.161023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.167035 (+  6012us) service_pool.cc:224] Handling call
0709 13:06:40.287010 (+7119975us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137000,"reported_tablets":6}
I20260709 13:06:40.340421 22506 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:40.354751 22506 pending_rounds.cc:85] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 2
I20260709 13:06:40.355036 22506 pending_rounds.cc:107] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:40.355295 22506 raft_consensus.cc:2889] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.309376 22503 pending_rounds.cc:107] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:40.356323 23957 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:40.340233 24081 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.346026 22545 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:40.347357 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:40.361951 22428 raft_consensus.cc:2368] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
W20260709 13:06:40.350762 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 415747us
I20260709 13:06:40.362322 22504 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
W20260709 13:06:40.364358 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51725.2us
I20260709 13:06:40.365427 23743 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.365898 24146 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:40.366544 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:40.231683 24111 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.370077 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:40.371752 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:40.360924 22503 raft_consensus.cc:2889] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.371102 24026 consensus_queue.cc:1059] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:06:40.376943 24111 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:40.354054 24110 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.387501 23923 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:40.388302 24025 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.390077 24110 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.361136 24118 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.396030 22501 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:40.352993 24104 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.374185 23926 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.437601 22504 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.443456 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:40.409714 23960 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.450594 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 497870us
I20260709 13:06:40.451676 22433 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:40.420900 24111 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.399037 24118 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.452589 23077 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:40.420758 24130 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:40.462822 23960 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:40.150207 23987 consensus_queue.cc:1175] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:40.500522 23904 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:40.501001 23740 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.446790 24007 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.453217 23856 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.461110 23923 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.504767 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.395947 24113 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.472007 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:40.513603 24118 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.519627 23740 raft_consensus.cc:697] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:40.523495 24018 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:06:40.503808 24122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.019s	sys 0.052s
I20260709 13:06:40.468051 24111 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.474005 24130 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.520737 23923 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.516360 23904 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.532430 22501 raft_consensus.cc:2368] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3.
I20260709 13:06:40.542769 24104 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:40.543470 24130 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.543618 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:40.543915 22316 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e32ba8e6132b4f8e98a99066b6fffe05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:40.518747 24007 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.546768 24128 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:40.546901 23904 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:40.538302 24122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.019s	sys 0.053s
I20260709 13:06:40.526696 24118 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.553615 22545 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:40.548223 23740 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.556164 23923 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:40.556159 24070 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.556957 24070 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:40.557319 24070 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:40.560876 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.559470 24073 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.559888 23960 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.562503 24111 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:40.565459 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:40.566037 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:40.566742 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:40.567374 23111 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:40.525818 24018 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.553860 22503 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:40.553938 24122 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:40.564225 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:40.554955 24104 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:06:40.575192 24113 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.575811 24007 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.575132 22501 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:40.577670 24118 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.578956 22473 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:40.583698 24113 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:40.584116 24113 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.584430 24113 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.588434 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:40.586472 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:40.590111 22580 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:40.595180 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:40.596014 22429 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 2: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:40.595203 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:40.597069 22577 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:40.597254 22432 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:40.602275 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:40.602607 22432 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:40.603003 22580 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:40.617883 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:40.596155 24007 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.602327 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:40.616946 24129 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:06:40.626255 22574 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.602885 24122 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.622997 24007 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.646770 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:40.650008 24153 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:06:40.641227 24151 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 13:06:40.662468 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.668059 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:40.669332 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:40.669869 22433 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.670507 22472 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:40.654675 24070 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.665916 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:40.683001 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:40.683094 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:40.676648 24129 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.716537 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:40.691416 22580 raft_consensus.cc:2410] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:40.702009 24152 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 13:06:40.689709 22574 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:40.734190 24030 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:40.735550 22428 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
W20260709 13:06:40.709012 24155 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:06:40.680735 23960 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:40.736027 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:40.738399 22432 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:40.715706 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:40.739533 22425 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:40.678503 22433 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:40.693449 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 209) took 1027 ms. Trace:
W20260709 13:06:40.717518 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.741901 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:40.743019 22433 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
W20260709 13:06:40.711911 24157 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:06:40.748570 23076 leader_election.cc:400] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3.
I20260709 13:06:40.748991 23076 leader_election.cc:403] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.694923 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:40.741214 23113 rpcz_store.cc:276] 0709 13:06:39.665863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.666018 (+   155us) service_pool.cc:224] Handling call
0709 13:06:39.666286 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.877443 (+211157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.693210 (+815767us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54006644d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:40.693393 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368868736}
I20260709 13:06:40.740186 22429 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:40.683025 24113 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:40.757436 22546 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:40.758671 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:40.751456 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:40.703886 24007 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:40.759553 22425 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.751297 22429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:40.713315 23107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59008 (request call id 473) took 1004 ms. Trace:
I20260709 13:06:40.763293 22429 raft_consensus.cc:606] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:40.763762 22429 raft_consensus.cc:614] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:40.762717 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:40.691625 24070 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:40.773320 22432 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:40.776511 22546 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:40.777650 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 82802.6us
I20260709 13:06:40.772728 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:40.779150 22508 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.779956 22399 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:40.781002 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:40.692623 22431 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:40.787391 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:40.716368 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:40.724846 23904 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:40.705505 24127 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:40.791054 22433 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:40.791658 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:40.789304 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:40.796907 22507 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:40.797787 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:40.794337 23738 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.756983 23987 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:40.787608 24091 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.791450 23923 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.749557 23960 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.794770 24066 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.792667 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:40.795199 24070 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.761536 24104 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:06:40.801391 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:40.821000 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:40.849669 22581 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:40.821269 22574 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:40.802008 22503 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.799013 22428 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:40.812539 22432 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:40.800653 22399 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:40.808823 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:40.847224 22425 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:40.819311 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:40.817768 23923 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.819775 23106 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:40.804435 23971 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.803960 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:40.826438 24066 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.864251 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:40.856819 22578 raft_consensus.cc:2368] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:40.773419 23107 rpcz_store.cc:276] 0709 13:06:39.709223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.713160 (+  3937us) service_pool.cc:224] Handling call
0709 13:06:40.713068 (+999908us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54006e2154. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:40.713225 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262743808}
I20260709 13:06:40.841177 24070 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:40.858227 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 57730.1us
I20260709 13:06:40.866307 22582 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:40.852463 22501 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:40.818262 23987 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:40.802451 23904 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:40.871254 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 96714.3us
I20260709 13:06:40.862237 23923 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.878345 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:40.880872 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:40.863741 24080 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:40.886583 24080 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.887044 24080 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.888831 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:40.890246 22578 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:40.890317 22505 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:40.882459 22474 leader_election.cc:400] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:40.892359 22578 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:40.892820 22578 pending_rounds.cc:85] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:06:40.893049 22578 pending_rounds.cc:107] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:40.893270 22578 raft_consensus.cc:2889] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.893568 23743 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.895551 22474 leader_election.cc:403] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.866897 24066 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.871076 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:40.882259 24122 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:40.898150 24116 consensus_queue.cc:1059] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:40.898993 22574 raft_consensus.cc:2393] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:40.899214 24074 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:40.899400 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:40.900104 22500 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:40.910172 22505 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:06:40.911515 22505 pending_rounds.cc:85] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 1
I20260709 13:06:40.860812 23920 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:40.911967 22505 pending_rounds.cc:107] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:40.912304 22505 raft_consensus.cc:2889] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.884490 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:40.885218 24131 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:40.885990 23971 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.884317 22575 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:40.873783 24070 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:40.956537 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 54188.8us
I20260709 13:06:40.940630 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:40.913549 24007 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:40.958516 24007 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:40.959306 22472 leader_election.cc:400] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:40.902307 23743 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:06:40.973418 22432 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:40.959885 22582 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.962652 24113 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:40.962819 22472 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:40.964241 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:40.965767 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:40.977218 22472 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:40.980428 22472 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:40.983953 22472 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:40.986621 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:40.925071 23920 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.012466 22582 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:06:40.981307 24127 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:41.022327 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:41.027995 24111 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:41.028697 24111 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:06:41.029049 24168 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:06:40.961941 24104 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:06:40.985185 23856 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.001502 24145 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.985450 23106 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.960013 23971 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.004228 24130 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.029081 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:41.028288 24167 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:41.020880 24148 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.062726 24080 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.064252 24189 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.067013 24189 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.069267 24189 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.069957 24189 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.070405 24189 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.068244 24080 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.072254 24080 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.072340 24189 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.021066 24113 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:41.029660 24111 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.006721 24089 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:06:41.072762 24080 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.081815 24128 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:41.086097 24144 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.549s	user 0.001s	sys 0.002s
I20260709 13:06:41.062775 24127 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:41.132603 24146 raft_consensus.cc:3055] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:41.133119 24146 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:41.134001 24146 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.135279 24146 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.060051 24145 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:41.136827 24145 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.138871 24074 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.139389 24074 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.059716 23856 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:41.140916 23856 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.141523 24074 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:41.142184 22503 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:41.144163 23971 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:41.097821 24113 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:41.108673 23920 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.145326 24113 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.062458 24007 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.112434 24073 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.093943 22577 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.151194 24073 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.079344 24130 raft_consensus.cc:697] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:41.152887 24130 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.121963 23987 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:41.153486 24073 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:41.075075 23960 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.154888 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1037) took 1361 ms. Trace:
I20260709 13:06:41.155299 22424 rpcz_store.cc:276] 0709 13:06:39.793584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.793734 (+   150us) service_pool.cc:224] Handling call
0709 13:06:39.795713 (+  1979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.796081 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.796112 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.187916 (+391804us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b2c00000f48. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:06:40.188726 (+   810us) log.cc:844] Serialized 556 byte log entry
0709 13:06:40.418019 (+229293us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:40.418068 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.418157 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.085343 (+667186us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:41.154649 (+ 69306us) raft_consensus.cc:1685] finished
0709 13:06:41.154673 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.154831 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35488384,"thread_start_us":228852,"threads_started":1,"wal-append.queue_time_us":338487}
I20260709 13:06:41.132179 24127 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.092356 23923 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.115228 24128 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.161933 23738 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.162410 23738 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.162923 24128 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.163726 24091 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3.
I20260709 13:06:41.167454 22507 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:41.168067 23106 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:06:41.170334 23923 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:41.170899 24066 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.177263 22508 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:41.145967 24080 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.186137 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.186906 22508 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:41.190629 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.191607 22507 raft_consensus.cc:2410] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:41.192575 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.193432 22508 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
W20260709 13:06:41.194309 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 215332us
I20260709 13:06:41.192451 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.194404 22424 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:41.197563 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:41.198218 22433 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:41.204046 22432 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:41.184139 24176 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.236502 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:41.242111 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:41.244144 22424 raft_consensus.cc:2393] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:41.188599 23855 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
W20260709 13:06:41.253305 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 231045us
I20260709 13:06:41.254997 23076 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:41.216519 24073 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:41.267745 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:41.268410 22432 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.275112 22506 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:41.281251 24073 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.265547 24014 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:41.290874 24014 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:41.291868 24014 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.293927 24151 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.260586 24096 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.321573 22432 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:41.295895 24182 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.304687 24070 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.294502 24151 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.332583 22546 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:41.339704 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:41.251818 24176 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:41.347102 24179 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:06:41.319213 24096 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:41.356910 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.376987 22577 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:41.376889 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:41.378118 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:41.378509 22582 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 2: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:41.331705 24182 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.384510 23738 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.419195 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.419982 22506 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 1.
I20260709 13:06:41.393643 24066 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:41.375190 24088 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.011s	sys 0.007s
I20260709 13:06:41.379819 24074 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.380059 22432 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:41.354974 23923 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:41.417366 24070 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:41.334290 24104 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:41.435977 24096 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:41.437999 24182 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:41.421502 24176 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.437331 22502 raft_consensus.cc:2955] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:06:41.428228 24088 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.011s	sys 0.008s
I20260709 13:06:41.376652 23987 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:41.410768 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:41.444904 22429 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.413379 24145 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.408977 23856 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.413599 24151 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.410753 24183 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:41.429917 23738 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.431483 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:41.433771 23923 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:41.410352 24188 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:06:41.440940 22396 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:41.442798 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:41.446795 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.484078 22504 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.449345 22545 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:41.484232 22507 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
I20260709 13:06:41.452324 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:41.484458 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 43604.4us
I20260709 13:06:41.485145 22508 raft_consensus.cc:2393] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:41.467449 24183 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.484706 22506 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.468081 23107 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:41.486286 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:41.492965 22396 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:41.487110 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:41.451227 24182 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:41.483510 23923 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.483628 24176 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.444828 24074 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.497377 22396 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:41.482620 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.491134 24146 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.488204 24025 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.490558 23738 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:41.498760 23960 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.491019 24104 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:41.486745 24200 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:41.497553 24066 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.513872 22396 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:41.580279 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.602649 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 88855.8us
I20260709 13:06:41.579217 24025 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:41.603842 24025 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.604848 24183 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:41.607997 23856 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:41.610189 24202 log.cc:927] Time spent T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:06:41.612918 24025 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.614142 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:41.615041 24025 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.615510 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:41.616187 22430 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:41.598555 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:41.619361 22503 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:41.620560 24070 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:41.622879 24104 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:41.623512 24060 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.658700 24060 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.659024 24104 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.624850 24145 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.660231 24070 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.626933 24074 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:41.598500 24146 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.662377 24070 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:41.663321 22507 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:41.512892 24185 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.579525 24080 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:41.633394 24200 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.600347 23738 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.639832 24196 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:41.603173 22396 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:41.677322 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 74213.6us
I20260709 13:06:41.677502 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:41.506177 24176 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.650368 22508 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.662871 24146 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.505861 24182 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.585727 22506 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:41.597925 23960 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.650820 22503 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:41.707382 22503 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.708581 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:41.709147 22582 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.708292 22503 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.681325 24060 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:41.619259 22499 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 996) took 1525 ms (client timeout 1999 ms). Trace:
I20260709 13:06:41.682245 22430 raft_consensus.cc:2368] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:41.683969 24025 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:41.648687 24066 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.656199 22429 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
W20260709 13:06:41.683866 24208 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:06:41.692524 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:41.741537 22576 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:41.693045 24074 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:06:41.694777 24197 log.cc:927] Time spent T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.280s	user 0.002s	sys 0.001s
I20260709 13:06:41.674435 24185 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.687628 24080 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.698171 22399 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:41.749336 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:41.750311 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 52248.9us
I20260709 13:06:41.750474 22429 raft_consensus.cc:2410] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:41.697149 24081 raft_consensus.cc:2955] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:41.698854 23738 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:41.700032 24194 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.762671 24194 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.763120 24194 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.766520 24060 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:41.702419 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.767217 24060 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.768033 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.769398 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.700102 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:41.742249 24066 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.704205 24176 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.771852 24176 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:41.704576 24201 log.cc:927] Time spent T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.288s	user 0.000s	sys 0.003s
I20260709 13:06:41.773029 24018 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.713583 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:41.774488 24014 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.771376 22433 raft_consensus.cc:2955] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:06:41.775152 24195 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.359s	user 0.002s	sys 0.003s
I20260709 13:06:41.775096 24014 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.721536 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:41.722277 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:41.777204 22430 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:41.722270 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:41.721248 22499 rpcz_store.cc:269] 0709 13:06:40.094311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.096683 (+  2372us) service_pool.cc:224] Handling call
0709 13:06:41.619029 (+1522346us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400002654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:41.619196 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630214400}
I20260709 13:06:41.706533 23923 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.725898 22503 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:41.778304 22503 pending_rounds.cc:85] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 1
I20260709 13:06:41.778558 22503 pending_rounds.cc:107] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:41.764333 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:41.730772 22508 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:41.735999 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:41.779770 22424 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:06:41.706211 24200 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:41.751840 22429 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:41.785938 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.708642 23960 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.708410 24180 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.756623 23904 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:41.750710 24185 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.769615 24060 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:41.758495 22431 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.761264 24148 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:41.702132 24182 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:41.781096 22503 raft_consensus.cc:2889] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.770005 22501 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:41.787302 22505 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.790673 22429 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:41.805984 22433 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.746496 24025 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.750121 24186 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:41.758348 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:41.810637 22578 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:41.776242 24146 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:06:41.816682 22428 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:06:41.788723 22426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.006s	sys 0.031s
I20260709 13:06:41.738099 22582 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:41.810597 24130 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:41.785578 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 159095us
I20260709 13:06:41.841724 22545 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:41.842322 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 91235.9us
I20260709 13:06:41.752137 24074 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.826871 22576 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:41.818289 22508 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.824540 22574 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:41.820708 24148 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.843694 22399 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:41.875376 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.837288 22426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.007s	sys 0.031s
I20260709 13:06:41.809871 24190 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:06:41.809176 24180 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.855757 23904 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:41.854868 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.917171 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.920674 24180 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:41.921356 24074 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:41.920707 24220 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.907264 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.877234 24130 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.933735 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:41.937235 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63943.5us
I20260709 13:06:41.921753 24180 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.943570 22399 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:41.924278 23904 raft_consensus.cc:697] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:41.951570 24217 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:41.952167 24217 raft_consensus.cc:697] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:41.954715 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:41.955405 22506 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:41.873795 24186 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:41.959302 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:41.960081 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:41.961723 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:41.964128 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:41.965826 22577 raft_consensus.cc:2410] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:41.966531 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:41.967310 22582 raft_consensus.cc:2393] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:41.971017 22577 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:41.973044 22576 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:41.977936 22433 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:41.989631 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:41.963243 22501 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:41.942111 24180 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.953199 24217 consensus_queue.cc:237] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:41.974819 23733 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.999970 22576 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.002391 22576 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:42.000164 22506 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:41.985805 24219 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:41.985560 23923 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:41.985131 24080 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:42.003114 22576 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.013120 22576 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.001305 22580 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:42.016227 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 64029.3us
I20260709 13:06:42.005024 24221 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:42.038177 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 107455us
I20260709 13:06:42.039835 22576 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:42.012897 22431 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:42.040486 22576 pending_rounds.cc:85] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:06:42.046422 22576 pending_rounds.cc:107] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:42.043274 22396 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:42.040905 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:42.046739 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:42.046754 22576 raft_consensus.cc:2889] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:42.047531 22506 raft_consensus.cc:2393] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 2: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:06:42.042596 22316 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e32ba8e6132b4f8e98a99066b6fffe05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:42.048458 22576 raft_consensus.cc:3055] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.049732 22580 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:42.050228 24218 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:06:42.019584 24025 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:42.025266 24146 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.006903 23733 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.048864 22576 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:42.057657 22576 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.058703 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:42.058962 22576 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.062227 24226 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:42.062510 24233 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:42.062808 22506 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:42.062858 24226 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.063141 24233 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.065512 24233 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:42.065785 24226 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:42.066388 24226 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:42.066885 24226 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.068971 24226 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:42.059399 24025 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:42.072001 22546 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:42.013655 24219 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.058151 24074 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:42.056380 24223 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:42.015231 23904 consensus_queue.cc:237] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.078908 24104 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:42.070047 24025 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:42.100096 24209 log.cc:927] Time spent T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.441s	user 0.001s	sys 0.001s
I20260709 13:06:42.102325 24194 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.057385 24239 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:06:42.057579 24146 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.104707 24180 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.077729 24060 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:42.096807 24223 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.138605 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:42.139173 24130 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.142231 24194 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:42.143483 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 71564.9us
I20260709 13:06:42.099514 24104 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.151369 24187 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:42.156297 22576 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:42.172681 22576 pending_rounds.cc:85] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 2
I20260709 13:06:42.157248 22472 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:42.174117 22472 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:42.165406 23733 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:42.165920 24186 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.172986 22576 pending_rounds.cc:107] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:42.180018 22576 raft_consensus.cc:2889] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:42.148334 23743 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:42.177040 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.181173 22472 leader_election.cc:400] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:42.184602 22472 leader_election.cc:403] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:42.183676 22579 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
W20260709 13:06:42.185870 22579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 1875) took 1379 ms (client timeout 1520 ms). Trace:
I20260709 13:06:42.185940 22472 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:42.166875 24185 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:42.186458 22579 rpcz_store.cc:269] 0709 13:06:40.806837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.806964 (+   127us) service_pool.cc:224] Handling call
0709 13:06:42.176867 (+1369903us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:42.185802 (+  8935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3830144}
I20260709 13:06:42.173368 24104 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.190140 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:42.192930 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:42.192431 22507 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:42.179486 24130 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.196503 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:42.197273 22507 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:42.188988 24200 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:42.045580 24221 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.182250 24096 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:42.188890 24007 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:42.188864 23855 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:42.204870 24234 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:42.190802 24122 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:42.208189 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.209002 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:42.217298 22396 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:42.217599 22506 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:42.208036 24200 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.210405 24230 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.210690 23111 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:42.211273 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.199656 23920 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.189543 23743 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.213502 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:42.223732 22507 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:42.215243 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:42.220721 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.224794 24178 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.231004 24178 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:42.231429 24178 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.231491 24185 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.225312 24066 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.194859 23923 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:06:42.216280 24096 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:42.246287 23743 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:42.246417 24066 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:42.182171 24025 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.248067 23855 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:42.249089 24146 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.260414 24223 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:42.230481 24219 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.232385 22431 raft_consensus.cc:2368] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3.
I20260709 13:06:42.232174 23960 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.212424 24148 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.257305 24226 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:42.261960 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:42.221487 24194 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:06:42.264637 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.270815 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.186044 24187 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.232795 24230 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.271477 22581 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
W20260709 13:06:42.273923 22581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 1881) took 1423 ms (client timeout 1884 ms). Trace:
I20260709 13:06:42.266417 24221 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.277416 22433 raft_consensus.cc:2393] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:42.272037 24226 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.282850 24226 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.285043 22396 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:42.286566 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:42.274294 22581 rpcz_store.cc:269] 0709 13:06:40.851439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.852126 (+   687us) service_pool.cc:224] Handling call
0709 13:06:42.270666 (+1418540us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:42.273861 (+  3195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8110464}
I20260709 13:06:42.264912 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 1880) took 1437 ms. Trace:
I20260709 13:06:42.279551 24230 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.310528 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.288617 23957 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.289171 24194 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:42.301682 24073 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:42.301299 24148 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.303537 24033 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:42.321115 24104 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.327922 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:42.333161 22504 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:42.323891 24194 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:42.337158 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 279446us
I20260709 13:06:42.322891 23957 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:42.367290 22396 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:42.360930 24213 log.cc:927] Time spent T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:06:42.299094 22575 rpcz_store.cc:276] 0709 13:06:40.826827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.828141 (+  1314us) service_pool.cc:224] Handling call
0709 13:06:40.858766 (+ 30625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.956803 (+ 98037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.253401 (+1296598us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b54001cd9d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:42.263851 (+ 10450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52589184}
W20260709 13:06:42.341562 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 305925us
I20260709 13:06:42.360380 24194 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.361325 23957 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.380993 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:42.381736 22504 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.333362 24033 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.373751 24185 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:42.385921 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 215567us
I20260709 13:06:42.330996 24096 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.384291 24187 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:42.391297 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:42.368571 24145 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:06:42.383496 24190 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:42.383286 24196 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:42.368616 24234 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:06:42.386164 24185 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:42.413048 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.425082 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.418944 22504 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:42.432550 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.433565 22581 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:42.433897 22396 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:42.436712 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 268058us
I20260709 13:06:42.437067 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.437472 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.437760 22579 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:42.438171 22576 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:42.439987 22474 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:42.392176 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:42.435217 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.450246 22581 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:42.451627 23076 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:42.412544 24223 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.465291 23077 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:42.464722 22474 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:42.375690 24241 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:06:42.432089 24185 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.473989 24151 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.411974 24243 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:06:42.469416 24223 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:42.490022 24223 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.490908 24243 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:42.491456 24243 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.491848 24243 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.480710 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:42.495620 22504 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:06:42.501657 24237 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:06:42.412179 24146 consensus_queue.cc:1059] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:06:42.508713 24242 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.476387 22398 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.4:42955 timed out after 1.777s (SENT) [suppressed 7 similar messages]
I20260709 13:06:42.459020 24074 raft_consensus.cc:697] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:42.493623 23107 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:42.474123 24189 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:42.459133 24232 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:42.474784 24226 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:42.525192 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:42.526109 23108 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEARNER]: Advancing to term 4
I20260709 13:06:42.497313 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.430399 24190 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.489075 24245 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.425987 24196 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:42.583127 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 110565us
I20260709 13:06:42.515846 24234 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:42.571487 24145 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.571344 24104 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:42.512462 24151 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:06:42.578074 24186 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:42.577749 24146 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:42.589011 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.587604 22575 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:42.626591 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.627436 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.580964 24226 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.627951 24219 raft_consensus.cc:3055] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.584744 24073 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.577721 24189 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.679919 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:42.623229 24145 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:42.680986 23112 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
W20260709 13:06:42.688432 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 212057us
I20260709 13:06:42.591135 24232 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:42.628422 24245 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.695463 22504 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
W20260709 13:06:42.684420 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.509387 24242 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.695649 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:42.703825 23111 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.619374 24234 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.706049 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:42.691864 24033 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.693987 24219 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:42.720135 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:42.697240 24073 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.698949 24145 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.729630 22504 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:42.729787 23111 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:42.688236 24146 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:42.730613 24244 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 13:06:42.802896 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 339331us
I20260709 13:06:42.806003 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.806416 22474 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:42.806708 23112 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:42.697496 24074 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.813205 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:42.814425 22581 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:42.801867 24241 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:42.828329 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.842290 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.728739 24232 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.818728 24261 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:42.808081 24219 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:42.844695 23920 consensus_meta.cc:287] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.612s	user 0.000s	sys 0.010s
I20260709 13:06:42.852087 22574 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:06:42.852664 24178 consensus_meta.cc:287] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.005s
I20260709 13:06:42.851485 24189 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:42.827536 24241 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.860975 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.861430 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.854434 24261 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.873956 23108 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:42.860256 23920 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.847203 24269 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:42.857168 24226 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.875861 23108 pending_rounds.cc:85] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 2
I20260709 13:06:42.889127 23108 pending_rounds.cc:107] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:42.889428 23108 raft_consensus.cc:2889] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:42.890712 22506 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.877424 24219 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.880719 24257 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.876969 24261 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.881515 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.868027 24178 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:42.849434 24243 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.896677 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.907859 23108 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:42.909802 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1145) took 1197 ms. Trace:
I20260709 13:06:42.910238 22578 rpcz_store.cc:276] 0709 13:06:41.712727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.712872 (+   145us) service_pool.cc:224] Handling call
0709 13:06:42.909617 (+1196745us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b540028b754. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:42.909746 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74858880}
I20260709 13:06:42.890800 24269 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:42.906580 24245 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:42.906972 24146 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:42.907805 24257 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:42.917418 22506 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:42.918452 24257 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.911809 22575 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:42.921612 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:42.917295 24230 consensus_meta.cc:287] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.005s
I20260709 13:06:42.928231 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 140) took 1957 ms. Trace:
I20260709 13:06:42.928799 22427 rpcz_store.cc:276] 0709 13:06:40.970847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.970977 (+   130us) service_pool.cc:224] Handling call
0709 13:06:40.971376 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:41.244303 (+272927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.255991 (+ 11688us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:42.103931 (+847940us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b2c00000f48. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:06:42.104619 (+   688us) log.cc:844] Serialized 52 byte log entry
0709 13:06:42.451081 (+346462us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.566177 (+115096us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.583001 (+ 16824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.610543 (+ 27542us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.927811 (+317268us) raft_consensus.cc:1685] finished
0709 13:06:42.927914 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.928153 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39670,"prepare.queue_time_us":121496,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":90703,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":20489,"spinlock_wait_cycles":85720960,"thread_start_us":623468,"threads_started":3,"wal-append.queue_time_us":720861}
I20260709 13:06:42.931445 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:42.934330 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:42.935256 22427 raft_consensus.cc:2410] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:42.944011 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.944361 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.946247 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.937321 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:42.954316 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.954699 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:42.956118 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:42.957093 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.957274 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:42.954208 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.958316 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.960103 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.958469 24223 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.967897 24234 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.958323 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:42.968884 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:42.969877 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:42.971237 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:42.972813 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:42.923403 24230 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.936086 24269 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.979925 24178 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:42.980408 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 1857) took 2354 ms. Trace:
W20260709 13:06:42.980605 24194 consensus_meta.cc:287] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
I20260709 13:06:42.981734 22576 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.980998 24194 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.980849 22426 rpcz_store.cc:276] 0709 13:06:40.625492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.626494 (+  1002us) service_pool.cc:224] Handling call
0709 13:06:40.744439 (+117945us) spinlock_profiling.cc:243] Waited 979 us on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:40.777421 (+ 32982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.860942 (+ 83521us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:40.878405 (+ 17463us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.606853 (+728448us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f0069d180ac 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b
0709 13:06:42.179434 (+572581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.184606 (+  5172us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:42.184654 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.281260 (+ 96606us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b18003b0b60. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d032a6 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1
0709 13:06:42.282528 (+  1268us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b18003b0b60. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:06:42.980129 (+697601us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b540003c354. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:42.980183 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.980326 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13503,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":44520,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":1964,"spinlock_wait_cycles":189490176,"thread_start_us":1263119,"threads_started":2,"wal-append.queue_time_us":1002313}
I20260709 13:06:42.981606 24223 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:42.987761 22500 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:06:42.988401 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:42.989545 22426 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.975208 24185 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:42.992641 24243 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:42.987591 23957 consensus_meta.cc:287] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.001s
I20260709 13:06:43.012773 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1021) took 1565 ms. Trace:
I20260709 13:06:43.005108 22427 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:43.003211 23957 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.014385 22500 rpcz_store.cc:276] 0709 13:06:41.441501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.444181 (+  2680us) service_pool.cc:224] Handling call
0709 13:06:42.987190 (+1543009us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfde9c 00007f0069cfda5b 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:42.987454 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.988318 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.006579 (+ 18261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26208640}
I20260709 13:06:43.016711 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:43.017601 22500 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.021936 24185 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.023432 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 146) took 1608 ms. Trace:
I20260709 13:06:43.033236 22430 rpcz_store.cc:276] 0709 13:06:41.414992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.785221 (+370229us) service_pool.cc:224] Handling call
0709 13:06:41.813735 (+ 28514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.857617 (+ 43882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.857652 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.857710 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.857744 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.023143 (+1165399us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b540043ab54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:43.023196 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.023356 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100418304}
I20260709 13:06:43.036091 24194 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.037364 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 149) took 1066 ms. Trace:
I20260709 13:06:43.037782 22428 rpcz_store.cc:276] 0709 13:06:41.971847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.973274 (+  1427us) service_pool.cc:224] Handling call
0709 13:06:43.036665 (+1063391us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:43.036852 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.037028 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.037054 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.037109 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:43.037138 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.037193 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.037304 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19112704}
I20260709 13:06:43.028206 22500 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:43.055954 22428 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:43.057380 22428 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:43.057452 22500 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.063053 24073 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:43.069787 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.072772 24129 raft_consensus.cc:3055] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:43.081540 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1056) took 1889 ms. Trace:
I20260709 13:06:43.085963 22432 rpcz_store.cc:276] 0709 13:06:41.191674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.333272 (+141598us) service_pool.cc:224] Handling call
0709 13:06:43.081324 (+1748052us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b54000d6e54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:43.081436 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91111296}
W20260709 13:06:43.082064 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.084707 24230 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.089545 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 189) took 1296 ms. Trace:
I20260709 13:06:43.090054 22499 rpcz_store.cc:276] 0709 13:06:41.793531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.020599 (+227068us) service_pool.cc:224] Handling call
0709 13:06:42.070115 (+ 49516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.189281 (+119166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.190866 (+  1585us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.194888 (+  4022us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.200019 (+  5131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.089326 (+889307us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000ff0d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:43.089376 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.089487 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238718336}
I20260709 13:06:43.086647 23957 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.086956 24145 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.094696 24200 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.096180 24145 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.096697 22500 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.090996 24257 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.085827 24129 raft_consensus.cc:740] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:43.088109 24014 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.104523 23856 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:43.105074 23856 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:43.105707 24257 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:43.104678 24207 log.cc:927] Time spent T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.446s	user 0.001s	sys 0.005s
I20260709 13:06:43.108091 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:43.100322 24129 consensus_queue.cc:260] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.108822 23987 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:43.109427 23987 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.111709 23987 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.109378 24129 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.086483 22426 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:43.117479 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:43.114758 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.118590 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.124563 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.126226 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:43.129328 22545 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:43.133034 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 1900) took 1156 ms. Trace:
I20260709 13:06:43.133642 23987 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.133533 22577 rpcz_store.cc:276] 0709 13:06:41.976268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.976443 (+   175us) service_pool.cc:224] Handling call
0709 13:06:43.046080 (+1069637us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:43.046270 (+   190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.049753 (+  3483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.049783 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.054196 (+  4413us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.073678 (+ 19482us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:43.073717 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.073780 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.132709 (+ 58929us) raft_consensus.cc:1685] finished
0709 13:06:43.132730 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.132966 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3221,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":17103,"spinlock_wait_cycles":21385472,"thread_start_us":18468,"threads_started":1,"wal-append.queue_time_us":62993}
I20260709 13:06:43.134653 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.135443 22499 raft_consensus.cc:2393] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:43.136392 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.137506 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.137684 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1067) took 1135 ms. Trace:
I20260709 13:06:43.138232 22499 raft_consensus.cc:2393] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:43.138531 22427 rpcz_store.cc:276] 0709 13:06:42.002341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.970944 (+968603us) service_pool.cc:224] Handling call
0709 13:06:43.137440 (+166496us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b540043d854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:43.137614 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62588160}
I20260709 13:06:43.139079 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1022) took 1697 ms. Trace:
I20260709 13:06:43.139460 22503 rpcz_store.cc:276] 0709 13:06:41.441841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.444124 (+  2283us) service_pool.cc:224] Handling call
0709 13:06:41.619203 (+175079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.817814 (+198611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.138881 (+1321067us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400002650. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:43.139024 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340255488}
I20260709 13:06:43.140281 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.140617 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:43.143504 24224 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 1.157s	user 0.005s	sys 0.000s
I20260709 13:06:43.145011 24200 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.145483 24200 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:43.146675 22545 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:43.146905 22503 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:43.105875 23856 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:43.152683 22547 connection.cc:256] RPC call timeout handler was delayed by -1.0437638639999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:06:43.145828 24200 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.153368 24074 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.161195 24074 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.161571 24074 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.163576 22547 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.141242 23987 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.163527 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.139103 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:43.190318 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.152415 24249 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:43.195828 22547 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:43.153415 24223 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:43.201663 22545 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.164912 24096 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:43.187379 23987 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.187603 24250 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.192106 23856 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.186002 24073 consensus_queue.cc:1059] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:43.195572 24081 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.156508 24245 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:06:43.238679 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.245952 22429 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:06:43.246515 22429 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34614 (request call id 150) took 1270 ms (client timeout 1680 ms). Trace:
W20260709 13:06:43.246919 22429 rpcz_store.cc:269] 0709 13:06:41.976090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.976255 (+   165us) service_pool.cc:224] Handling call
0709 13:06:43.238499 (+1262244us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:43.246436 (+  7937us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12593024}
I20260709 13:06:43.152237 24199 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:06:43.209117 24266 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:43.201763 24264 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:43.248858 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.209587 24219 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:43.235335 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1059) took 1553 ms. Trace:
I20260709 13:06:43.255465 24219 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:43.257360 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 55806.4us
I20260709 13:06:43.208988 24223 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.259347 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.232739 24096 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.249593 24250 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:43.192643 24246 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:06:43.265681 22545 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.201984 24249 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:43.267622 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 69440.5us
I20260709 13:06:43.262712 24245 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.259822 24081 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.247010 24261 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.273699 22547 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:43.272318 24264 raft_consensus.cc:3055] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:43.281404 22547 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.281636 24288 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.282437 24249 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.283134 24249 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:43.285228 24249 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.285925 24249 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.286403 24249 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.258250 24266 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.291203 23108 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:43.275446 24245 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:43.288600 24249 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.292960 24287 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.279774 24241 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.271544 24250 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.255432 22502 rpcz_store.cc:276] 0709 13:06:41.680389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.830978 (+150589us) service_pool.cc:224] Handling call
0709 13:06:41.884432 (+ 53454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.913586 (+ 29154us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:41.942843 (+ 29257us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.155993 (+1213150us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b180020c0e0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f006ce1a060 00007f006ce2c716 00007f006ce3d287 00007f006ce3d208
0709 13:06:43.192434 (+ 36441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.196315 (+  3881us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:43.208887 (+ 12572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.230941 (+ 22054us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.233980 (+  3039us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65600,"prepare.queue_time_us":19758,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":60,"raft.queue_time_us":87584,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":6850,"spinlock_wait_cycles":22226304,"thread_start_us":32116,"threads_started":1}
I20260709 13:06:43.289742 24264 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:43.290855 24187 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.299371 24245 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.328155 24266 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.293316 24289 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:43.349409 22431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1071) took 1310 ms (client timeout 1596 ms). Trace:
W20260709 13:06:43.349844 22431 rpcz_store.cc:269] 0709 13:06:42.038853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.084176 (+ 45323us) service_pool.cc:224] Handling call
0709 13:06:43.346136 (+1261960us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54001e64d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:43.349344 (+  3208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85949824}
I20260709 13:06:43.348686 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.364209 24096 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.365229 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.367506 22508 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.369216 24033 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.369958 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1066) took 1165 ms. Trace:
I20260709 13:06:43.370486 24189 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:06:43.371266 24252 log.cc:927] Time spent T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.660s	user 0.000s	sys 0.001s
I20260709 13:06:43.377737 24185 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.357252 24219 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.378249 24288 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.379639 24242 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.381852 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.351699 24249 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:43.383847 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 185) took 1591 ms. Trace:
I20260709 13:06:43.398725 22508 rpcz_store.cc:276] 0709 13:06:41.792596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.847120 (+ 54524us) service_pool.cc:224] Handling call
0709 13:06:43.367164 (+1520044us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfde9c 00007f0069cfda5b 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:43.367327 (+   163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.383597 (+ 16270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.383785 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15603968}
I20260709 13:06:43.400014 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.400844 22508 raft_consensus.cc:2410] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:43.384066 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.404439 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.405483 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.406028 22432 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:43.406780 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.407276 22432 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:43.407989 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.365095 24250 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.384935 22504 rpcz_store.cc:276] 0709 13:06:42.204462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.705737 (+501275us) service_pool.cc:224] Handling call
0709 13:06:43.369797 (+664060us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54003d86d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:43.369903 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49641728}
W20260709 13:06:43.385699 22316 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e32ba8e6132b4f8e98a99066b6fffe05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:43.387130 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.410051 22432 raft_consensus.cc:2410] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:43.410197 22503 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:43.410918 24261 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.411340 24074 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.395723 24185 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.413602 24185 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.395937 24096 consensus_queue.cc:1059] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:06:43.414934 24096 raft_consensus.cc:3055] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:43.415277 24096 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:43.377992 23738 raft_consensus.cc:1064] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
W20260709 13:06:43.391894 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 110572us
I20260709 13:06:43.352690 24289 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.421897 22432 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:43.395944 22428 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:43.396399 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.421427 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.422853 23108 raft_consensus.cc:2368] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:43.397229 23904 consensus_queue.cc:1059] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:43.393362 24189 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.395223 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.424289 22473 leader_election.cc:400] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:43.424611 22473 leader_election.cc:403] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:43.362874 23987 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.420776 22547 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.390247 24033 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.397433 24223 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.428608 22546 leader_election.cc:400] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3.
I20260709 13:06:43.413589 24190 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.416834 24176 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:43.431373 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.429786 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.432176 22546 leader_election.cc:403] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:43.433858 22432 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:43.416064 24096 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.425906 24178 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:43.426167 24180 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:43.427248 24185 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:06:43.444782 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.428095 24129 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.436642 24287 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:43.421540 24249 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.465596 24249 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.465766 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:43.466355 22577 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.468032 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:43.469082 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:43.469971 22582 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:43.466609 22579 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:43.451395 23738 consensus_queue.cc:237] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.452566 23105 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:43.448185 24180 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.431222 24200 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.456687 24185 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.457302 24096 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:43.458550 22506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1069) took 1253 ms (client timeout 1545 ms). Trace:
I20260709 13:06:43.460101 22502 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:43.460918 24192 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.462284 24289 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.436848 24250 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.426548 24070 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:06:43.467257 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:43.472047 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 43605.7us
I20260709 13:06:43.471112 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:43.478111 22506 rpcz_store.cc:269] 0709 13:06:42.205560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.244605 (+ 39045us) service_pool.cc:224] Handling call
0709 13:06:43.458377 (+1213772us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400176bd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:43.458490 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437604224}
I20260709 13:06:43.480909 22581 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:43.463132 23960 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.466575 24081 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.479782 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:43.475828 24287 raft_consensus.cc:697] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:43.483156 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.473892 23743 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.487809 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:43.441318 24176 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.494915 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:43.480541 24074 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.449468 24178 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:43.503140 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:43.504060 22432 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:43.474599 23904 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:43.484184 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:43.506177 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:43.507726 22581 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:43.501387 24190 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.510143 24190 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.511137 24176 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.512929 24287 consensus_queue.cc:237] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.495738 23105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 215) took 1070 ms. Trace:
I20260709 13:06:43.512197 24190 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.484278 24192 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.490192 24245 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.535158 24033 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.538018 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1066) took 1546 ms. Trace:
I20260709 13:06:43.538452 22430 rpcz_store.cc:276] 0709 13:06:41.991563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.035774 (+1044211us) service_pool.cc:224] Handling call
0709 13:06:43.036182 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.378785 (+342603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.378817 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.379347 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.431170 (+ 51823us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:43.431210 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.431272 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.537771 (+106499us) raft_consensus.cc:1685] finished
0709 13:06:43.537792 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.537950 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":342218,"raft.queue_time_us":343418,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":51444,"threads_started":1,"wal-append.queue_time_us":103085}
I20260709 13:06:43.537350 24129 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4.
I20260709 13:06:43.546542 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 147) took 2127 ms. Trace:
I20260709 13:06:43.547201 22424 rpcz_store.cc:276] 0709 13:06:41.418924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.786517 (+367593us) service_pool.cc:224] Handling call
0709 13:06:41.786784 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.788702 (+  1918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.788730 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.788770 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.788797 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.546170 (+1757373us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b540043c454. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:43.546226 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.546389 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4022016}
I20260709 13:06:43.549513 24178 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.530089 24073 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.519763 23105 rpcz_store.cc:276] 0709 13:06:42.425653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.506014 (+ 80361us) service_pool.cc:224] Handling call
0709 13:06:43.452025 (+946011us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:43.452259 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.476522 (+ 24263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.490988 (+ 14466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8473344}
I20260709 13:06:43.554015 24200 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.555351 24180 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.556180 23987 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.562703 24245 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.564795 24189 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.566596 23743 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3.
I20260709 13:06:43.570596 22505 raft_consensus.cc:2393] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:43.574409 22396 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:43.551855 24073 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:43.579523 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.581715 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.585592 22503 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.586066 22506 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:43.584430 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:43.588276 22505 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.587973 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.590425 22504 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:43.590867 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:43.592753 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:43.596174 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:43.587951 24129 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:43.597806 24129 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:43.599651 22505 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:43.600024 24129 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.570582 24186 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.603439 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:43.604305 22508 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.605036 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1064) took 1638 ms. Trace:
I20260709 13:06:43.580994 24180 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:43.608868 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:43.618316 24180 raft_consensus.cc:697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:43.580834 24190 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.616345 22396 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:43.619207 24180 consensus_queue.cc:237] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.619170 24190 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.621032 22396 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:43.617949 22503 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:43.617571 22508 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:43.581121 24178 consensus_queue.cc:1059] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:06:43.603466 24186 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:43.641997 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 60642us
I20260709 13:06:43.620913 22425 rpcz_store.cc:276] 0709 13:06:41.966827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.967730 (+   903us) service_pool.cc:224] Handling call
0709 13:06:43.237052 (+1269322us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:43.237295 (+   243us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:43.380537 (+143242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.380566 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:43.381098 (+   532us) log.cc:844] Serialized 52 byte log entry
0709 13:06:43.505056 (+123958us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:43.602071 (+ 97015us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.604575 (+  2504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.604723 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.604765 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:43.604838 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.604981 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144865,"raft.queue_time_us":146884,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9574,"spinlock_wait_cycles":24927360,"thread_start_us":199903,"threads_started":2,"wal-append.queue_time_us":156866}
I20260709 13:06:43.646770 24073 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.605582 24176 consensus_queue.cc:1059] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 13:06:43.647279 24238 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 1.262s	user 0.004s	sys 0.000s
I20260709 13:06:43.648025 24007 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:43.648551 24007 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.640317 23960 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:43.653421 24176 raft_consensus.cc:3055] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:43.653827 24176 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:43.654628 24176 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.655620 24176 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.658547 24199 raft_consensus.cc:3055] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:43.659009 24199 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:43.660964 24288 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:43.661387 24288 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:43.662138 24288 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.663335 24288 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.665161 24190 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.667915 24196 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:43.659792 24199 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.671306 24199 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.669552 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.682777 23923 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.684279 23923 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:43.686832 24276 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.682s	user 0.002s	sys 0.001s
I20260709 13:06:43.688350 24186 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.691615 24186 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:43.692335 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 50579.1us
I20260709 13:06:43.695173 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:43.692444 24033 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:43.696547 22396 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:43.696684 23923 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.697271 24182 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.697747 24182 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:43.697642 24088 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:43.698169 24182 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.697326 24033 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:43.699445 24033 raft_consensus.cc:697] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:43.683068 24232 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.700748 24033 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.702428 24232 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:43.702890 24232 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.706440 22578 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:43.707772 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:43.708971 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:43.709733 22579 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:43.711352 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:43.717590 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:43.719318 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.720806 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.721451 22508 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:43.722251 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.727861 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.730762 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.731439 22508 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:43.732779 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.733412 22546 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.719937 23113 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:43.734717 22546 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:43.735612 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.739733 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.740620 22508 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:43.732652 22575 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:43.741910 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.742410 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.743429 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:43.746071 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.747584 22547 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:43.748447 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:43.724280 23111 raft_consensus.cc:2955] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:43.752130 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:06:43.712879 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 70134.2us
I20260709 13:06:43.737092 23960 raft_consensus.cc:697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:43.742326 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.756354 23960 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.757131 23109 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:43.758977 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:43.760725 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:43.763150 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.738191 23957 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:43.768040 22546 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.753567 24290 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:43.773816 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.775405 23957 raft_consensus.cc:697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:43.775970 23743 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.737579 24148 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:06:43.776719 24073 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:43.777614 23106 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:43.777844 22546 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.764101 24096 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.779805 24182 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:43.754628 24287 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:43.782780 24007 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:43.791302 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 152001us
I20260709 13:06:43.792846 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.767223 24288 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.772128 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.770128 24245 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.766678 23987 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.797011 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.806190 22398 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:43.805735 22396 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:43.808823 22505 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:43.793700 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:43.787715 24232 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.802309 23743 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.850941 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:43.851809 22577 raft_consensus.cc:2393] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:43.801155 24288 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:06:43.854015 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 47906.8us
I20260709 13:06:43.841286 23105 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:43.851140 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:43.856204 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.857587 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51934.7us
I20260709 13:06:43.843456 23923 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.808091 24245 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:43.860288 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:43.896152 24182 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:43.799989 24096 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.897779 22582 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:43.800882 24287 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.854197 23743 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:06:43.969023 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.902061 22396 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:43.902599 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1065) took 1921 ms. Trace:
I20260709 13:06:43.858752 22398 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:43.846174 24268 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 13:06:43.990368 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 131707us
I20260709 13:06:43.989883 22433 rpcz_store.cc:276] 0709 13:06:41.981372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.988955 (+  7583us) service_pool.cc:224] Handling call
0709 13:06:43.902361 (+1913406us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54002981d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:43.902531 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659598208}
I20260709 13:06:43.998059 24287 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:43.862948 24176 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.992319 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:43.992156 23112 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:44.010903 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:44.011665 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 195) took 1184 ms. Trace:
I20260709 13:06:44.012236 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:43.896835 24116 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.013532 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:44.010505 24176 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:43.993801 24245 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.860445 24288 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.013123 22578 raft_consensus.cc:2410] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:43.841620 23957 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.014089 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:44.013965 24116 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:43.993548 24226 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.012212 22500 rpcz_store.cc:276] 0709 13:06:42.827614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.242240 (+414626us) service_pool.cc:224] Handling call
0709 13:06:43.257512 (+ 15272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.275553 (+ 18041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.277018 (+  1465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.279349 (+  2331us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:43.280440 (+  1091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.011407 (+730967us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54004268d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:44.011460 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.011601 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27787008}
I20260709 13:06:44.043313 22575 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:44.038918 24176 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:43.989976 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 88018.2us
I20260709 13:06:44.096732 22396 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:44.097381 22399 connection.cc:256] RPC call timeout handler was delayed by -1.227348308000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 13:06:44.098075 22399 connection.cc:256] RPC call timeout handler was delayed by -1.0716483080000216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:06:44.043881 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:44.100693 22578 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.029021 24304 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.997968 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:44.110067 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:43.861882 24178 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.118247 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:44.120136 23079 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:44.111657 22429 raft_consensus.cc:2393] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:06:44.029955 24311 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:06:44.105543 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:44.031127 24308 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:06:44.114995 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.015435 23738 raft_consensus.cc:3055] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:44.028723 24148 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.117722 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.096961 24130 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:44.054791 23743 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.125207 22505 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.096894 24226 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:44.115716 24190 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:44.126893 24096 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:44.130383 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:44.123381 24033 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:44.050495 24192 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:44.131246 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:44.131393 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:44.117856 23841 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.131960 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:44.171084 22506 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:44.139387 23738 raft_consensus.cc:740] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:44.178947 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:44.134361 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:44.130607 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:44.187090 22504 raft_consensus.cc:2368] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4.
I20260709 13:06:44.187394 22505 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:44.129165 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:44.188359 22507 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:44.123099 24122 consensus_queue.cc:1059] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:44.123575 22425 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:44.116627 22574 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.151117 22578 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:44.153061 22474 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:44.126592 22545 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:44.133141 22500 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:06:44.194394 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 67890.8us
I20260709 13:06:44.118800 24178 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.133086 24185 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:44.176204 22428 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:44.176756 22582 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:44.141424 24148 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:44.144835 24232 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:44.157265 24130 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:44.185593 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:44.126168 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.109970 22573 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.189399 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:44.136207 24183 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:06:44.160387 24015 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:44.161993 24231 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.197106 22545 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:44.197665 24200 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:44.241072 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 44053.2us
I20260709 13:06:44.242314 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:44.177776 24033 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.215252 24148 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.217077 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:44.221078 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:44.224673 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:44.307096 22582 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:44.233888 22505 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:44.221804 22501 raft_consensus.cc:2393] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:44.234632 23738 consensus_queue.cc:260] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:44.212397 24096 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
W20260709 13:06:44.235831 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.238879 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:44.243340 22545 leader_election.cc:400] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4.
I20260709 13:06:44.325397 22545 leader_election.cc:403] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:06:44.326273 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 83076.8us
I20260709 13:06:44.327174 22545 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:44.251848 24196 raft_consensus.cc:3055] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:44.331563 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:44.244649 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 91678.7us
I20260709 13:06:44.244228 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:44.246896 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:44.333985 22578 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:44.334147 23111 raft_consensus.cc:2410] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:44.248399 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:44.170504 24190 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.208006 24178 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.176131 23841 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:44.347208 23841 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.347541 23738 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.244200 24015 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.351521 24015 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:44.333892 24066 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.333606 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:44.353410 24129 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.353811 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:44.354636 22576 raft_consensus.cc:2368] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5.
I20260709 13:06:44.321962 24220 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:06:44.354908 23841 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.355525 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:44.313176 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 56152.1us
W20260709 13:06:44.318423 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 101426us
I20260709 13:06:44.353402 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:44.358001 22398 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:44.360030 22396 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:44.361953 22546 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:44.195737 22580 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.323426 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:44.135305 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:44.371497 22582 raft_consensus.cc:2410] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:44.196548 24288 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:44.305085 23923 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.344751 23987 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:44.335474 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:44.358145 22506 raft_consensus.cc:2410] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:44.353892 24129 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:44.377034 22503 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:44.326973 24232 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.379925 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:44.390301 22578 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:06:44.390631 22579 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:44.332031 24196 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:44.370124 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:44.372711 24199 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:06:44.378046 23923 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:44.395501 23923 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.383426 23987 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:44.403726 23987 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:44.383255 24182 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.320221 22505 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.375840 24220 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:06:44.409423 24130 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:44.379212 24066 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.391289 24129 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.387964 22581 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:44.394550 24196 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:44.378269 22426 raft_consensus.cc:1240] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:44.376194 24192 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:44.418323 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:44.382929 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:44.417454 22545 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:44.432453 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:44.430085 22581 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:44.436141 22580 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:44.437180 22503 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.438434 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:44.441449 22505 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:44.434756 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:44.452224 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 373088us
I20260709 13:06:44.374470 24287 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:06:44.461243 22545 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:44.379797 22575 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
W20260709 13:06:44.490556 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 390336us
W20260709 13:06:44.464532 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.485353 22576 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.419267 24033 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:44.439929 24015 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.441931 24096 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.442353 24200 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4.
I20260709 13:06:44.481865 24192 raft_consensus.cc:697] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:44.493188 24290 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.514231 24196 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.462049 23987 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.549180 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:44.483017 24232 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:44.481020 24231 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:06:44.517648 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 343936us
I20260709 13:06:44.491679 24194 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:06:44.517148 24081 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:06:44.517310 24151 consensus_queue.cc:1059] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:06:44.551525 24096 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 13:06:44.578294 24314 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:06:44.578001 24192 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:44.569905 24217 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.583869 24232 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.587543 22399 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:44.522804 24015 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.521436 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.617678 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:44.618474 22577 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
W20260709 13:06:44.605373 24245 consensus_meta.cc:287] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.003s
I20260709 13:06:44.628458 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.648095 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.649017 22430 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:44.649945 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.650528 22430 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:44.651363 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.582881 23743 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:44.653805 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.615005 24033 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.662910 22430 raft_consensus.cc:2410] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:06:44.663417 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 330078us
I20260709 13:06:44.672204 22474 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:44.615203 24217 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:44.681205 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.628216 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.633432 24325 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:44.628599 22427 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:44.682160 22430 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
W20260709 13:06:44.729954 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 57858.1us
W20260709 13:06:44.734094 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 242586us
W20260709 13:06:44.747298 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.616854 24178 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.772751 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:44.774042 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.777915 22474 leader_election.cc:400] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5.
I20260709 13:06:44.778271 22474 leader_election.cc:403] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:44.677103 24217 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.789871 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:44.731717 24316 log.cc:927] Time spent T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:06:44.652585 24245 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.684041 22573 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:44.813242 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.817652 22430 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:44.818296 22578 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:44.772673 23856 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.816608 22431 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:44.790956 24284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.010s	sys 0.023s
I20260709 13:06:44.793357 24199 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:44.849218 23112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 232) took 1123 ms. Trace:
W20260709 13:06:44.826525 24284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.010s	sys 0.023s
I20260709 13:06:44.849668 23112 rpcz_store.cc:276] 0709 13:06:43.725860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.807885 (+ 82025us) service_pool.cc:224] Handling call
0709 13:06:43.864499 (+ 56614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.014887 (+150388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.848274 (+833387us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b54005b27d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:44.849152 (+   878us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124761472}
I20260709 13:06:44.819646 24073 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.830432 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1155) took 1361 ms. Trace:
I20260709 13:06:44.812424 23923 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.845395 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:44.904723 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 126920us
I20260709 13:06:44.908931 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 155) took 1056 ms. Trace:
I20260709 13:06:44.909169 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:44.910645 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 239899us
I20260709 13:06:44.909344 22582 rpcz_store.cc:276] 0709 13:06:43.854957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.383175 (+528218us) service_pool.cc:224] Handling call
0709 13:06:44.400862 (+ 17687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.401106 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:44.652994 (+251888us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.908599 (+255605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.908650 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:44.908689 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.908750 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.908870 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172608,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":1600,"thread_start_us":506665,"threads_started":2}
I20260709 13:06:44.828574 23856 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.831559 24325 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.908545 24290 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.907128 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:44.871302 24199 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:44.940912 24015 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:44.944435 23738 consensus_meta.cc:287] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.000s
I20260709 13:06:44.946768 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:44.947377 24325 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:44.947881 23109 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:06:44.948601 24329 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:06:44.950922 24324 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
W20260709 13:06:44.957008 24322 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:06:44.935942 24330 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.961817 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:44.962532 24326 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:44.936873 24290 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:44.965466 24007 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:44.966173 24290 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:44.967343 24178 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:44.968201 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1172) took 1117 ms. Trace:
I20260709 13:06:44.968652 24245 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:44.936622 24148 consensus_meta.cc:287] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.002s
I20260709 13:06:44.969135 22581 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:44.969704 24288 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:44.969590 24148 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:44.972112 24190 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:44.935056 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:44.972754 22428 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:44.971994 24148 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:44.881057 22573 rpcz_store.cc:276] 0709 13:06:43.464177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.471949 (+  7772us) service_pool.cc:224] Handling call
0709 13:06:44.013401 (+541452us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfdeee 0000000000375939 00007f0071d711e0 00007f0071e3a0c4 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:44.825655 (+812254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12058880}
I20260709 13:06:44.984767 23856 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:44.990643 23989 raft_consensus.cc:3055] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:44.994472 24330 raft_consensus.cc:697] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:44.986111 24199 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:44.980401 24332 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:06:44.995258 24176 consensus_meta.cc:287] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.878s	user 0.004s	sys 0.007s
I20260709 13:06:44.985611 23923 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:44.997148 23106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 233) took 1271 ms. Trace:
W20260709 13:06:44.997067 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.998283 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.015004 22432 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.968609 22579 rpcz_store.cc:276] 0709 13:06:43.850583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.850915 (+   332us) service_pool.cc:224] Handling call
0709 13:06:44.967977 (+1117062us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b540016add4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:44.968143 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214492416}
I20260709 13:06:45.023146 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:44.960245 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.003489 22547 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:44.987596 24343 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.992973 24259 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.001976 23743 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:45.003361 24190 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:45.051863 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 48492.4us
I20260709 13:06:45.052883 22547 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:44.981310 24342 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5.
I20260709 13:06:45.005339 23989 raft_consensus.cc:740] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:06:45.029354 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 120268us
I20260709 13:06:45.030094 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:45.038334 22429 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:45.060504 22474 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:45.008340 22426 raft_consensus.cc:2393] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:45.009712 24148 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.007601 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.061439 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.067699 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.061844 22547 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.063014 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:45.010828 24338 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:45.064375 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:45.069483 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.071131 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:45.072623 22505 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.075592 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:45.076504 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.077658 22432 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:45.057930 24288 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.080226 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.058373 24245 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.055075 24343 raft_consensus.cc:697] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:45.058648 24339 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.017149 24176 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.087608 22432 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:45.077612 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:45.095239 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.072067 24325 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:45.060848 23904 consensus_queue.cc:1059] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:06:45.086153 24328 log.cc:927] Time spent T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:06:45.077907 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1165) took 1533 ms. Trace:
I20260709 13:06:45.122804 22429 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:45.134222 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:45.053196 24259 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:45.137356 24341 log.cc:927] Time spent T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:45.137929 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:45.138669 24340 log.cc:927] Time spent T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:06:45.140118 22424 raft_consensus.cc:2410] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:45.125873 22505 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:45.142597 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:45.085256 24081 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.133409 24330 consensus_queue.cc:237] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.145449 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:45.146317 24081 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:45.146821 24081 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:45.147715 24081 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.070076 24148 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.150648 24148 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:45.135953 24346 log.cc:927] Time spent T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:06:45.133622 22574 rpcz_store.cc:276] 0709 13:06:43.544093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.560630 (+ 16537us) service_pool.cc:224] Handling call
0709 13:06:43.561102 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.195878 (+634776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.073277 (+877399us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b5400375854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:45.077825 (+  4548us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134922624}
I20260709 13:06:45.096757 24344 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:45.152094 24344 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.152527 24344 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.157235 24259 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.159245 24217 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.086737 24338 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.143659 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:45.162916 24338 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:45.163765 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:45.165304 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:45.167528 22505 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:45.169673 22506 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:45.171440 24070 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:45.173386 22505 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:45.173794 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:45.176357 22506 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:45.177652 22506 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:06:45.151702 24196 consensus_meta.cc:287] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.000s
I20260709 13:06:45.203861 22504 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:06:45.204306 22504 pending_rounds.cc:85] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 1
I20260709 13:06:45.204594 22504 pending_rounds.cc:107] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:45.204828 22504 raft_consensus.cc:2889] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.182691 24245 raft_consensus.cc:3055] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:45.189581 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.175169 23109 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:45.197811 23904 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:45.122193 24339 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:45.216164 24129 consensus_meta.cc:287] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.803s	user 0.011s	sys 0.001s
I20260709 13:06:45.231189 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:45.230904 22399 connection.cc:256] RPC call timeout handler was delayed by -1.3461573569999246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
I20260709 13:06:45.228919 22579 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:45.226284 22472 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:45.231081 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:45.237712 22399 connection.cc:256] RPC call timeout handler was delayed by -1.2687573570000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
I20260709 13:06:45.213320 24245 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:45.237743 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:45.239117 22399 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.217341 24325 raft_consensus.cc:697] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:45.218416 22426 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.245314 22580 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:45.240619 22581 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:45.238654 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:45.247953 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:45.248726 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:45.250339 22576 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:45.220546 24176 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.228092 23856 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:45.253684 22399 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.256224 24294 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:45.014446 23106 rpcz_store.cc:276] 0709 13:06:43.726180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.856976 (+130796us) service_pool.cc:224] Handling call
0709 13:06:43.895481 (+ 38505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.096392 (+200911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.109126 (+ 12734us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.160040 (+ 50914us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.625702 (+465662us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:44.932720 (+307018us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.945070 (+ 12350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.990367 (+ 45297us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.993744 (+  3377us) raft_consensus.cc:1685] finished
0709 13:06:44.993771 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.997058 (+  3287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112964,"prepare.queue_time_us":427117,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":182779,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":2632,"thread_start_us":520092,"threads_started":2,"wal-append.queue_time_us":718813}
I20260709 13:06:45.263167 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:45.263715 24186 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:45.270283 22399 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.251264 24183 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:45.222478 23904 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.241169 24129 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.277578 23108 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:45.214131 24343 consensus_queue.cc:237] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.282554 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.271857 24294 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.273727 24305 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:45.275348 24354 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.306644 24354 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.308838 24354 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:45.278651 24231 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.292764 24321 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:45.309530 24231 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:45.310037 24231 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.311038 22427 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:45.313758 24339 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:45.314384 24264 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.293373 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.293933 24232 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:45.290810 23738 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.288909 24217 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:45.306051 24129 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.268868 23856 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.280408 24183 raft_consensus.cc:697] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:45.273917 24182 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 13:06:45.319831 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45794.3us
I20260709 13:06:45.320555 23738 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:45.321929 24176 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.276311 24178 consensus_queue.cc:1059] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:45.325690 23111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 349) took 1070 ms. Trace:
I20260709 13:06:45.275218 24186 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.326360 22399 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.316653 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:45.326884 23738 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.291481 24325 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.333053 23856 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.324561 24294 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:45.334256 22502 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:45.329248 23111 rpcz_store.cc:276] 0709 13:06:44.255575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.352802 (+ 97227us) service_pool.cc:224] Handling call
0709 13:06:45.324985 (+972183us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:45.325189 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.325364 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.325391 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.325434 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:45.325464 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.325525 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.325635 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39392000}
I20260709 13:06:45.341322 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1098) took 1236 ms. Trace:
I20260709 13:06:45.342109 22499 rpcz_store.cc:276] 0709 13:06:44.105021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.107667 (+  2646us) service_pool.cc:224] Handling call
0709 13:06:44.131125 (+ 23458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.322419 (+191294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.326146 (+  3727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.332146 (+  6000us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:44.335722 (+  3576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.340855 (+1005133us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54002c9554. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:45.340966 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.341194 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399830400}
I20260709 13:06:45.348178 24226 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.353497 23109 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:45.355324 24186 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.357617 24183 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.361667 24321 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:45.365772 24232 raft_consensus.cc:3055] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:45.368247 24232 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:45.369417 24232 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.370982 24232 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.371106 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:45.372087 22575 raft_consensus.cc:2393] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:45.373057 24182 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.373507 23904 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:45.374769 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.377771 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48411.6us
I20260709 13:06:45.327450 24339 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.290484 24245 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.356226 24186 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:06:45.376626 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.391786 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:45.393955 24371 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:45.395270 24371 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:45.395687 24371 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:45.391021 22426 raft_consensus.cc:2410] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:45.423427 23111 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:06:45.423867 23111 pending_rounds.cc:85] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 4
I20260709 13:06:45.424078 23111 pending_rounds.cc:107] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:45.424285 23111 raft_consensus.cc:2889] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.426278 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:45.428224 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:45.400126 24371 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.430634 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.430891 24371 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:45.430143 24363 log.cc:927] Time spent T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:06:45.432184 23077 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:45.448966 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:45.450978 23904 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:45.414902 24365 consensus_queue.cc:1059] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:06:45.416086 24245 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.385862 24339 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.379907 24344 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.458724 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:45.459391 22547 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.439395 24073 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:06:45.470543 24339 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:45.493340 24337 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.702s	user 0.001s	sys 0.003s
I20260709 13:06:45.494690 24231 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.498076 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1177) took 1641 ms. Trace:
I20260709 13:06:45.498495 22578 rpcz_store.cc:276] 0709 13:06:43.856829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.390923 (+534094us) service_pool.cc:224] Handling call
0709 13:06:44.817987 (+427064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.818729 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.497878 (+679149us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400086450. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:45.498015 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818383744}
I20260709 13:06:45.470430 24081 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:45.510733 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1109) took 1080 ms. Trace:
I20260709 13:06:45.516309 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.490576 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:45.514285 22507 rpcz_store.cc:276] 0709 13:06:44.430046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.430164 (+   118us) service_pool.cc:224] Handling call
0709 13:06:44.430613 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.430904 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.430926 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.440122 (+  9196us) log.cc:844] Serialized 556 byte log entry
0709 13:06:44.569230 (+129108us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:44.569267 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.569338 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.492711 (+923373us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:45.503460 (+ 10749us) raft_consensus.cc:1685] finished
0709 13:06:45.503483 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.510653 (+  7170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5337472,"thread_start_us":128781,"threads_started":1,"wal-append.queue_time_us":239955}
I20260709 13:06:45.519131 22398 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:45.522176 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:45.501072 24176 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.501379 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.528117 22398 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.500384 23738 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.530296 23106 raft_consensus.cc:2410] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:45.536921 24116 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.513043 24030 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:45.525580 24178 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.525005 24376 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.529316 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:06:45.548264 22316 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e32ba8e6132b4f8e98a99066b6fffe05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:45.529922 23104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 346) took 1281 ms. Trace:
I20260709 13:06:45.533684 24294 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.560600 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.554251 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.563757 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:45.530815 24183 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.558689 23107 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.559142 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1108) took 1384 ms. Trace:
I20260709 13:06:45.531131 22426 raft_consensus.cc:2376] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4. Re-sending same reply.
I20260709 13:06:45.564390 22580 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.567083 22428 rpcz_store.cc:276] 0709 13:06:44.180057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.213015 (+ 32958us) service_pool.cc:224] Handling call
0709 13:06:44.213349 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.989876 (+776527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.558832 (+568956us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b540003c854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:45.559062 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1746023296}
I20260709 13:06:45.559912 23738 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.589304 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.590332 22428 raft_consensus.cc:2410] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:45.591307 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.551935 24231 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:45.594252 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 64039.5us
I20260709 13:06:45.561141 24178 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:45.596251 22398 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:45.599155 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:45.603808 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.605435 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.617668 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.621264 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.622747 23738 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.626951 24344 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.709429 22580 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:45.711691 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.718040 22425 raft_consensus.cc:2376] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3. Re-sending same reply.
I20260709 13:06:45.719256 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.722363 24264 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.556041 23104 rpcz_store.cc:276] 0709 13:06:44.248054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.312870 (+ 64816us) service_pool.cc:224] Handling call
0709 13:06:45.468727 (+1155857us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:45.481686 (+ 12959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.512661 (+ 30975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.512703 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.512759 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:45.517223 (+  4464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.522990 (+  5767us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.527268 (+  4278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54908800}
I20260709 13:06:45.711380 24365 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:45.724278 24365 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.725724 23113 raft_consensus.cc:3055] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:45.726123 23113 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:45.726447 24365 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.726909 23113 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.728004 23113 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.600693 24178 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.730839 24178 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:45.734565 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.735347 22425 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:45.737300 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:45.735761 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 146903us
I20260709 13:06:45.739625 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:45.713351 24380 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:06:45.744619 23108 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:45.747905 24386 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.748550 24386 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:45.749523 24386 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:45.750946 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.753228 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.757098 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.758059 22430 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:45.758986 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.760116 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.764017 23113 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:45.744648 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.765429 22425 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:45.766388 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.762737 22430 raft_consensus.cc:2376] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4. Re-sending same reply.
I20260709 13:06:45.768236 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.768939 22430 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:45.769852 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:45.776335 23077 leader_election.cc:336] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.638s (SENT)
I20260709 13:06:45.776859 23077 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:45.778195 24371 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.782655 22425 raft_consensus.cc:2410] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:45.784116 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.784941 22430 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.786221 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.787029 22425 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:45.767972 24200 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.780458 24294 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:45.796355 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 193965us
I20260709 13:06:45.795255 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.797330 22398 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.798245 22398 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:45.781821 23107 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:45.801863 22425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:45.802714 22425 raft_consensus.cc:606] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:45.803141 22425 raft_consensus.cc:614] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:45.804899 22425 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:45.804821 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 60630.5us
I20260709 13:06:45.807379 24081 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.808048 24081 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.808552 22428 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.809233 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 1881) took 1195 ms. Trace:
I20260709 13:06:45.809526 22428 rpcz_store.cc:276] 0709 13:06:44.613341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.807963 (+1194622us) service_pool.cc:224] Handling call
0709 13:06:45.808312 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.808998 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.809179 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.810837 22428 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.811508 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 1884) took 1197 ms. Trace:
I20260709 13:06:45.812026 24081 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:45.820683 22433 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:45.806296 24384 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.821733 24392 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.833180 24148 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:06:45.842002 23841 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:45.842948 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 616653us
I20260709 13:06:45.843930 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:45.845752 22472 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:45.824046 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 1879) took 1211 ms. Trace:
I20260709 13:06:45.846357 22425 rpcz_store.cc:276] 0709 13:06:44.612798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.804262 (+1191464us) service_pool.cc:224] Handling call
0709 13:06:45.804596 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.806140 (+  1544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.823974 (+ 17834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.847384 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.847784 22425 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:45.811825 22428 rpcz_store.cc:276] 0709 13:06:44.614104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.810303 (+1196199us) service_pool.cc:224] Handling call
0709 13:06:45.810651 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.811271 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.811455 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.848555 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 1886) took 1198 ms. Trace:
I20260709 13:06:45.849720 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.850255 22425 rpcz_store.cc:276] 0709 13:06:44.650194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.847172 (+1196978us) service_pool.cc:224] Handling call
0709 13:06:45.847543 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.848231 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.848493 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.851686 22425 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.852973 22425 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:45.853685 24196 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.854080 22425 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:45.833739 22398 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:45.856194 23841 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:45.856729 23841 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:45.857909 24392 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:45.857712 23841 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.858865 24392 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.860024 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:45.863816 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.864100 23104 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:45.860708 23989 consensus_queue.cc:260] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.864509 23104 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:06:45.865264 24370 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.377s	user 0.007s	sys 0.005s
I20260709 13:06:45.796036 24200 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.867586 24200 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:45.867798 24343 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:45.868386 24343 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:45.862242 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 569738us
W20260709 13:06:45.872265 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.861662 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.861855 24392 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.862344 24130 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:45.863338 24397 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.872905 22432 raft_consensus.cc:2376] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3. Re-sending same reply.
I20260709 13:06:45.850674 22431 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:45.848456 24357 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.858336 22574 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:45.890305 22430 raft_consensus.cc:2410] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:45.890018 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.881397 24288 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:45.891336 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:45.893401 22505 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:45.895109 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.895906 22429 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:45.897921 22429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 1892) took 1233 ms. Trace:
I20260709 13:06:45.898365 22429 rpcz_store.cc:276] 0709 13:06:44.664529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.134471 (+469942us) service_pool.cc:224] Handling call
0709 13:06:45.894952 (+760481us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:45.897852 (+  2900us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92554496}
I20260709 13:06:45.891924 24288 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.899484 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.900341 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1101) took 1785 ms. Trace:
I20260709 13:06:45.878793 24245 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.900641 22429 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:45.900434 22428 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.900918 22424 rpcz_store.cc:276] 0709 13:06:44.114588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.114743 (+   155us) service_pool.cc:224] Handling call
0709 13:06:45.900133 (+1785390us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540003cd54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:45.900288 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306719488}
I20260709 13:06:45.905161 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.902077 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:45.902247 22431 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:45.902987 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.905241 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:45.900466 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:45.906937 22424 raft_consensus.cc:2393] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:45.907958 22424 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:45.914779 22429 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.915803 22503 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:45.916843 22505 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:45.917359 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.917956 22432 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:45.918687 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.918911 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.919821 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.919014 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:45.921397 22579 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:45.922202 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.922956 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.889003 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:45.925412 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.923378 22579 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:06:45.924822 24264 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:45.929177 22576 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.929080 24264 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.929803 24096 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.882906 24397 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.930270 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.931433 23743 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.932127 24397 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.932787 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.897557 24385 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.878499 24371 consensus_queue.cc:1059] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:06:45.931430 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.934724 22425 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:45.933619 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 87950.6us
I20260709 13:06:45.935895 22472 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:45.933867 22577 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:45.938400 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.940171 22431 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:45.914595 24339 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:45.904610 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:45.945489 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.931957 23743 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.865445 23104 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.935724 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:45.946552 22472 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:45.910127 24343 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:45.958165 22504 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:45.931886 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:45.932595 22499 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:45.925140 24354 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:06:45.966068 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.937580 24358 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:45.938015 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1074) took 1018 ms. Trace:
I20260709 13:06:45.915992 24245 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.979452 22425 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:45.977536 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:45.997586 22431 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:45.957454 24330 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.086383 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:46.090857 22503 raft_consensus.cc:2410] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:45.968990 24343 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.056360 22432 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:46.097070 23112 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:06:46.100103 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 167924us
I20260709 13:06:45.975732 24226 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:06:45.930295 24096 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:45.948107 24385 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.961807 24073 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:46.135058 24073 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.959486 24355 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:45.969252 23104 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.951541 24339 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.975047 24357 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.091630 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:45.980135 22574 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:45.998737 24129 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:45.995929 24116 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:45.980996 24287 consensus_queue.cc:1059] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:06:45.997186 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:46.121480 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.980571 24354 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:45.996047 24392 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:06:46.128425 24200 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.094975 22573 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:46.096000 24343 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:46.147890 22505 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:46.162061 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:46.153604 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 156542us
I20260709 13:06:46.155869 22429 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:46.156354 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:46.157292 22578 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:46.139720 24355 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.162061 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:46.150498 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:46.191298 23077 leader_election.cc:336] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.799s (SENT)
W20260709 13:06:46.236857 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.208874 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 50392.6us
I20260709 13:06:46.244760 23077 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:46.249114 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 57859.5us
W20260709 13:06:46.250295 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.259496 22396 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:46.261679 22396 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:46.267287 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:46.268102 22503 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:46.270467 22503 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:46.273574 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 110219us
I20260709 13:06:46.275727 22503 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:46.158478 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:46.208488 24343 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.160964 24354 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:46.280319 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.246042 22574 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.281528 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:46.155393 24116 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.288187 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:46.254014 24371 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:46.291023 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.290879 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:46.247953 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:46.265390 24349 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:46.209005 24200 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:46.157337 24358 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 13:06:46.151177 24357 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.159633 24129 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.283360 24384 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:46.281778 24288 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:46.296774 24398 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
W20260709 13:06:46.324878 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.273538 24401 consensus_queue.cc:1059] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:06:46.278903 24182 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:06:46.293409 23743 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:46.281404 24232 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:46.291690 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:46.330205 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 449228us
I20260709 13:06:46.290133 24402 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:46.372083 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 434361us
I20260709 13:06:46.293326 23841 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:06:46.386876 22398 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:46.376674 22427 raft_consensus.cc:2393] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:46.317855 22499 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:46.374572 24384 raft_consensus.cc:697] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:46.381129 24392 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:46.384577 24245 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:46.407511 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 120379us
I20260709 13:06:46.391227 23743 consensus_queue.cc:1059] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:06:46.418642 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:46.323331 24349 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:46.429440 24081 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.007s	sys 0.006s
W20260709 13:06:46.434756 24081 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.008s	sys 0.006s
W20260709 13:06:46.435479 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 144785us
I20260709 13:06:46.436386 22396 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:46.426257 23110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.009s	sys 0.005s
I20260709 13:06:46.438727 22546 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:46.426714 24096 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:46.432340 24073 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:46.444711 23107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.002s	sys 0.009s
W20260709 13:06:46.441964 23110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.009s	sys 0.005s
I20260709 13:06:46.455798 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:46.427246 24413 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.980396 22501 rpcz_store.cc:276] 0709 13:06:44.914785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.917319 (+  2534us) service_pool.cc:224] Handling call
0709 13:06:45.625503 (+708184us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:45.661768 (+ 36265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.686311 (+ 24543us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:45.790808 (+104497us) log.cc:844] Serialized 14 byte log entry
0709 13:06:45.888837 (+ 98029us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.898127 (+  9290us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:45.901167 (+  3040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.915570 (+ 14403us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.933570 (+ 18000us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97778,"prepare.queue_time_us":69831,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":73005,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":13540224,"thread_start_us":113075,"threads_started":2,"wal-append.queue_time_us":23603}
I20260709 13:06:46.478720 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:46.437558 24339 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:46.485164 22546 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:46.466907 24350 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 1.380s	user 0.004s	sys 0.000s
I20260709 13:06:46.445942 24288 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.428460 24392 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:46.480003 23107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.002s	sys 0.010s
I20260709 13:06:46.465428 24355 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:46.485893 24073 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.484648 24408 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.488307 24200 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:46.493299 24232 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:46.487672 24304 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:46.507686 22424 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.001s	sys 0.024s
I20260709 13:06:46.505640 22546 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:46.491037 24096 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.510350 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:46.511485 22433 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34614 (request call id 160) took 1368 ms (client timeout 1502 ms). Trace:
W20260709 13:06:46.648991 22433 rpcz_store.cc:269] 0709 13:06:45.143478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.172892 (+ 29414us) service_pool.cc:224] Handling call
0709 13:06:45.489807 (+316915us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:45.554076 (+ 64269us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfde9c 00007f0069cfda5b 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:46.511299 (+957223us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540043c954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:46.511425 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586098560}
W20260709 13:06:46.501880 24404 log.cc:927] Time spent T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:06:46.503446 24405 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
W20260709 13:06:46.517731 24015 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:06:46.521634 24426 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.517155 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:46.664649 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.665382 24355 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.666795 23108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59024 (request call id 238) took 1240 ms. Trace:
I20260709 13:06:46.667208 23108 rpcz_store.cc:276] 0709 13:06:45.425930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.427352 (+  1422us) service_pool.cc:224] Handling call
0709 13:06:46.666576 (+1239224us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54005069d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:46.666714 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622445952}
I20260709 13:06:46.668555 23113 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:46.654831 24073 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.670765 24073 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.671576 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:46.525931 24407 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:06:46.505851 24408 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:46.541503 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.677057 24408 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.678167 22574 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:46.511080 22502 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:46.479344 24384 consensus_queue.cc:237] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.495923 24294 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:06:46.511502 24226 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:46.505206 23856 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:46.513720 24418 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:46.488986 22499 raft_consensus.cc:2955] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:46.515442 24425 consensus_queue.cc:1059] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 13:06:46.638460 22424 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.001s	sys 0.024s
W20260709 13:06:46.652165 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 146601us
W20260709 13:06:46.648403 24406 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.249s	user 0.000s	sys 0.006s
I20260709 13:06:46.658152 24419 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.681238 24330 consensus_meta.cc:287] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.011s
I20260709 13:06:46.680893 24426 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:46.516216 24232 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.682184 24096 raft_consensus.cc:1064] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
W20260709 13:06:46.684617 22472 leader_election.cc:336] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.533s (SENT)
W20260709 13:06:46.727332 22472 leader_election.cc:336] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.582s (SENT)
I20260709 13:06:46.728515 22472 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:46.671530 24073 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.685375 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:46.666853 24355 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:46.663865 24343 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:46.738373 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 165) took 1556 ms. Trace:
I20260709 13:06:46.693619 22427 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:46.682274 23904 raft_consensus.cc:3055] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:46.672250 22507 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:46.683712 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:46.657346 24417 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.148s	user 0.003s	sys 0.002s
I20260709 13:06:46.711321 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:46.744903 24015 consensus_queue.cc:1059] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:46.745728 24015 consensus_queue.cc:1243] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Peer e47a624c3ddb48c5a8947ac0b3e71f84 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:46.745929 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:46.746227 24232 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:46.746620 22433 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:46.747555 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:46.747663 22396 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:46.712759 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:46.749167 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:46.750066 24178 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.750583 24349 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:46.750658 23079 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:46.751828 24416 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:46.717391 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 83072us
I20260709 13:06:46.751820 23105 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:06:46.752908 23077 leader_election.cc:336] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.001s (SENT)
I20260709 13:06:46.775110 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:46.776391 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:46.777742 22433 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:46.743989 22579 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
W20260709 13:06:46.755558 24422 log.cc:927] Time spent T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:06:46.782801 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:46.784090 24423 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:06:46.777137 24392 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:46.754658 24426 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:46.702028 24116 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:46.786890 24402 raft_consensus.cc:3055] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:46.708022 23856 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.732299 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:46.787298 24402 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:46.787672 24073 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.726789 24330 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.725078 24419 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:46.790967 22506 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.791195 24354 raft_consensus.cc:3055] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:46.791383 24343 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:46.791677 24354 raft_consensus.cc:740] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:46.792198 22503 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:46.708519 24226 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.755698 24393 raft_consensus.cc:2955] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:46.793558 23856 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:46.796424 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:46.796622 24226 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:46.706952 24183 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.719702 24418 raft_consensus.cc:697] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:46.797358 24183 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:46.692306 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.741881 22474 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:46.740229 22502 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:46.742789 23904 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:46.799507 24183 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:46.799337 23904 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:46.800721 23904 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:46.734757 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.797869 24418 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.793236 22500 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:46.793006 24130 raft_consensus.cc:3055] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:46.805842 24130 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:46.805996 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:46.800798 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:46.808135 24408 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.808880 22427 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:46.792694 24354 consensus_queue.cc:260] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.809826 24354 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.733925 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:46.750538 24178 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.793707 24358 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.812677 24178 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.813920 23989 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.814584 22504 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:46.759994 22501 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
W20260709 13:06:46.816169 22316 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e32ba8e6132b4f8e98a99066b6fffe05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:46.816854 24343 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:46.817862 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 76046.2us
I20260709 13:06:46.818783 22474 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:46.752280 24416 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:46.826020 24416 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:46.826228 24424 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 13:06:46.754812 24371 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:06:46.755239 23110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 242) took 1238 ms. Trace:
I20260709 13:06:46.755908 24377 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.829221 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:46.820932 24130 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:46.791720 24419 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:46.823350 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.823729 24200 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:46.788172 24402 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:46.779965 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.837591 23077 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:46.838827 22433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:46.839071 23077 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:46.839416 22433 raft_consensus.cc:606] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:06:46.720713 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.779910 24196 consensus_meta.cc:287] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.905s	user 0.017s	sys 0.000s
I20260709 13:06:46.828313 22474 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:46.827301 24358 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.825341 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:46.853195 22474 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:46.855549 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 127156us
I20260709 13:06:46.856364 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:46.856649 22472 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:46.831534 24377 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:46.836114 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:46.867652 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:46.839809 22433 raft_consensus.cc:614] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:46.838615 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:46.850627 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:46.835484 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:46.845604 24339 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.875546 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:46.876205 22431 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:06:46.870153 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:46.878705 22504 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:46.757076 24355 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:46.852090 24196 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.854980 24325 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.847496 24371 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.873411 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:46.875973 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:46.876047 22508 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:46.868950 24377 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.863543 24226 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.887269 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:46.860539 24402 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.888244 22546 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:46.895577 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1119) took 1010 ms. Trace:
I20260709 13:06:46.909238 22508 rpcz_store.cc:276] 0709 13:06:45.884793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.885007 (+   214us) service_pool.cc:224] Handling call
0709 13:06:46.875525 (+990518us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:46.875713 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.895277 (+ 19564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.895502 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9153920}
I20260709 13:06:46.911029 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:46.868371 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:46.911902 22582 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:46.912245 22580 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:46.844734 24200 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.891155 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:46.914006 22507 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:46.894652 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:46.866775 22501 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:46.899149 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:46.880739 23107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 359) took 1008 ms. Trace:
I20260709 13:06:46.851927 24288 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:06:46.916698 22546 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:46.902853 22576 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:46.934177 22474 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:46.935895 22576 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:46.938863 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.895038 23856 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.894953 22573 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:46.926151 22577 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:46.887279 24176 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.927986 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:46.928560 22433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:46.968899 22433 raft_consensus.cc:606] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:46.890676 24426 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:46.934165 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 95132.6us
I20260709 13:06:46.894372 24081 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.979732 24081 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.899981 24358 consensus_queue.cc:1059] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:06:46.943534 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:46.940763 23104 consensus_meta.cc:287] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.775s	user 0.014s	sys 0.002s
I20260709 13:06:46.980316 24081 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.929200 24199 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.904771 24268 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.964850 22578 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:46.892911 24339 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.984880 22474 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:46.986742 24325 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.989091 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:46.994786 22433 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.963335 24116 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:46.967979 24176 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:46.968912 23904 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.973877 24426 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.974398 23856 raft_consensus.cc:697] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:46.990473 24199 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.007900 22581 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:46.991987 24418 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:47.010300 22431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:47.011554 24199 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.012135 24357 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.012878 23856 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:46.828452 23110 rpcz_store.cc:276] 0709 13:06:45.516897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.518264 (+  1367us) service_pool.cc:224] Handling call
0709 13:06:45.868580 (+350316us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:45.868786 (+   206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.869160 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.869195 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.869728 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.685973 (+816245us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18002c7ac0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f006c9ca4bc 00007f0069d1848b 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b 00007f006c9c1d23 00007f006c9c20d1
0709 13:06:46.686138 (+   165us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:46.686177 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.686242 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.754961 (+ 68719us) raft_consensus.cc:1685] finished
0709 13:06:46.754982 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.755173 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267,"raft.queue_time_us":1351,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4762,"spinlock_wait_cycles":13886464,"thread_start_us":607162,"threads_started":1,"wal-append.queue_time_us":601940}
I20260709 13:06:47.006675 24426 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.015079 24178 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.020457 24339 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:47.021289 23105 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:47.021773 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.043149 24129 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.011041 23904 raft_consensus.cc:697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:47.047180 23904 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:47.049031 24437 log.cc:927] Time spent T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:06:47.049438 24435 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:06:47.005661 23104 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:47.022727 24148 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:46.998378 24335 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.929605 23107 rpcz_store.cc:276] 0709 13:06:45.872397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.873732 (+  1335us) service_pool.cc:224] Handling call
0709 13:06:45.891889 (+ 18157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.892280 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.892310 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.892801 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.502742 (+609941us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:46.506511 (+  3769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.513204 (+  6693us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.825646 (+312442us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:46.860221 (+ 34575us) raft_consensus.cc:1685] finished
0709 13:06:46.860254 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.871754 (+ 11500us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1058,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":10874,"spinlock_wait_cycles":4417792,"thread_start_us":604110,"threads_started":1,"wal-append.queue_time_us":608745}
I20260709 13:06:47.024555 24418 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.025235 24116 raft_consensus.cc:697] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:47.025977 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.074754 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:46.995198 24325 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:47.004776 24176 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:47.031980 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 57304.6us
W20260709 13:06:47.034013 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 96557.8us
I20260709 13:06:47.042832 24178 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.059250 22433 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:06:47.061599 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.062348 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.063546 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:47.061510 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 51085.1us
W20260709 13:06:47.070299 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 142447us
I20260709 13:06:47.025065 22431 raft_consensus.cc:606] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.091674 22431 raft_consensus.cc:614] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:47.026340 24408 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:47.091146 22472 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.074257 24418 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.027006 24355 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:47.097564 24355 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:47.087419 24373 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:06:47.095957 22472 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:47.109783 24355 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:47.108158 24200 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:47.114835 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 1887) took 2464 ms. Trace:
I20260709 13:06:47.114529 24426 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:47.115600 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.080695 24325 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.115252 22428 rpcz_store.cc:276] 0709 13:06:44.650599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.849238 (+1198639us) service_pool.cc:224] Handling call
0709 13:06:45.900271 (+ 51033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.909458 (+  9187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.114606 (+1205148us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b540003cd50. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:47.114770 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116609920}
I20260709 13:06:47.117852 22431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:47.118568 22431 raft_consensus.cc:606] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:47.118893 22431 raft_consensus.cc:614] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:47.120951 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:47.126407 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.127496 22546 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:47.130753 22472 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.132048 22472 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.073179 24357 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:06:47.088127 23104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 357) took 1227 ms. Trace:
I20260709 13:06:47.137796 24377 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.078779 24344 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:06:47.110921 24399 log.cc:927] Time spent T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.058s	user 0.000s	sys 0.003s
I20260709 13:06:47.142587 22472 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.101001 24425 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:47.147238 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.157056 22581 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:47.154698 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:47.159386 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:47.161273 22474 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:47.141089 24408 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:47.171250 23108 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:47.175884 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 87109.4us
I20260709 13:06:47.148424 24356 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:47.153481 24436 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.143837 24365 consensus_queue.cc:1059] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:47.192456 24443 raft_consensus.cc:3055] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:47.192878 24443 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:47.193723 24443 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.194651 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.144071 23104 rpcz_store.cc:276] 0709 13:06:45.860215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.863642 (+  3427us) service_pool.cc:224] Handling call
0709 13:06:45.863978 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.054252 (+1190274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.084801 (+ 30549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.153877 24445 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.189863 24287 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.209328 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.185137 23904 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.188593 24356 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:47.188755 24425 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.188114 24408 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:47.234695 22545 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.197299 24385 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:47.233197 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 68323.5us
I20260709 13:06:47.148538 24116 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.187579 24199 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:47.251731 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 165073us
I20260709 13:06:47.182017 24454 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:06:47.236389 24356 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.191314 24358 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:06:47.259035 24377 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.266166 24426 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.267156 23076 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:47.283658 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:47.270823 24400 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.217450 24287 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.232908 24456 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:06:47.290165 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 199256us
I20260709 13:06:47.292753 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 1937) took 1373 ms. Trace:
I20260709 13:06:47.235965 23904 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:47.287007 24453 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:06:47.294785 24400 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:47.286568 24460 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:06:47.287024 24449 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.297152 22575 rpcz_store.cc:276] 0709 13:06:45.919299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.934062 (+ 14763us) service_pool.cc:224] Handling call
0709 13:06:45.952840 (+ 18778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.953055 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:45.972049 (+ 18994us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.102366 (+130317us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.754563 (+652197us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b180023e780. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:06:47.250419 (+495856us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b180023e780. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f006ce1a060 00007f006ce2c716 00007f006ce3d287 00007f006ce3d208
0709 13:06:47.292381 (+ 41962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.292435 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:47.292497 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.292565 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.292692 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22449,"prepare.run_cpu_time_us":6370,"prepare.run_wall_time_us":49052,"raft.queue_time_us":25780,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":20266,"spinlock_wait_cycles":16829440,"thread_start_us":166434,"threads_started":2,"wal-append.queue_time_us":309081}
I20260709 13:06:47.301067 24377 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:47.289501 24418 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.285375 24463 consensus_queue.cc:1059] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:06:47.287357 24408 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:47.328627 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.322726 24377 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:47.318698 24468 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:47.349713 24416 consensus_meta.cc:287] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 13:06:47.350251 24416 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.350842 23904 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:47.351426 23109 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:47.356261 24199 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:47.358086 24418 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:47.345650 24377 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.368569 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.370875 22575 raft_consensus.cc:2410] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:47.367947 22573 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:47.361747 24386 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:47.349884 24400 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.359144 23989 consensus_queue.cc:1059] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:06:47.363071 24416 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.363713 24468 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:06:47.409868 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 117403us
I20260709 13:06:47.411772 22506 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:47.412418 24400 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:47.412681 23738 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:47.413033 24400 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.413353 23738 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.415346 24400 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:47.415760 23738 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:47.418491 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.409058 24386 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.425024 24386 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:47.425238 24467 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:06:47.425871 24468 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:47.429025 24462 log.cc:927] Time spent T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:06:47.475188 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 313973us
I20260709 13:06:47.453256 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:47.492005 22575 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:47.486024 22396 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:47.455188 22425 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:06:47.452133 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1132) took 1303 ms. Trace:
I20260709 13:06:47.463222 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:47.453723 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 202393us
I20260709 13:06:47.525467 22503 rpcz_store.cc:276] 0709 13:06:46.148401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.277189 (+128788us) service_pool.cc:224] Handling call
0709 13:06:46.277513 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.794771 (+517258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.451832 (+657061us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b540019aad4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:47.452054 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182829440}
I20260709 13:06:47.526916 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.527735 22503 raft_consensus.cc:2393] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:47.529217 22472 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.529109 22581 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:47.463999 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.532305 22505 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:47.542734 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:47.561088 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 75179.7us
I20260709 13:06:47.550978 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:47.542428 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1088) took 1456 ms. Trace:
I20260709 13:06:47.562747 22396 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.563024 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.564157 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:47.565891 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 254400us
I20260709 13:06:47.567548 22472 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.450577 24443 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.449813 24130 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.571048 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:47.442111 24330 raft_consensus.cc:3055] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:47.460515 24349 raft_consensus.cc:3055] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.529453 24419 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.610747 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:47.534631 24385 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.612144 22430 raft_consensus.cc:2410] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:47.557861 24116 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.612406 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:47.562283 22505 rpcz_store.cc:276] 0709 13:06:46.086227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.241962 (+155735us) service_pool.cc:224] Handling call
0709 13:06:47.463823 (+1221861us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:47.542337 (+ 78514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13083520}
I20260709 13:06:47.454646 24358 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.483153 24425 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.455104 24439 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.432363 24335 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.461064 24387 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.445834 24287 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:47.488437 24365 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:47.618167 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:47.597863 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:47.623538 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:47.451299 24445 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.594254 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:47.644286 22578 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:47.454844 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1133) took 1297 ms. Trace:
I20260709 13:06:47.593392 24436 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.646646 22502 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:47.630115 23077 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.632045 23856 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.609319 24426 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.436329 24081 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.454087 24447 consensus_queue.cc:1059] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.171s
I20260709 13:06:47.533368 24226 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 13:06:47.637877 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.557605 24343 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:06:47.616168 24330 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:47.447662 24461 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.181s
W20260709 13:06:47.638815 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 404180us
I20260709 13:06:47.620217 24349 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:47.649565 24386 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:47.661664 24450 log.cc:927] Time spent T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.248s	user 0.000s	sys 0.003s
I20260709 13:06:47.568949 24397 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:06:47.641440 22433 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.630345 24471 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:06:47.642776 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:47.645229 24472 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:47.645243 24445 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:47.432461 24356 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.676791 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 209) took 1208 ms. Trace:
I20260709 13:06:47.676914 24445 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.677271 24330 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.678268 24330 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.679214 24377 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.652856 23856 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.682296 23856 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:47.677201 22507 rpcz_store.cc:276] 0709 13:06:46.468746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.743300 (+274554us) service_pool.cc:224] Handling call
0709 13:06:46.743603 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.919054 (+175451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.676530 (+757476us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001761d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:47.676736 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391304064}
I20260709 13:06:47.684886 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.685989 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:47.685660 24445 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.645817 24365 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.569550 24401 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:47.462370 24096 raft_consensus.cc:1068] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Unable to promote non-voter 9cea93fb03e04e48a6dabc4094ee7c93: Illegal state: Replica 10c2f471167442c0b75d8cd50ed8c40c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:47.649860 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:47.691401 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.692164 23105 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:47.631239 24358 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:47.630621 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:47.629127 24419 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.693246 24358 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.652766 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:47.693933 22501 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:47.694344 22431 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.694615 24419 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.657760 23111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 244) took 1778 ms. Trace:
I20260709 13:06:47.660913 24371 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.695573 24356 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:47.695907 24268 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:47.695214 23111 rpcz_store.cc:276] 0709 13:06:45.879616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.879776 (+   160us) service_pool.cc:224] Handling call
0709 13:06:45.880077 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.880255 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:46.258084 (+377829us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.654419 (+1396335us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b18003e5a20. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f006c9ca4bc 00007f0069d1848b 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f006ce1a060 00007f006ce2c716 00007f006ce3d287
0709 13:06:47.657372 (+  2953us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.657419 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:47.657460 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.657577 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.657704 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":510263,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":87,"raft.queue_time_us":59490,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":7933,"spinlock_wait_cycles":39504256,"thread_start_us":524514,"threads_started":2}
I20260709 13:06:47.663931 22545 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.631789 24385 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.698191 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:47.694358 22501 pending_rounds.cc:85] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 4
I20260709 13:06:47.699584 22501 pending_rounds.cc:107] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:47.699844 22501 raft_consensus.cc:2889] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:47.631577 24176 consensus_meta.cc:287] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.004s
I20260709 13:06:47.663012 24343 consensus_queue.cc:1243] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer e32ba8e6132b4f8e98a99066b6fffe05 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:47.641041 24387 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.708694 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:47.670467 22425 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:47.673632 22433 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:47.674855 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.675204 24015 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.676038 24349 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.634394 24425 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.715107 22431 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:47.715292 24425 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:47.715845 24445 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.716111 23109 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 3: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:47.686556 22507 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.692297 22429 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:47.700652 22432 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:47.660362 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.700848 22473 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:47.718225 24264 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:47.641511 24325 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.649207 23989 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:47.706471 24474 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.706712 24096 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.696416 24268 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.726564 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.708076 24477 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:47.711074 24015 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:47.648032 22499 rpcz_store.cc:276] 0709 13:06:46.157531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.428161 (+270630us) service_pool.cc:224] Handling call
0709 13:06:46.445556 (+ 17395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.479316 (+ 33760us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:47.050951 (+571635us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.454398 (+403447us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.454467 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:47.454517 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.454622 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.454775 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187535,"raft.queue_time_us":188064,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":209116,"threads_started":1,"wal-append.queue_time_us":251786}
I20260709 13:06:47.728150 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.727999 24015 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.729540 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.730166 24477 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.732069 24377 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.707201 24176 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.706463 24358 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.732780 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.734109 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.735178 22499 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:47.711970 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:47.720779 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 60153.5us
I20260709 13:06:47.736555 23989 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.737474 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.737576 24081 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:47.738193 24081 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:47.738327 22545 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.738667 23989 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:47.739797 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.721928 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:47.740742 22575 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.742846 24365 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.726996 24096 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:47.743769 24096 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.745839 24325 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.724728 24471 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.746755 24471 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.747115 24471 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.747937 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:47.748796 22578 raft_consensus.cc:2368] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5.
I20260709 13:06:47.729341 24015 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.750662 24264 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.751590 22505 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:47.749866 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:47.753383 24477 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.753925 22428 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:47.754623 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.756033 22499 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:47.732095 24330 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:06:47.740270 23111 raft_consensus.cc:2410] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:47.761173 24330 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:47.761931 24330 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:47.766574 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.766350 23110 raft_consensus.cc:2955] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:47.766795 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.769224 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.736291 24387 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.770622 22578 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:47.769156 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.777536 23105 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
W20260709 13:06:47.786602 24458 log.cc:927] Time spent T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.525s	user 0.001s	sys 0.000s
I20260709 13:06:47.787933 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:46.739041 22424 rpcz_store.cc:276] 0709 13:06:45.182265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.908697 (+726432us) service_pool.cc:224] Handling call
0709 13:06:45.908967 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.909158 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:45.976249 (+ 67091us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.738064 (+761815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.738111 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:46.738149 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.738208 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.738319 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64186,"prepare.queue_time_us":72708,"prepare.run_cpu_time_us":21026,"prepare.run_wall_time_us":85406,"raft.queue_time_us":28293,"thread_start_us":764049,"threads_started":2,"wal-append.queue_time_us":750289}
I20260709 13:06:47.804201 24386 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:47.804934 24386 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.788931 24385 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.753602 24176 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:47.808198 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.812115 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:47.813764 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:47.821260 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 243) took 2029 ms. Trace:
I20260709 13:06:47.821676 23113 rpcz_store.cc:276] 0709 13:06:45.791971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.792132 (+   161us) service_pool.cc:224] Handling call
0709 13:06:46.668196 (+876064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.668937 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.821061 (+1152124us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54005069d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:47.821204 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2002650368}
I20260709 13:06:47.821198 22581 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.816215 22577 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:47.823421 22507 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:06:47.824966 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:47.818840 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.817606 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.826195 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.829800 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.830622 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:47.830798 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.824728 22575 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:47.831327 22577 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:47.830011 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:47.831980 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.832957 22545 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.833981 22472 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.835772 22472 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.837069 22472 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.839102 22472 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:47.839857 24284 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.844905 24073 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:47.840116 24425 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.844237 24268 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.840201 24343 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.819675 24385 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:06:47.850193 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.850487 22399 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.851791 22504 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
W20260709 13:06:47.852420 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 242539us
I20260709 13:06:47.862272 22580 raft_consensus.cc:2393] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:47.862633 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.864773 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.864842 22581 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:06:47.867947 23113 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:47.869763 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.869853 22399 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:47.873834 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.883345 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.884712 24384 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:47.885579 24373 raft_consensus.cc:3055] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.886011 24373 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:47.886880 24373 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.888813 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.841318 24129 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.841542 24387 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.889982 24387 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.892858 22398 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:47.894060 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 55071.7us
I20260709 13:06:47.895401 22472 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:47.897209 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:47.897843 23112 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.897851 22399 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.902901 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.853793 24449 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.865267 24264 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.882740 24096 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.896617 24463 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.880621 24408 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.881034 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:47.923947 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:47.882241 24130 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.880887 24397 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.849490 24325 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:06:47.764601 24330 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.885838 24393 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:47.925834 22547 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.896562 24030 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.927387 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:47.905349 24358 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:47.898380 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1141) took 1075 ms. Trace:
I20260709 13:06:47.907078 24305 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.894789 24196 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.890444 24471 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.934020 24483 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.907675 24425 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:47.939419 22547 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.893797 24400 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:06:47.917987 24402 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:47.942957 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 87604.6us
I20260709 13:06:47.921533 24408 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.925001 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:47.949523 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:47.950256 22396 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.928668 24478 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.955392 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:47.958352 22547 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.960026 22547 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:47.961567 22396 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:47.941054 24449 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.934816 22499 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:47.942592 24030 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.962725 24073 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.962980 24287 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.965734 24387 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:47.932902 24130 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.944931 24268 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:47.932446 24339 consensus_queue.cc:1059] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:47.962839 24264 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.952939 24408 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.923997 24463 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:47.970351 24386 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:47.974845 24471 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:47.923491 24081 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:47.994793 24386 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:47.968624 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.996217 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.996625 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.996819 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1138) took 1176 ms. Trace:
I20260709 13:06:47.979060 22399 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:47.955168 24358 raft_consensus.cc:697] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:47.954667 24330 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.999255 23112 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:06:48.000468 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:48.001049 23112 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.004779 22547 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:47.952749 24402 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.960319 23738 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.956866 24365 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.005896 24402 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:48.006309 24365 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.008548 24365 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:47.986109 22396 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:48.008911 22581 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:47.959892 24425 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:48.010144 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:48.009949 24425 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.010715 22578 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:48.010753 22575 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:47.988849 24178 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.976241 24483 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.984261 24468 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:47.997218 22508 rpcz_store.cc:276] 0709 13:06:46.820115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.917929 (+ 97814us) service_pool.cc:224] Handling call
0709 13:06:46.918363 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.662654 (+744291us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b1800350fe0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f006c9ca4bc 00007f0069d1848b 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f006ce1a060 00007f006ce1abfb 00007f006ce2564b
0709 13:06:47.662816 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.662841 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.669790 (+  6949us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.891235 (+221445us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:47.891271 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.891355 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.996494 (+105139us) raft_consensus.cc:1685] finished
0709 13:06:47.996525 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.996759 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32336,"raft.queue_time_us":69657,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5012,"spinlock_wait_cycles":7306624,"thread_start_us":244478,"threads_started":2,"wal-append.queue_time_us":298522}
I20260709 13:06:48.017264 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:48.011637 22573 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:47.956596 24384 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:06:48.012624 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:47.994733 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:48.014745 22580 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.015146 23112 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:47.944550 22501 rpcz_store.cc:276] 0709 13:06:46.823423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.978447 (+155024us) service_pool.cc:224] Handling call
0709 13:06:46.978789 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.706531 (+727742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.861504 (+154973us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400175cd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:47.894675 (+ 33171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643827968}
W20260709 13:06:48.024933 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 45952.1us
I20260709 13:06:48.017150 24081 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:48.030740 23110 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:47.994815 24130 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:48.032372 22581 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:47.999203 24358 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.020787 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:48.033236 22503 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.033608 24386 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.033981 24419 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.016563 24365 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:48.037093 24096 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:48.042055 22546 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:48.049279 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:48.052832 22428 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:48.053524 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:48.084235 22432 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:48.085335 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:48.055701 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:48.055876 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:48.087153 22424 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.058732 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:48.088233 22433 raft_consensus.cc:2393] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:48.060039 22425 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:48.089711 22425 pending_rounds.cc:85] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 2
I20260709 13:06:48.089986 22425 pending_rounds.cc:107] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:48.090216 22425 raft_consensus.cc:2889] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.091720 22425 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:48.061085 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.986795 24305 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:48.068504 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:48.094772 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.071996 22503 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:48.072446 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:48.077368 22582 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:48.071012 22473 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:48.020712 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:48.096825 22578 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
W20260709 13:06:48.101365 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 59410us
I20260709 13:06:48.102741 22503 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.104031 22503 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.108043 22546 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:48.105182 24445 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:48.113485 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:48.114260 22499 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.114401 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:48.115089 22427 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.116809 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:48.117503 22501 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.117262 24402 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.118312 24463 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:48.081844 24081 raft_consensus.cc:697] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:48.019544 24468 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.121280 24096 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.122247 24339 consensus_queue.cc:1059] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:48.118800 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:48.123770 24339 raft_consensus.cc:3055] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:48.124194 24339 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:48.124749 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:48.073307 24386 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.081538 24178 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:48.099083 24130 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.113294 24445 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:48.127974 22316 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e32ba8e6132b4f8e98a99066b6fffe05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:48.134423 22505 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.135645 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:48.135946 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:48.098240 24387 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.105058 24330 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.142745 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:48.138916 24408 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.146462 24325 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:48.160326 22428 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.148195 24344 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:48.138792 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:48.156378 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:48.158727 24387 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.163383 22398 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:48.169068 24371 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:48.169665 24371 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.171202 22505 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:48.174053 22503 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:48.175278 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:48.176313 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:48.179128 22424 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:48.132894 24264 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.187779 22577 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:48.188656 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1145) took 1354 ms. Trace:
I20260709 13:06:48.191354 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:48.191807 22506 rpcz_store.cc:276] 0709 13:06:46.834276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.023310 (+189034us) service_pool.cc:224] Handling call
0709 13:06:47.023593 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.412294 (+388701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.188262 (+775968us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54003ea154. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:48.188575 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891929984}
I20260709 13:06:48.195685 22505 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.197957 24419 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.198495 24419 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.198813 24419 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.200857 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:48.201005 22396 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:48.201939 23841 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:48.191830 24330 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:48.203796 24330 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.206660 22573 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.207969 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:48.208777 22579 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:48.136551 24386 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.100623 24365 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.202353 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:48.160331 24470 raft_consensus.cc:3055] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.221132 22573 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.221655 23113 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:48.222280 24365 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:48.226230 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.187438 24428 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.228564 22581 raft_consensus.cc:2955] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:48.244344 24081 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.233664 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:48.237558 24030 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:48.239805 24408 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:48.241887 24393 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:48.226267 23108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 514) took 1427 ms. Trace:
I20260709 13:06:48.154734 24178 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.243789 24402 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:48.212095 24426 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:06:48.226857 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:48.281081 22501 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:48.282524 22501 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.250870 22499 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:48.285300 22499 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:48.231935 24419 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.219844 23841 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.268092 23108 rpcz_store.cc:276] 0709 13:06:46.798782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.824513 (+ 25731us) service_pool.cc:224] Handling call
0709 13:06:46.824825 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.171800 (+346975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.226035 (+1054235us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54006982d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:48.226209 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796146944}
I20260709 13:06:48.243129 24339 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.271927 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:48.277022 24030 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:48.246284 24470 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:48.266853 22508 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:06:48.291532 22508 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.294579 23841 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:48.295902 23841 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.299355 24420 raft_consensus.cc:3055] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.299819 24420 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:48.304250 24491 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.199s	user 0.003s	sys 0.000s
I20260709 13:06:48.260623 24483 consensus_queue.cc:1059] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:48.263917 24371 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.267668 24428 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:48.349625 24475 log.cc:927] Time spent T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.723s	user 0.002s	sys 0.000s
I20260709 13:06:48.353742 24373 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.355106 24445 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:48.355597 24387 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:48.334890 24470 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.330585 24420 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.364741 24428 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:48.367795 24178 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:48.371332 24470 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.372102 24420 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.382202 24371 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:48.393458 24130 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:48.725538 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.727454 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.582895 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.270272 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:48.729595 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 459346us
I20260709 13:06:48.730449 22503 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
W20260709 13:06:48.606006 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.605998 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.606647 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.731781 24176 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.732107 24178 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.732719 24178 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:48.616277 22427 consensus_meta.cc:287] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.006s
I20260709 13:06:48.631914 22508 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:48.732833 24176 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.733541 24183 consensus_queue.cc:1059] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:48.734884 24183 raft_consensus.cc:3055] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:48.735313 24183 raft_consensus.cc:740] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:48.735569 22508 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:48.657284 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1219) took 1766 ms. Trace:
I20260709 13:06:48.482961 24349 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.736647 22574 rpcz_store.cc:276] 0709 13:06:46.890399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.944741 (+ 54342us) service_pool.cc:224] Handling call
0709 13:06:46.994222 (+ 49481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.164889 (+1170667us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b18003ab1c0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f006c9ca4bc 00007f0069d1848b 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f006ce1a060 00007f006ce1abfb 00007f006ce2564b
0709 13:06:48.165029 (+   140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.165063 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.165588 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.655631 (+490043us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:48.656150 (+   519us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.656508 (+   358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.656660 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.656704 (+    44us) raft_consensus.cc:1685] finished
0709 13:06:48.656826 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.657055 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26717,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2678,"spinlock_wait_cycles":9772928,"thread_start_us":533861,"threads_started":2,"wal-append.queue_time_us":211834}
I20260709 13:06:48.739017 24268 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:48.683748 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.739914 24268 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.719945 24030 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:48.723127 24129 consensus_queue.cc:1059] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:48.741902 24129 raft_consensus.cc:3055] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:48.742460 24129 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:48.608913 22499 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:48.654474 22546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.004s	sys 0.015s
W20260709 13:06:48.743372 22546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.005s	sys 0.016s
W20260709 13:06:48.741925 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.393232 24419 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:48.743220 24385 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.525065 24468 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:48.717782 24015 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.743935 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 615707us
I20260709 13:06:48.746176 24030 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:48.757134 22579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.005s	sys 0.009s
I20260709 13:06:48.743201 24268 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:48.742128 22427 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:48.765439 24183 consensus_queue.cc:260] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.746399 24178 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:48.759855 22504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.009s	sys 0.004s
I20260709 13:06:48.778519 24330 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:48.779116 24425 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.779409 24330 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.782022 23076 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:48.782470 24330 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:48.783696 22579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.005s	sys 0.009s
I20260709 13:06:48.785125 24129 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.789361 24015 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.790172 22508 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:48.784196 24433 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.778414 24357 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:48.794374 24433 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.795121 24357 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.789930 24183 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:48.792068 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.796957 22504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.009s	sys 0.005s
I20260709 13:06:48.802556 23111 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:48.745993 24386 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.811590 24176 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:48.789819 24449 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:06:48.821306 24468 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.821331 23108 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:48.827718 24330 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:48.829133 23077 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:48.830402 23077 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:48.831252 24386 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:48.832080 24470 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.832901 24470 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.833812 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:48.825215 24468 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.840375 24463 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:48.838603 24468 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.844774 24015 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:48.836634 22505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.010s	sys 0.016s
W20260709 13:06:48.853443 22396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.001s	sys 0.013s
W20260709 13:06:48.854061 22396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.002s	sys 0.013s
W20260709 13:06:48.854632 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 638895us
I20260709 13:06:48.857532 22396 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:48.859266 24384 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.853978 24358 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:06:48.861917 22396 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:48.863667 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:48.855022 22505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.011s	sys 0.016s
W20260709 13:06:48.870497 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.871070 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:48.874482 24449 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:48.875375 24449 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.878173 24449 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:48.878443 24496 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.540s	user 0.003s	sys 0.006s
I20260709 13:06:48.884663 23106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59024 (request call id 251) took 1010 ms. Trace:
I20260709 13:06:48.885171 23106 rpcz_store.cc:276] 0709 13:06:47.873090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.880527 (+  7437us) service_pool.cc:224] Handling call
0709 13:06:48.863376 (+982849us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfdeee 0000000000375939 00007f0071d711e0 00007f0071e3a0c4 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:48.883003 (+ 19627us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19034880}
W20260709 13:06:48.856292 23107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.007s	sys 0.015s
I20260709 13:06:48.875205 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:48.887914 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1150) took 1392 ms. Trace:
I20260709 13:06:48.888597 24030 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:48.888329 22500 rpcz_store.cc:276] 0709 13:06:47.495987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.528749 (+ 32762us) service_pool.cc:224] Handling call
0709 13:06:48.874896 (+1346147us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfdeee 0000000000375939 00007f0071d711e0 00007f0071e3a0c4 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:48.887837 (+ 12941us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35147648}
I20260709 13:06:48.894855 22500 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.895823 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:48.896734 24385 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.897496 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:48.881732 24445 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.908324 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:48.909487 23110 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:48.896715 22580 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:48.920459 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:48.921490 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:48.921543 22430 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 1934) took 1302 ms (client timeout 1525 ms). Trace:
I20260709 13:06:48.923523 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1115) took 1020 ms. Trace:
W20260709 13:06:48.882309 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.000s	sys 0.017s
W20260709 13:06:48.923422 22430 rpcz_store.cc:269] 0709 13:06:47.621110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.626954 (+  5844us) service_pool.cc:224] Handling call
0709 13:06:48.920040 (+1293086us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:48.921452 (+  1412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8055040}
W20260709 13:06:48.924672 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.001s	sys 0.017s
I20260709 13:06:48.947880 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:48.949728 24129 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.950387 22545 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:48.951499 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 94613.6us
I20260709 13:06:48.953485 23077 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:48.839592 24425 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.948412 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:48.923967 22501 rpcz_store.cc:276] 0709 13:06:47.902963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.283444 (+380481us) service_pool.cc:224] Handling call
0709 13:06:48.289980 (+  6536us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:48.290375 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.290405 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:48.291011 (+   606us) log.cc:844] Serialized 52 byte log entry
0709 13:06:48.617468 (+326457us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:48.617558 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.617683 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.620328 (+  2645us) raft_consensus.cc:1685] finished
0709 13:06:48.620346 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.923061 (+302715us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b54003eb050. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:48.923308 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1824,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":15633,"spinlock_wait_cycles":14146432,"thread_start_us":8366,"threads_started":1,"wal-append.queue_time_us":8991}
I20260709 13:06:48.963950 24268 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.969017 24268 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:48.970890 22330 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.972491 24096 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:48.882721 24357 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:48.975775 24459 log.cc:927] Time spent T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 1.722s	user 0.014s	sys 0.000s
I20260709 13:06:48.979367 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:48.981879 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.988677 24294 raft_consensus.cc:3055] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.034614 24294 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:49.036244 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:48.990396 24217 raft_consensus.cc:993] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:06:49.037405 24217 raft_consensus.cc:1081] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:06:48.991097 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1108) took 1091 ms. Trace:
I20260709 13:06:49.038095 24096 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:48.919365 24433 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:48.992509 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59024 (request call id 256) took 1080 ms. Trace:
I20260709 13:06:49.039371 24478 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:48.993446 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 122582us
I20260709 13:06:49.038836 22505 rpcz_store.cc:276] 0709 13:06:47.899972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.200264 (+300292us) service_pool.cc:224] Handling call
0709 13:06:48.202793 (+  2529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.244286 (+ 41493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.244316 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.244812 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.869305 (+624493us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:48.869372 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.869487 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.990827 (+121340us) raft_consensus.cc:1685] finished
0709 13:06:48.990850 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.991042 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41101,"raft.queue_time_us":41242,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":623882,"threads_started":1,"wal-append.queue_time_us":739674}
I20260709 13:06:48.993971 24030 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.995193 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1116) took 1087 ms. Trace:
I20260709 13:06:49.041258 24030 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:49.041440 22507 rpcz_store.cc:276] 0709 13:06:47.907295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.955141 (+ 47846us) service_pool.cc:224] Handling call
0709 13:06:48.994833 (+1039692us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54003ab954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:48.995035 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760679296}
I20260709 13:06:48.995592 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:49.042616 22581 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.919482 24287 raft_consensus.cc:3055] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.045068 24287 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:49.046367 24287 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.996580 24470 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.049558 24357 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.999437 24081 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.050279 23113 rpcz_store.cc:276] 0709 13:06:47.912435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.916615 (+  4180us) service_pool.cc:224] Handling call
0709 13:06:48.049106 (+132491us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:48.992047 (+942941us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400206f54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:48.992257 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323775104}
I20260709 13:06:49.051137 24030 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.048039 24287 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.000422 24513 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:49.003683 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1149) took 1513 ms. Trace:
I20260709 13:06:49.006650 24507 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.007259 24449 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:49.055141 24513 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.055953 24449 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.057473 24513 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:49.057957 24449 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:49.009181 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:49.058795 23110 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.059917 24096 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:49.063741 24081 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:49.064867 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.010253 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.050189 24357 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:48.883407 24178 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.013145 22398 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:49.015489 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.018662 24425 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:49.019207 24196 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.020174 24339 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.019750 22330 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 2 to 4, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 4 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:49.021795 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47109.7us
I20260709 13:06:49.023486 22499 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.024456 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:49.027715 22547 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:49.021296 24358 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.030467 23841 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:49.031044 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:49.051644 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.092664 22430 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.030397 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:48.999545 24468 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.046408 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:49.069839 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 208039us
I20260709 13:06:49.091332 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:48.972005 24268 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:49.095289 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.097971 22505 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:49.099272 22433 raft_consensus.cc:2368] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5.
I20260709 13:06:49.036005 24294 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.097697 22330 catalog_manager.cc:5697] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 1 to 2, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 2 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:06:49.125126 24357 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:49.065371 22502 rpcz_store.cc:276] 0709 13:06:47.494124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.557854 (+ 63730us) service_pool.cc:224] Handling call
0709 13:06:47.622083 (+ 64229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.647557 (+ 25474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.003182 (+1355625us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b540021bbd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:49.003479 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50131328}
I20260709 13:06:49.142717 23113 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:49.064986 24081 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.138417 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1112) took 1237 ms. Trace:
W20260709 13:06:49.187937 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 163650us
I20260709 13:06:49.099094 24358 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:49.197445 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.128171 23106 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:49.139549 24217 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.124889 23841 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.148355 22427 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:49.141076 24433 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.213043 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:49.207643 22433 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:49.193713 24096 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.206779 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1162) took 1169 ms. Trace:
W20260709 13:06:49.217510 22472 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.525s (SENT) [suppressed 27 similar messages]
I20260709 13:06:49.208117 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:49.219383 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.221796 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 175549us
I20260709 13:06:49.222891 23841 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:49.224772 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 211921us
I20260709 13:06:49.224911 24433 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.225545 24433 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.227280 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.227694 24433 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:49.189123 24196 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.230033 24196 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:49.230933 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.233618 24486 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:49.234483 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 207209us
I20260709 13:06:49.237344 22545 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:49.238380 24449 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.238886 24449 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:49.239360 24449 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.240732 24507 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:49.240919 24478 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:49.241408 24507 raft_consensus.cc:697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:49.242503 24507 consensus_queue.cc:237] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.222084 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.215857 22330 catalog_manager.cc:5697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 1 to 2, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.248708 23104 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:49.250658 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.251381 22433 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:49.253485 24294 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.255455 22506 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:49.257895 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1111) took 1357 ms. Trace:
I20260709 13:06:49.258270 22506 rpcz_store.cc:276] 0709 13:06:47.900769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.213658 (+312889us) service_pool.cc:224] Handling call
0709 13:06:48.213920 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.255881 (+1041961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.257574 (+  1693us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400183dd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:49.257822 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310695296}
I20260709 13:06:49.259002 23077 leader_election.cc:400] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5.
I20260709 13:06:49.259402 23077 leader_election.cc:403] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.259554 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.260170 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:49.260418 24373 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.275801 22430 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:49.253500 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.261940 22474 leader_election.cc:400] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5.
I20260709 13:06:49.277237 22474 leader_election.cc:403] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:06:49.276580 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 51023.4us
I20260709 13:06:49.259940 22330 catalog_manager.cc:5697] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 1 to 2, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.205113 22504 rpcz_store.cc:276] 0709 13:06:47.900995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.230787 (+329792us) service_pool.cc:224] Handling call
0709 13:06:48.231111 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.231309 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:48.837778 (+606469us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.095201 (+257423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:49.103382 (+  8181us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:49.107713 (+  4331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.126401 (+ 18688us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.138355 (+ 11954us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5655,"prepare.queue_time_us":150719,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":3556,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":11622,"thread_start_us":753374,"threads_started":2}
W20260709 13:06:49.279037 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 69663.3us
I20260709 13:06:49.283005 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:49.286000 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 145315us
I20260709 13:06:49.293371 23112 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:49.295275 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.299225 22424 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:49.302026 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:49.303179 22578 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.278959 24015 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.305763 22577 raft_consensus.cc:2393] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:49.305578 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.208554 24384 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:06:49.310045 22576 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:49.317231 22425 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:49.312343 23079 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:49.320498 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.309024 24015 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.319870 24081 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.318815 24178 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:49.356714 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 134065us
I20260709 13:06:49.358289 22474 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:49.337788 22429 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:49.338171 22473 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:49.323370 24463 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:49.362902 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 50687.8us
I20260709 13:06:49.363533 22396 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:49.364225 23079 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:49.365641 24420 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.366231 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.367794 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:06:49.368731 24463 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.334298 24015 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.339100 22330 catalog_manager.cc:5697] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 1 to 2, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:49.337653 24524 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:06:49.374845 22330 catalog_manager.cc:5697] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.340848 23106 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:06:49.377514 24178 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.378134 22399 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:49.378386 24385 consensus_queue.cc:1059] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:49.342799 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1250) took 1132 ms. Trace:
I20260709 13:06:49.349717 24325 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.381192 24385 raft_consensus.cc:3055] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:49.366670 22575 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:49.361853 24393 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.383255 24393 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.378096 24178 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:49.389159 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 177812us
I20260709 13:06:49.318539 23107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 373) took 1385 ms. Trace:
I20260709 13:06:49.396399 22578 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:49.403443 22499 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
W20260709 13:06:49.401793 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 116917us
I20260709 13:06:49.406433 22581 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:49.412626 24130 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.413156 24130 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.413556 24130 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.413431 24339 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:49.381711 24385 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:49.370147 23110 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
W20260709 13:06:49.441776 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 76094.7us
I20260709 13:06:49.397033 22573 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:49.447552 22473 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:49.379850 22579 rpcz_store.cc:276] 0709 13:06:48.210540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.212545 (+  2005us) service_pool.cc:224] Handling call
0709 13:06:48.212855 (+   310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:48.851743 (+638888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.851811 (+    68us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:48.852867 (+  1056us) log.cc:844] Serialized 52 byte log entry
0709 13:06:49.089902 (+237035us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:49.106962 (+ 17060us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.125869 (+ 18907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.131240 (+  5371us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.342531 (+211291us) raft_consensus.cc:1685] finished
0709 13:06:49.342555 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.342722 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3495,"prepare.queue_time_us":34525,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":46126,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":6505,"thread_start_us":795041,"threads_started":2,"wal-append.queue_time_us":341745}
I20260709 13:06:49.452913 23105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 254) took 1437 ms. Trace:
I20260709 13:06:49.453521 24393 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:49.454238 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.453429 23105 rpcz_store.cc:276] 0709 13:06:47.895266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.896531 (+  1265us) service_pool.cc:224] Handling call
0709 13:06:48.966728 (+1070197us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:48.967098 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.967571 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:49.147052 (+179481us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.301245 (+154193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:49.308618 (+  7373us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:49.309691 (+  1073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.320172 (+ 10481us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.333013 (+ 12841us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":272832,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":20726,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":20305,"spinlock_wait_cycles":18948992,"thread_start_us":236667,"threads_started":2,"wal-append.queue_time_us":188293}
I20260709 13:06:49.456907 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.457578 22504 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:49.458508 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.459926 24373 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5.
I20260709 13:06:49.462013 22474 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:49.464051 24196 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:49.464553 24196 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.464967 24196 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.465427 24343 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:49.465951 24343 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.466305 24343 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:49.468189 24129 consensus_queue.cc:1059] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:49.469506 24445 raft_consensus.cc:3055] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.470036 24445 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:49.471019 24445 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.473512 23077 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:49.474602 24470 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:49.475174 24470 raft_consensus.cc:697] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:49.444335 24478 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.476025 24470 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.477001 24478 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.490582 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.492576 22330 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.464462 24426 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:49.505690 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:49.219090 22508 rpcz_store.cc:276] 0709 13:06:48.037649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.836295 (+798646us) service_pool.cc:224] Handling call
0709 13:06:48.848848 (+ 12553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.997332 (+148484us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:48.997723 (+   391us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.206465 (+208742us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:49.206520 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:49.206560 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.206617 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.206726 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":383,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":8466,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":9300,"thread_start_us":199685,"threads_started":1,"wal-append.queue_time_us":246599}
I20260709 13:06:49.481228 24445 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.499924 23112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 257) took 1501 ms. Trace:
I20260709 13:06:49.501308 24330 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:49.502898 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.480633 22573 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.459833 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.481956 24478 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:49.519765 24385 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.509351 23112 rpcz_store.cc:276] 0709 13:06:47.998346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.067546 (+ 69200us) service_pool.cc:224] Handling call
0709 13:06:48.865494 (+797948us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:06:48.865797 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.293913 (+428116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.499614 (+205701us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54005069d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:49.499848 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562146560}
I20260709 13:06:49.510969 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:49.417186 24425 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:06:49.487113 24433 consensus_queue.cc:1059] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:06:49.512421 24129 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.515758 24358 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:49.516520 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.516666 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.539839 22577 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:49.517315 22424 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:49.519202 24468 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:49.515995 24325 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5.
I20260709 13:06:49.523141 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.524194 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.524420 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.524638 24343 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.567632 22399 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:49.526134 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.530614 24178 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:49.510186 24096 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:49.531978 22330 catalog_manager.cc:5697] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.539158 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:49.548054 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.549438 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.566825 22506 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:49.577483 22581 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:06:49.569999 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63857.9us
I20260709 13:06:49.570329 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.579412 24507 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:49.580066 24507 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.580448 24325 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:49.581173 24325 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:49.581528 24325 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.583142 24397 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:49.583987 24129 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.586390 24129 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:49.586992 24129 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.587502 24129 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.587800 22472 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:49.589015 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:49.589627 22501 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.590284 24325 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:49.592567 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.592814 22500 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:49.593429 24330 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.594033 24330 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.594879 24096 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.602530 24196 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.604745 24385 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.605504 24400 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:49.538898 24426 raft_consensus.cc:697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:49.615491 22575 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:49.619704 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.617900 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:49.566228 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.623075 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:49.625349 22582 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.624281 22506 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:49.593387 24478 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.633595 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 58025.6us
I20260709 13:06:49.615068 24358 raft_consensus.cc:3055] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:49.607738 24449 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.637401 24400 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:49.637605 24393 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.637916 24400 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.638159 24176 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:49.638437 24449 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:49.627786 24386 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.639868 24393 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.640525 24386 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:49.642639 24386 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:49.642863 24393 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:49.640149 24176 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.634991 24358 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:49.644434 22501 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:49.652878 24358 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.654316 24358 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.654458 22508 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:49.653388 24176 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:49.640239 24330 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:49.657747 24507 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:49.659390 24096 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:49.660704 24393 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:49.661592 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.662513 22424 raft_consensus.cc:2410] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:49.663408 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:49.636188 24294 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:49.666141 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 218757us
I20260709 13:06:49.617496 24397 raft_consensus.cc:697] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:49.592864 24325 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:49.622725 24373 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:49.699050 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 114149us
W20260709 13:06:49.702690 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 207371us
I20260709 13:06:49.704804 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:49.700292 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:49.708010 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:49.702385 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.713546 22424 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:06:49.719614 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 131876us
I20260709 13:06:49.713076 23112 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:49.722132 22428 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.666438 24433 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.723030 22473 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:49.707459 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.725538 22427 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.726506 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:49.729394 24196 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:49.731201 24371 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:49.699563 22502 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:49.732666 24426 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.732651 22428 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:49.733754 24486 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:49.734753 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.732393 23079 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:49.639662 24478 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.703621 22574 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:06:49.650465 24357 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:06:49.718672 24373 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:49.753381 22432 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:49.764425 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.754634 22472 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:49.756008 22431 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:49.766232 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:49.756336 22425 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:49.666529 24393 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.711941 24294 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:49.752259 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.760567 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:49.763590 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:49.768350 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:49.782023 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49703.7us
I20260709 13:06:49.753419 24325 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.766366 22472 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:49.772099 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:49.776932 24541 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.784704 22578 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:49.752655 24330 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:49.784077 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.747792 24096 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:49.802381 24448 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.781301 24486 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.806326 24486 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:49.812165 22580 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:49.813172 22398 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:49.816195 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:49.816990 22580 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:49.759604 24425 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:06:49.792277 24541 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.785748 24325 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:49.721732 24397 consensus_queue.cc:237] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.843902 22425 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:49.868355 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 55285.6us
I20260709 13:06:49.868817 22431 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:49.869762 22398 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:49.819895 24129 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:49.860834 24496 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:49.844313 24178 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.883433 24305 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.885036 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.880365 22580 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:06:49.888386 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.889293 22427 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:49.850853 24325 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.401204 23107 rpcz_store.cc:276] 0709 13:06:47.925652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.019750 (+ 94098us) service_pool.cc:224] Handling call
0709 13:06:48.083652 (+ 63902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.137270 (+ 53618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.151134 (+ 13864us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.249037 (+ 97903us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.887537 (+638500us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:49.191186 (+303649us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.209416 (+ 18230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.218678 (+  9262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.243171 (+ 24493us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b1800138e80. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:06:49.220524 (+-22647us) raft_consensus.cc:1685] finished
0709 13:06:49.292618 (+ 72094us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.310551 (+ 17933us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6118,"prepare.queue_time_us":315451,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":8044,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":29626,"spinlock_wait_cycles":4748544,"thread_start_us":846528,"threads_started":2,"wal-append.queue_time_us":498068}
W20260709 13:06:49.919745 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 138547us
I20260709 13:06:49.890924 22428 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:49.892243 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:49.892493 24439 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:49.944065 22431 raft_consensus.cc:2410] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:49.943888 24439 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.893867 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.889572 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:49.902755 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 121673us
I20260709 13:06:49.917724 22429 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.922582 22472 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:49.864192 24541 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.922641 22427 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:49.924911 24294 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.926051 24349 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.926815 24393 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:49.930701 24015 consensus_meta.cc:287] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 13:06:49.921559 24305 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:06:49.934044 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.935242 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.937065 22507 raft_consensus.cc:2410] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:49.937089 24552 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:06:49.964252 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.969823 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:49.804288 24373 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.963948 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.840416 24096 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.942366 24400 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:49.825317 24330 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.891244 24343 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:49.943046 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.893121 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.945737 22428 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:49.947947 22582 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:49.950716 22424 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:49.944808 22398 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:49.940284 24130 consensus_meta.cc:287] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.001s
I20260709 13:06:49.965930 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.868167 24465 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:06:49.967576 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:49.967878 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.960013 24287 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:50.012713 22433 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:49.969975 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.987679 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:49.990525 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.983035 24543 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.252s	user 0.003s	sys 0.000s
I20260709 13:06:49.930513 24545 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.974965 24449 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:49.970211 22547 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:50.009500 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:50.032172 22582 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:49.963557 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:50.013682 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.968999 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.970456 24445 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:50.015687 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 141129us
W20260709 13:06:50.024837 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.971244 23105 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:50.027673 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:50.016083 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.973814 24268 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.979905 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:49.977347 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:49.973927 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:49.973587 24178 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.031407 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:50.048791 22427 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:49.972210 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:49.963621 24081 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:50.037125 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48147.6us
I20260709 13:06:50.038004 22424 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:50.038538 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:50.037213 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.039775 24445 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.043957 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:50.043586 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 73986.9us
I20260709 13:06:50.049644 22500 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:49.994530 24015 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:49.976331 22573 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:50.073734 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 79549.8us
I20260709 13:06:50.074625 22545 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:50.077957 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.081194 22546 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.012813 24130 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.085268 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.088687 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:49.968390 24548 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.193s
I20260709 13:06:50.061688 24445 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.048146 24343 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.048574 24393 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.051579 24349 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.061976 24339 raft_consensus.cc:2764] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:06:50.097951 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 127846us
I20260709 13:06:50.101516 22396 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.104667 22424 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:50.093703 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:50.046095 24287 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.114029 24569 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:50.080403 24420 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.052021 24268 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.125284 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:50.107128 22426 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:50.063079 24081 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.062734 24178 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.118729 24393 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.086105 24449 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.174171 24264 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:50.177819 24096 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:50.179582 24130 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:50.181767 24268 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:50.182473 22429 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:50.183804 24178 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.184908 24439 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.185540 24287 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:50.186139 24393 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.186559 24387 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.188977 24015 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:50.170737 24339 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:50.201969 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 87938.3us
I20260709 13:06:50.207648 22472 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:50.240093 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 131903us
W20260709 13:06:50.207690 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 137210us
I20260709 13:06:50.262641 22546 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.181960 24081 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:50.190419 24420 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.159853 24507 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.116432 24343 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.273488 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:50.274469 24561 log.cc:927] Time spent T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:06:50.158033 24349 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.280550 24349 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.218786 24339 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.246953 24096 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.267635 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.285540 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:50.259790 24564 log.cc:927] Time spent T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:50.189946 24264 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.274542 22577 raft_consensus.cc:3055] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:50.260367 24548 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.278331 24343 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:50.281957 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 74381.7us
I20260709 13:06:50.294828 22577 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:06:50.297473 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 93538us
I20260709 13:06:50.301184 22472 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:50.284929 24339 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:50.304432 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 143333us
I20260709 13:06:50.308800 24449 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:50.298084 24400 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.309281 24264 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:50.285702 24268 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:06:50.304631 24569 raft_consensus.cc:697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:50.315672 24569 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.319031 22503 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:50.325842 24478 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:50.327104 23111 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.356459 22432 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:50.356734 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:50.357704 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:50.360185 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53974.6us
I20260709 13:06:50.293972 24287 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:06:50.362744 24096 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:50.365301 24420 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.306761 24130 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:50.367699 24130 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:50.368147 24130 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.368381 22573 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:50.369071 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:49188 (request call id 1266) took 1061 ms. Trace:
I20260709 13:06:50.369423 22573 rpcz_store.cc:276] 0709 13:06:49.312948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.367641 (+ 54693us) service_pool.cc:224] Handling call
0709 13:06:50.368945 (+1001304us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:50.371598 24562 log.cc:927] Time spent T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
W20260709 13:06:50.386926 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 119394us
I20260709 13:06:50.390260 22499 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:50.463876 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:50.465835 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.467376 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.468098 22508 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:50.469129 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:50.469796 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.470646 22503 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
W20260709 13:06:50.523756 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 162646us
W20260709 13:06:50.522631 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 134770us
W20260709 13:06:50.525548 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 367717us
I20260709 13:06:50.523748 22508 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.525458 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.529574 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.534622 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.535566 22507 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:50.540993 22547 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.472522 24096 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:50.523114 24349 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.549201 22500 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:50.557313 24566 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:50.563452 22547 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.556064 24572 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.569003 22396 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.548317 24264 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:50.575136 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 50053.3us
I20260709 13:06:50.531232 24478 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:06:50.537201 24420 consensus_queue.cc:1059] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:06:50.604965 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:50.546325 24287 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:06:50.610688 22581 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.609578 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:50.563269 24349 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.580154 24400 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:50.626560 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 57621us
I20260709 13:06:50.611879 24572 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.598126 24581 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:06:50.630184 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:50.629659 24373 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.640687 24096 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.638576 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:50.642294 24264 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.628556 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:50.645185 22503 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:50.607676 24578 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.630903 24081 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:50.625495 24445 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.662906 22508 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:50.672936 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:50.675567 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:50.665617 24325 consensus_meta.cc:287] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.003s
I20260709 13:06:50.654402 22573 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:50.678638 22507 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:50.676535 24463 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:50.681814 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:50.682116 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:50.688758 22574 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:50.688545 24463 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.690999 24463 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:50.652334 24572 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.657950 24393 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.671262 23105 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:50.685187 24325 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.645569 24571 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:50.698745 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.655822 24373 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.674973 24478 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.709782 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:50.742437 22508 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:50.744920 24445 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.752156 22546 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.762260 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.721097 24130 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.772573 24081 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:50.773910 23105 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:50.749567 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:50.775311 22574 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:50.775950 24373 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.776405 24130 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.777748 24325 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:50.778710 24541 consensus_meta.cc:287] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.772s	user 0.003s	sys 0.007s
I20260709 13:06:50.719854 24507 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:06:50.756810 24581 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.726352 24264 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:06:50.758589 24287 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.761226 24584 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.779524 24397 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:50.779898 24178 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.787492 24081 consensus_queue.cc:1243] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer e32ba8e6132b4f8e98a99066b6fffe05 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:06:50.794337 24554 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.865s	user 0.005s	sys 0.007s
I20260709 13:06:50.795727 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.779160 24541 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.800382 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1128) took 1264 ms. Trace:
I20260709 13:06:50.761583 24478 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.800804 22501 rpcz_store.cc:276] 0709 13:06:49.536462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.648222 (+111760us) service_pool.cc:224] Handling call
0709 13:06:49.665402 (+ 17180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.665736 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.665763 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.700036 (+ 34273us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.841888 (+141852us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:49.841948 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.842062 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.793734 (+951672us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:50.800071 (+  6337us) raft_consensus.cc:1685] finished
0709 13:06:50.800096 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.800320 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18878,"raft.queue_time_us":643,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":28730,"spinlock_wait_cycles":36504960,"thread_start_us":82463,"threads_started":1,"wal-append.queue_time_us":186983}
I20260709 13:06:50.803298 22580 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:50.803848 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.804322 24541 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:50.804510 22501 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:50.797709 24589 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:50.804936 24478 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:50.783825 24420 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.805637 24420 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.807902 24420 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.808327 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.813896 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.814757 24590 raft_consensus.cc:3055] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:50.815207 24590 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:50.815653 24393 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:50.816188 24590 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.816613 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:50.817579 24590 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:50.819866 24547 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 1.089s	user 0.008s	sys 0.008s
I20260709 13:06:50.792182 24584 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.822680 24584 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.824486 24339 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:06:50.827318 22316 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e32ba8e6132b4f8e98a99066b6fffe05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:50.798267 24178 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.794116 24397 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.829006 24578 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:50.832801 24178 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.848793 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:50.829423 24578 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:50.852843 23112 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:50.817663 23105 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.855957 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:50.862906 22501 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:06:50.856699 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 61028us
I20260709 13:06:50.861690 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.864725 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.863873 22503 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:50.866307 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:50.868777 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.896575 22545 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:50.855788 24349 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.902495 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.904768 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:50.906009 24578 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.921329 22501 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:50.910197 24373 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.917155 24397 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:50.860687 24589 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:50.865725 24081 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:50.870602 24507 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:50.902822 24264 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.901906 24478 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.929136 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1277) took 1122 ms. Trace:
I20260709 13:06:50.901768 24581 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.931288 24590 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.937182 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:50.923419 24096 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:50.922813 24555 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.941699 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:50.946619 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:50.947827 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:50.948598 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:50.949326 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:50.950044 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:50.950168 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:50.950969 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:50.960703 22433 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:50.962194 22425 raft_consensus.cc:3055] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:50.935593 22579 rpcz_store.cc:276] 0709 13:06:49.806648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.045121 (+238473us) service_pool.cc:224] Handling call
0709 13:06:50.045389 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.045629 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:50.114302 (+ 68673us) log.cc:844] Serialized 14 byte log entry
0709 13:06:50.823338 (+709036us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b18003eee40. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f006ce1a060 00007f006ce2c716 00007f006ce3d287 00007f006ce3d208
0709 13:06:50.928817 (+105479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.928870 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:50.928925 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.928989 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.929088 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33123,"prepare.queue_time_us":69386,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":782,"raft.queue_time_us":85323,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":14378,"spinlock_wait_cycles":12892928,"thread_start_us":140515,"threads_started":2}
I20260709 13:06:50.968288 22425 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:50.968966 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:50.969820 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:50.969738 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:50.970813 22578 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.969133 22545 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:50.969013 22428 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:50.934204 24264 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:50.978225 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:50.936878 24507 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:50.939244 24590 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.927014 24373 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:50.987411 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:50.988381 24571 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:50.989207 22545 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:50.989864 24569 consensus_queue.cc:1059] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:50.987449 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:50.987454 24589 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.959800 24096 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.005448 22427 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:50.980075 24264 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:51.008180 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.977331 22425 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.979596 24081 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:51.013059 24507 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:50.973557 24555 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.011591 24096 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.017776 24555 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.018353 24555 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:51.012467 22425 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.018894 24555 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.001647 23105 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:51.000031 24590 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.022742 22578 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
W20260709 13:06:51.032407 24550 log.cc:927] Time spent T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.219s	user 0.013s	sys 0.000s
I20260709 13:06:51.036409 24571 raft_consensus.cc:697] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:51.025914 24081 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.041391 24081 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.042012 24081 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.049693 22425 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
W20260709 13:06:51.048728 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 107129us
I20260709 13:06:51.055034 22429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 1967) took 1043 ms. Trace:
I20260709 13:06:51.055540 22429 rpcz_store.cc:276] 0709 13:06:50.011166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.014018 (+  2852us) service_pool.cc:224] Handling call
0709 13:06:51.054838 (+1040820us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003acad4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:51.054965 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293471616}
I20260709 13:06:51.058323 23079 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:51.035056 24601 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.067041 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:51.104888 22577 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.106551 22577 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.110942 24330 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:51.112387 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1190) took 1161 ms. Trace:
I20260709 13:06:51.112895 22502 rpcz_store.cc:276] 0709 13:06:49.950767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.969133 (+ 18366us) service_pool.cc:224] Handling call
0709 13:06:49.969476 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.062475 (+ 92999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.073024 (+ 10549us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.082552 (+  9528us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:50.090883 (+  8331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.112092 (+1021209us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b54003c8054. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:51.112152 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.112317 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187617152}
I20260709 13:06:51.092833 24603 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.129096 24607 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:51.129805 24607 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.132287 24607 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:51.096396 23105 raft_consensus.cc:2376] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5. Re-sending same reply.
I20260709 13:06:51.136754 24607 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.137631 24607 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.037632 24571 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.154129 24096 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.161118 24607 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:51.163936 24573 raft_consensus.cc:3055] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:51.146857 24373 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.179641 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:51.187902 23112 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:51.181087 24603 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:51.186496 22577 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:51.189354 24577 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:06:51.189043 24603 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.190112 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1282) took 1307 ms. Trace:
I20260709 13:06:51.190593 22577 rpcz_store.cc:276] 0709 13:06:49.882445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.274077 (+391632us) service_pool.cc:224] Handling call
0709 13:06:50.274379 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.104381 (+830002us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b4c0026de80. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b0eea20 00007f006b0ffa29 00007f006b0c5644 00007f006b0ecf2d 00007f006b0ecb93 00007f006ce1d18b 00007f006ce1dcb5 00007f006ce18f30 00007f006ce1a7de 00007f006ce24b49 00007f006ce25416
0709 13:06:51.189031 (+ 84650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.190045 (+  1014us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7848832}
I20260709 13:06:51.191457 24603 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:51.193465 22396 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:51.197608 22396 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:51.198534 22396 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:51.195670 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:51.201397 24176 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.201815 24176 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.202172 24176 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.204133 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:51.204698 22396 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:51.204983 23107 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:51.205304 24183 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.205826 24587 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.206321 24587 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.206694 24587 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.162205 24096 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:51.210700 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:51.184155 24573 raft_consensus.cc:740] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:51.187479 24264 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.211930 24573 consensus_queue.cc:260] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.213145 24264 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:51.213892 24573 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.213598 24386 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:51.216135 22396 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:51.200457 24385 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.218818 24584 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.205096 24081 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.264956 24397 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.264878 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.265247 24584 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.265523 24397 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.265952 24397 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.264513 24445 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.266763 24445 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.267459 24081 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:51.225814 24572 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:51.268179 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:51.265748 24584 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.228997 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:51.235921 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:51.236526 24578 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.237224 22547 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:51.271517 22547 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:51.272644 24081 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.273350 24081 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.274991 24384 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.275890 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:51.276659 24572 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.264971 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:51.278292 22430 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.244673 24339 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:51.200248 24590 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.250720 24483 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.252103 24567 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:51.252947 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1275) took 1447 ms. Trace:
I20260709 13:06:51.253350 24541 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.253933 24546 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:51.254585 24439 consensus_queue.cc:1059] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:51.255717 24294 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:51.256748 24349 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.257026 24544 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.257225 24425 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.257673 24426 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.258049 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.321506 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:51.322276 22428 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:51.252333 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:51.260419 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.322654 22424 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:06:51.322945 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 70690.2us
I20260709 13:06:51.261628 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.262961 22474 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:51.264050 24330 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.329409 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:51.263636 24176 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:51.267000 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:51.279474 22398 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:51.280350 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:51.282634 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 66602.3us
I20260709 13:06:51.227344 24587 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.287149 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:51.287554 24589 raft_consensus.cc:3055] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:51.288794 22574 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:51.290222 24397 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.290628 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:51.290867 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:51.277170 24572 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.288080 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:51.287621 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:51.295158 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:51.299366 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:51.307575 22582 rpcz_store.cc:276] 0709 13:06:49.805911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.042568 (+236657us) service_pool.cc:224] Handling call
0709 13:06:50.053438 (+ 10870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.180844 (+127406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.180887 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.180931 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:50.180964 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.252698 (+1071734us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400086454. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:51.252749 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.252883 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292470016}
I20260709 13:06:51.311321 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:51.314793 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.296542 24584 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.310065 24483 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.372658 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:51.372874 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:51.372512 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:51.373394 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:51.376111 22500 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:51.342437 22580 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:51.332993 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:51.315012 24546 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.314021 24567 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.378605 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:51.622429 24445 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.622974 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:51.623121 24445 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.613524 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:51.624782 24572 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:51.331853 24426 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:51.536661 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.629313 24426 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:51.391002 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.630975 22574 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:51.632750 22499 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:51.633212 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:51.633425 23112 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:51.633837 22505 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:51.608215 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 328798us
I20260709 13:06:51.637001 22503 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:51.640710 24603 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.641286 23105 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:51.529681 22430 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:51.640395 22501 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:51.644439 22506 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.449856 22578 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:51.610395 24339 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:51.654438 22582 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 13:06:51.331162 24325 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.332098 24425 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.379359 24589 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:51.378916 24400 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.658624 22576 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.609967 24357 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:51.313103 24541 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.320923 24544 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.658645 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:51.667513 22577 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:51.718221 22433 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:51.472141 22573 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:51.667837 22425 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:51.717412 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.470993 24349 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.541282 24448 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:06:51.726392 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 463480us
I20260709 13:06:51.644053 22507 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.731721 22505 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
W20260709 13:06:51.697374 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.316282 24294 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:51.748929 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 362673us
I20260709 13:06:51.699681 22398 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:51.643393 24578 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:51.753118 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:51.751541 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:51.757962 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:51.760664 22578 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
W20260709 13:06:51.762063 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 103503us
I20260709 13:06:51.763007 22546 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:51.729638 24617 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:06:51.735947 24264 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.660285 24463 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.766340 22505 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:51.711265 24176 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.373598 24330 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.735208 24571 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.796085 24571 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.796842 22399 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:51.793716 24463 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.798220 24571 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:51.798930 24264 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.799979 24463 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:51.767047 24483 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:51.659437 24325 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.820374 24325 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.823359 24349 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:51.768666 22503 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:51.769923 24619 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.825333 24619 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.826967 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.827579 24619 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.828116 24619 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.770248 24555 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:51.773222 24287 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.768714 24590 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:51.775904 22502 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:51.829499 24425 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.830329 22577 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:51.712039 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:51.831049 24544 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.831784 24544 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:51.832093 24445 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.832824 24546 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.832612 24445 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.833081 24555 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:51.834790 24555 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:51.835318 24555 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:51.836756 24555 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.838012 24555 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:51.831064 22574 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
W20260709 13:06:51.839414 24573 consensus_meta.cc:287] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.000s
I20260709 13:06:51.778157 24578 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.841928 24578 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:51.787388 24577 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.842720 24541 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.784193 22506 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:06:51.785709 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:51.775800 24183 consensus_meta.cc:287] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.004s
I20260709 13:06:51.790586 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:51.844412 22424 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.674036 24607 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.791225 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.846196 23079 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:51.847465 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.854230 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:51.828182 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.858140 22430 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:51.641281 24603 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.793967 24387 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:51.764585 24448 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.793720 24081 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:51.750262 24357 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:51.801868 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 102275us
I20260709 13:06:51.803067 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:51.808568 22427 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:51.809026 24400 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.809520 24386 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:51.810060 24470 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:51.810766 24601 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:51.656831 24339 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.811587 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:51.813324 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:51.814220 24589 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.819578 24130 raft_consensus.cc:3055] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:51.730002 24397 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.859649 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.862006 24607 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.859982 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:51.936688 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 76774.1us
I20260709 13:06:51.674386 24384 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.183s
I20260709 13:06:51.869097 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:51.869768 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 66794.2us
I20260709 13:06:51.855460 24463 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.852203 24183 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.832291 24544 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.849095 24587 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.874642 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:51.867605 24387 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.929546 24130 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:51.927692 22433 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:51.929203 22424 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
W20260709 13:06:51.876148 24449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.506s	user 0.017s	sys 0.020s
I20260709 13:06:51.861585 22428 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:51.934474 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:51.956691 24571 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.938905 22432 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:51.941337 22425 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:06:51.884280 23111 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:51.952644 24330 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.954324 24264 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:51.955367 22427 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:51.860239 24619 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:51.948606 24584 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.945116 24589 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.942726 24463 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.961599 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:51.948598 24448 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:51.924432 24386 raft_consensus.cc:697] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:51.965416 24130 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:51.966606 24357 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:51.973062 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:52.022723 22506 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:51.973912 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:51.975626 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:51.976841 22502 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:51.978415 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:51.979542 22504 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:51.940308 24287 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.875312 24483 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:51.991690 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 57321us
I20260709 13:06:51.992080 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.028965 22425 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:52.029037 22545 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.030184 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:51.986856 24449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.619s	user 0.017s	sys 0.020s
W20260709 13:06:52.006727 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 255276us
I20260709 13:06:52.005123 24264 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.956562 24590 consensus_queue.cc:1059] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:52.018093 22507 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:06:51.990010 24571 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:51.998901 22432 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:52.007308 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.033068 22576 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:06:52.033171 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:52.046923 22474 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:52.015074 24463 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.052588 22580 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: [2.5-3.6]
W20260709 13:06:52.053969 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.054438 22505 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:52.055760 22506 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:52.028718 24567 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:52.060655 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.061985 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:52.064284 23112 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:52.062876 22474 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.031519 24578 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:52.065984 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.042470 24425 raft_consensus.cc:2764] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:06:52.068802 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.037716 24130 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:52.036203 24483 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:52.038532 24294 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:52.053983 24571 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.121464 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:52.153118 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:52.058809 24448 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:52.157861 23113 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:52.038897 24287 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.217278 22428 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:52.185843 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.183786 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.166971 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:52.175632 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.221117 22579 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
W20260709 13:06:52.160631 24624 log.cc:927] Time spent T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:06:52.067122 24578 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.233843 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:52.160153 24625 log.cc:927] Time spent T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:06:52.121191 24621 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.067467 24264 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.058722 24357 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:52.235807 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 167056us
I20260709 13:06:52.237954 22507 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:52.154343 24183 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.181913 24330 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.245280 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 300275us
I20260709 13:06:52.237087 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:52.161518 24603 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:52.172583 24620 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:52.160600 24546 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.257249 22474 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:52.238915 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 206969us
I20260709 13:06:52.267766 22545 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.067165 24349 raft_consensus.cc:2764] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:52.271054 22474 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.154654 24567 consensus_queue.cc:1059] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:06:52.165557 24325 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.239740 24578 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.272061 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:52.240417 24439 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.263942 24622 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.242589 24621 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.159813 24483 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.288542 22507 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:06:52.232409 24448 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.068187 24445 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:52.237811 24463 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.071826 24579 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.197s
I20260709 13:06:52.306360 22500 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:52.270155 24357 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:52.279578 24426 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.266178 24330 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.162721 24386 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.299132 22399 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:52.331812 22503 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:52.361827 23076 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.338943 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:52.265841 24183 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.295258 24633 raft_consensus.cc:2764] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:52.071619 24400 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.200s
I20260709 13:06:52.306838 24544 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:52.317031 24621 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.365065 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.305441 24590 consensus_queue.cc:1243] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer e32ba8e6132b4f8e98a99066b6fffe05 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:52.278966 24546 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.372218 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.389798 22581 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:52.372951 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.391119 22579 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:52.281512 24620 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:52.377897 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 78844.5us
I20260709 13:06:52.392947 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:52.379446 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.393735 22577 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:52.305449 24385 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:06:52.294587 24607 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:52.408646 24607 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:52.409171 24607 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:52.409981 24607 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.343636 24572 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.396402 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.375473 24615 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:52.401017 24330 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:52.396590 24637 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.401042 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.405762 24287 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:52.376612 24264 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:06:52.419538 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 82841us
I20260709 13:06:52.396880 24590 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:52.482837 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 89948.3us
W20260709 13:06:52.467017 24624 log.cc:927] Time spent T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:06:52.468230 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.406900 24571 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.473476 22396 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.381443 24470 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:52.479984 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.376139 24541 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:06:52.375636 24445 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:52.385772 24644 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.502995 22577 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:52.515223 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.524355 22580 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
W20260709 13:06:52.520445 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47066us
W20260709 13:06:52.521215 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 652666us
I20260709 13:06:52.526299 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.529207 22399 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:52.531091 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.470489 24615 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.483259 24590 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:52.478456 22574 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:52.489657 24439 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:52.468648 24572 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.516034 24400 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.519562 24470 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.527149 24579 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:52.528785 24449 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:06:52.566026 24643 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:06:52.567571 24636 log.cc:927] Time spent T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:06:52.567858 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:52.569031 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:52.569438 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.569639 22499 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:52.570127 22574 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:52.570533 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:52.571640 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:52.572690 24325 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:52.574342 24571 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:52.575628 24546 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:52.535714 24397 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:52.576534 24439 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.578357 24463 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:52.578656 24645 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:06:52.578763 24183 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:52.548935 24590 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:52.607686 24639 log.cc:927] Time spent T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:06:52.608357 22533 heartbeater.cc:646] Failed to heartbeat to 127.20.208.62:33169 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.208.62:33169 timed out after 15.000s (SENT)
I20260709 13:06:52.529331 24644 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.609127 24448 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:52.526540 24445 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.520679 24637 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:06:52.609957 24400 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.610353 24400 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.610718 24400 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.610562 24449 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.556066 24470 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:52.611868 24629 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
W20260709 13:06:52.619357 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 382347us
W20260709 13:06:52.619256 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 93412.5us
I20260709 13:06:52.618508 22474 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.622031 22474 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.520367 24357 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:52.612671 24589 consensus_meta.cc:287] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.010s
I20260709 13:06:52.624529 22474 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:06:52.625676 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 96567.2us
I20260709 13:06:52.627940 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.663065 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:52.667439 24339 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:52.668048 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:52.617556 23107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 267) took 1336 ms. Trace:
I20260709 13:06:52.672199 22577 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:52.614324 24620 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:52.625294 24325 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:52.670168 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 402453us
I20260709 13:06:52.670791 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:52.710384 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.710939 24397 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.711601 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.711460 24397 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.712767 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.713222 24658 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:52.713655 24397 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:52.713860 24658 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.670941 22474 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.619887 24579 raft_consensus.cc:697] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:52.706143 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:52.718684 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.706853 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:52.719363 22577 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:52.708536 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:52.720139 22578 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:52.625440 24546 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.721930 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.712782 24445 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:52.725556 24445 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.726002 24445 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.727212 22575 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:52.727653 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.727049 22545 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.721369 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.730870 22428 raft_consensus.cc:2410] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:52.732108 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.729230 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.612360 24264 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.674593 24655 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:52.720850 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49975.1us
I20260709 13:06:52.709060 24590 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.722210 24546 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:52.726416 24445 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.739879 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.741173 24615 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:52.741588 24339 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:52.742228 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.757390 22424 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:52.758276 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.758834 22424 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:52.759610 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.746284 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.747035 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.705991 24325 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:52.760833 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.750764 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:52.754053 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:52.755342 22399 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:52.765810 22428 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:52.766716 22474 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.767889 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:52.768550 22474 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.736420 22427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
W20260709 13:06:52.820077 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 62732.8us
I20260709 13:06:52.821434 22545 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:52.822992 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:52.825819 22503 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.748333 24655 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:52.726732 24400 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.756515 24384 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:06:52.756832 24546 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.841859 22581 raft_consensus.cc:1240] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:52.728328 24555 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:52.827703 22427 raft_consensus.cc:606] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:52.748013 24572 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:52.827549 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:52.834724 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 79436.4us
I20260709 13:06:52.844122 22399 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:52.764165 24325 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.836242 22545 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:52.753335 24387 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:52.830857 24330 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:52.831902 24339 raft_consensus.cc:697] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:52.829881 24622 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:52.854527 22432 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:52.831861 24620 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.833020 24655 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.829679 24603 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:52.857609 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 1979) took 1589 ms. Trace:
I20260709 13:06:52.826622 24658 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:52.856854 24330 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.857633 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.832134 24468 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:52.840931 24571 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:52.853919 24638 log.cc:927] Time spent T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:06:52.860167 24622 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:52.877108 24603 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.867035 22431 rpcz_store.cc:276] 0709 13:06:51.259044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.259169 (+   125us) service_pool.cc:224] Handling call
0709 13:06:51.259555 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.674644 (+415089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.674676 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.699086 (+ 24410us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.989048 (+289962us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.238664 (+249616us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.240499 (+  1835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.409801 (+169302us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540043c954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:52.409848 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.845424 (+435576us) raft_consensus.cc:1685] finished
0709 13:06:52.848403 (+  2979us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.848577 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1945,"prepare.queue_time_us":373640,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":20228,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":6932,"spinlock_wait_cycles":909842688,"thread_start_us":454976,"threads_started":2,"wal-append.queue_time_us":503476}
I20260709 13:06:52.877910 24621 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.849490 24385 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.854341 24268 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:52.896144 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 369778us
I20260709 13:06:52.862742 24620 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:52.918038 22505 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:52.893862 24339 consensus_queue.cc:237] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:52.924702 24654 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 13:06:52.924261 24661 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:06:52.886418 24622 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:52.884232 24330 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:52.885192 24468 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:52.942960 22507 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:52.929486 24620 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.947615 22503 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:06:52.857462 24662 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:52.876360 24651 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:06:52.881934 24664 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:52.961004 24468 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.962169 24468 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.835791 24579 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:52.921561 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:52.888815 24571 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:52.969890 24664 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:52.978592 22573 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:53.071802 24590 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:53.109294 24176 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:53.125084 24176 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:53.129156 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:53.135789 24470 consensus_meta.cc:287] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
W20260709 13:06:53.178691 24130 consensus_meta.cc:287] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 1.020s	user 0.005s	sys 0.007s
I20260709 13:06:53.180088 24571 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:53.181840 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1197) took 1358 ms. Trace:
I20260709 13:06:53.182315 22433 rpcz_store.cc:276] 0709 13:06:51.823370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.001636 (+178266us) service_pool.cc:224] Handling call
0709 13:06:52.015818 (+ 14182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.016053 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:52.240784 (+224731us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.570937 (+330153us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b18002295a0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d35522 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:06:53.180917 (+609980us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b18002295a0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069cafc0a 00007f00733ef219 00007f0069d37a40 00007f0069d324e4 00007f0069d32455 00007f007081a3c7 00007f006ce2c9a7 00007f006ce3c0bf 00007f006ce3c038
0709 13:06:53.181258 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.181476 (+   218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.181531 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:53.181582 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.181652 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.181776 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":747936,"prepare.queue_time_us":1189501,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":14272,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":17513,"spinlock_wait_cycles":133339776,"thread_start_us":346062,"threads_started":2,"wal-append.queue_time_us":281851}
I20260709 13:06:53.186103 24546 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.188817 24664 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:53.198884 24546 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:53.147347 24621 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:53.202903 24578 consensus_meta.cc:287] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.895s	user 0.005s	sys 0.004s
I20260709 13:06:52.674098 23107 rpcz_store.cc:276] 0709 13:06:51.280799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.298621 (+ 17822us) service_pool.cc:224] Handling call
0709 13:06:51.327832 (+ 29211us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:51.640719 (+312887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.648816 (+  8097us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:51.839669 (+190853us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b2c00047618. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:06:51.840340 (+   671us) log.cc:844] Serialized 52 byte log entry
0709 13:06:52.069960 (+229620us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.371294 (+301334us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.483766 (+112472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.516516 (+ 32750us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.568124 (+ 51608us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b1800333940. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:06:52.581188 (+ 13064us) raft_consensus.cc:1685] finished
0709 13:06:52.611411 (+ 30223us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.616136 (+  4725us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70130,"prepare.queue_time_us":428521,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":172983,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":177,"spinlock_wait_cycles":35214464,"thread_start_us":469859,"threads_started":3,"wal-append.queue_time_us":438743}
I20260709 13:06:53.176231 24620 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.198907 24445 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.142251 24325 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.209394 24445 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:53.212231 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 491948us
I20260709 13:06:53.213186 23077 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.214893 23077 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.204293 24578 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.139927 24603 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:53.219684 24672 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.220284 24325 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:53.132236 24656 consensus_queue.cc:1059] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:06:53.206852 24620 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:53.232517 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.242002 24672 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.241129 24445 raft_consensus.cc:3055] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:53.243758 24445 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:53.239827 24330 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.236835 24658 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.244630 24445 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.245764 24578 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:53.247483 24330 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:53.248621 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 97216.7us
W20260709 13:06:53.250478 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 120725us
I20260709 13:06:53.258721 22499 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:53.136438 24470 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.258165 24325 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:53.280296 24584 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.281111 24584 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.283316 24584 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:53.285104 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.285665 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.286537 22431 raft_consensus.cc:2410] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:53.285946 22426 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:53.287045 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.285713 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.290477 22425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:53.291080 22425 raft_consensus.cc:606] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:53.291432 22425 raft_consensus.cc:614] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:53.291941 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:53.293442 23077 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:53.294235 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.294590 23077 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.294857 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.295035 24468 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.295890 24468 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.294590 22399 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.298995 22429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:53.294885 22433 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:53.299605 22429 raft_consensus.cc:606] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.299958 22429 raft_consensus.cc:614] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:53.300594 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.300961 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.301347 22425 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:53.302510 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.302532 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:53.287602 24325 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:53.303828 22576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1289) took 2023 ms (client timeout 1589 ms). Trace:
I20260709 13:06:53.303968 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:53.304320 22576 rpcz_store.cc:269] 0709 13:06:51.275392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.275592 (+   200us) service_pool.cc:224] Handling call
0709 13:06:53.298762 (+2023170us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b540009a454. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:53.298881 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878696832}
I20260709 13:06:53.308185 24655 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.313688 23105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 551) took 1541 ms. Trace:
I20260709 13:06:53.314198 23105 rpcz_store.cc:276] 0709 13:06:51.771732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.771896 (+   164us) service_pool.cc:224] Handling call
0709 13:06:52.065495 (+293599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.150752 (+ 85257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.154390 (+  3638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.169290 (+ 14900us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.169354 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.169450 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.313410 (+1143960us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b540045fe50. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:53.313559 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666801536}
I20260709 13:06:53.299252 24662 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.318775 24622 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.320797 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.322067 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.322779 22427 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:06:53.311757 22472 connection.cc:256] RPC call timeout handler was delayed by -1.0774833909998733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:06:53.326320 24357 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:53.326972 24357 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.329172 24357 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:53.314218 24470 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:53.332063 24628 raft_consensus.cc:3055] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:53.360937 24325 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:53.364722 24628 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:53.350024 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1149) took 2025 ms. Trace:
I20260709 13:06:53.365003 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.361738 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:53.341794 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.340637 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:53.439718 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.417425 24449 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:53.452451 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:53.347363 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:53.361176 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:53.502785 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.572304 22506 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:06:53.413267 24176 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:53.508190 24567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.178s	user 0.010s	sys 0.011s
I20260709 13:06:53.572974 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.366981 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.573709 22427 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.574694 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.366169 24628 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.576969 24176 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.580606 24628 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:53.573325 24567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.011s	sys 0.011s
I20260709 13:06:53.449509 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:53.585613 22428 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:53.586433 24647 raft_consensus.cc:3055] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:53.586644 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.588392 22428 raft_consensus.cc:1217] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 3.2->[5.3-5.3]
I20260709 13:06:53.588948 22428 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:06:53.460053 24445 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.431843 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.596859 22427 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:53.447739 24619 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:53.433480 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.599182 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.599630 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.601455 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.601683 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.422943 22500 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.605707 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1168) took 1635 ms. Trace:
I20260709 13:06:53.606076 22500 rpcz_store.cc:276] 0709 13:06:51.970298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.361345 (+391047us) service_pool.cc:224] Handling call
0709 13:06:53.422760 (+1061415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.604678 (+181918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.605522 (+   844us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400425ed0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:53.605650 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2439999872}
I20260709 13:06:53.414465 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:53.437481 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.607451 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.430732 24644 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:53.458563 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.608078 23113 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:53.376047 22472 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:53.610344 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 234368us
I20260709 13:06:53.611315 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:53.440594 24470 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.611681 24590 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:53.611225 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:53.551674 24656 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.552538 24483 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:53.553192 24387 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:53.448730 24662 raft_consensus.cc:993] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:06:53.553452 22473 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:53.465438 24268 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:53.630756 24387 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.631155 24325 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.631589 24325 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:53.631518 24483 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.632131 24325 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.631667 24385 raft_consensus.cc:1081] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:06:53.365794 22508 rpcz_store.cc:276] 0709 13:06:51.324124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.324233 (+   109us) service_pool.cc:224] Handling call
0709 13:06:51.373058 (+ 48825us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:51.625986 (+252928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.626015 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:51.626629 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 13:06:51.925065 (+298436us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:52.285571 (+360506us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.286757 (+  1186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.349534 (+1062777us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54000c6f54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:53.349608 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.349660 (+    52us) raft_consensus.cc:1685] finished
0709 13:06:53.349762 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.349951 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29681,"prepare.queue_time_us":232179,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":2822,"raft.queue_time_us":163662,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":10207,"spinlock_wait_cycles":580786560,"thread_start_us":564417,"threads_started":2,"wal-append.queue_time_us":378234}
W20260709 13:06:53.554047 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 192403us
W20260709 13:06:53.630537 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 77168.6us
I20260709 13:06:53.447489 22577 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:53.630867 24268 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.636365 24678 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:53.636914 24678 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.637427 24268 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:53.639003 24678 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:53.639485 24678 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:06:53.374159 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.439862 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:53.646483 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:53.647996 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:53.649366 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:53.650020 22582 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.334017 24400 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:53.430655 24655 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:53.367575 24572 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.653987 24572 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.656080 24572 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:53.411893 24670 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.436s	user 0.005s	sys 0.006s
I20260709 13:06:53.364586 24622 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:53.556071 22432 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.439297 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.657938 24672 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:53.658806 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 219583us
I20260709 13:06:53.554127 24633 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.659584 24633 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:53.659992 24633 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.661171 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:53.661911 22574 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.665285 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:53.560999 23076 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.423777 22503 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:53.668973 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:53.672909 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:53.673921 24603 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:53.674855 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 113959us
I20260709 13:06:53.679226 23076 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:53.680804 22578 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:53.681648 24603 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:53.682219 24603 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:53.682953 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:53.683159 24603 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.464902 24339 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:53.568990 24463 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:53.570575 24357 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.706972 22578 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:06:53.571031 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.440754 24468 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.575834 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:53.452847 22425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:53.419272 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1229) took 1353 ms. Trace:
I20260709 13:06:53.598313 24647 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:53.550948 22507 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:53.617000 22472 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:53.718321 22431 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:53.612170 24470 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.621958 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.623407 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.624725 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.625771 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.613077 24619 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.628638 24541 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:53.562697 24665 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.708s	user 0.004s	sys 0.014s
I20260709 13:06:53.697088 22573 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:06:53.705454 22582 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:53.711119 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:53.708568 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.613413 24644 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
W20260709 13:06:53.718852 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 101926us
I20260709 13:06:53.721119 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:53.728403 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:53.730902 23108 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:53.714967 24555 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.733348 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:53.741410 22499 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.715664 22505 rpcz_store.cc:276] 0709 13:06:52.065852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.166644 (+100792us) service_pool.cc:224] Handling call
0709 13:06:53.419010 (+1252366us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b5400425ed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:53.419200 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602712448}
I20260709 13:06:53.695693 24678 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.715812 24672 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:53.746380 22507 raft_consensus.cc:2410] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:53.745889 22506 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:53.762866 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:53.751786 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.745012 22472 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:53.733022 24655 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.760149 22504 raft_consensus.cc:1240] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:53.633162 24656 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.767472 22505 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.768231 22432 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:53.760747 24176 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:53.765252 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:53.707481 24633 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.743526 24628 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.714494 24463 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.748675 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:53.707844 24339 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.729959 24357 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.754663 24449 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.766358 24578 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:53.793597 22504 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:53.766026 24555 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.783215 22472 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:53.850862 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 67722.4us
I20260709 13:06:53.818480 22508 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:53.820551 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.749460 24386 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:53.753311 24685 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:53.787442 24622 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:53.774331 24541 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.729748 24468 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.834318 22425 raft_consensus.cc:606] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.772702 24572 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:06:53.795379 22501 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:53.854214 22472 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:53.836577 23104 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:53.773711 24672 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:53.864982 22500 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.782979 24176 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.871546 23113 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:06:53.871975 23113 pending_rounds.cc:85] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 7
I20260709 13:06:53.870165 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:53.873178 22504 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:53.875577 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:53.856148 23110 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:53.872254 23113 pending_rounds.cc:107] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:06:53.881744 23113 raft_consensus.cc:2889] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.884893 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.890712 22472 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:53.859512 24655 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.894618 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:53.896624 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 138211us
I20260709 13:06:53.787712 24647 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.839545 24660 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:06:53.896574 22473 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:53.880005 24081 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:53.883055 24445 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.867645 24622 raft_consensus.cc:697] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:53.849851 24449 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:53.905747 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:53.886497 24621 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.949792 24621 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.950249 24621 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.895706 24483 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:53.926877 22473 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:53.945709 24176 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:53.947304 24468 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:53.954787 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 49098.4us
W20260709 13:06:53.957562 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 43851.2us
I20260709 13:06:53.919903 24541 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.916236 24081 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:06:53.971715 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 86647.7us
I20260709 13:06:53.921435 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.975240 23076 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.976958 22507 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.978042 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:53.978590 22506 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:06:53.963474 24330 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.990445 22578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:06:53.991176 22578 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:53.991504 22578 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.995929 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:53.965758 24468 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.029515 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.033866 22506 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:54.035794 23112 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:53.969669 24387 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:54.063863 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.971935 24541 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.972033 24619 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:54.068244 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 72412.1us
I20260709 13:06:54.070945 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:53.974723 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:54.088145 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:54.081403 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 75489.1us
I20260709 13:06:54.083776 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.086256 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.074219 24678 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.096661 22573 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:54.124693 24339 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:54.097364 24692 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
W20260709 13:06:54.098316 24688 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:06:54.126935 24081 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.127683 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1312) took 1399 ms. Trace:
I20260709 13:06:54.070413 24468 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.128007 24081 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.099514 22502 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.109620 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.129796 24468 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:54.116812 24400 consensus_queue.cc:1059] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:54.118146 24633 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.131121 24400 raft_consensus.cc:3055] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:54.131533 24400 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:54.132498 24400 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.133790 24400 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.106673 22396 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:54.137259 24463 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.137629 22396 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:54.138643 24386 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.139173 24574 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.120908 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:54.139925 23110 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.141628 24672 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.142421 22575 rpcz_store.cc:276] 0709 13:06:52.728746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.728883 (+   137us) service_pool.cc:224] Handling call
0709 13:06:52.739078 (+ 10195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.739432 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.739459 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.498404 (+758945us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b2c000fc268. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:06:53.559840 (+ 61436us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.818050 (+258210us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:53.818087 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.818152 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.127369 (+309217us) raft_consensus.cc:1685] finished
0709 13:06:54.127390 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.127621 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":477,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":50,"spinlock_wait_cycles":18724096,"thread_start_us":257834,"threads_started":1,"wal-append.queue_time_us":361216}
I20260709 13:06:54.144600 24573 consensus_queue.cc:1059] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:54.145843 24573 raft_consensus.cc:3055] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:54.123965 24697 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:54.127439 22330 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33176 (request call id 262) took 17209 ms (client timeout 15000 ms). Trace:
I20260709 13:06:53.981221 24701 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.120100 24555 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.153685 22504 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:54.156262 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:54.156558 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:54.159363 22424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:06:54.159648 22500 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:54.160696 22424 raft_consensus.cc:606] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:54.160581 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:54.161545 22424 raft_consensus.cc:614] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:54.168004 22396 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:54.124173 22574 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:54.176095 22580 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.179037 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:54.087416 24387 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.068341 24470 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.091081 24541 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.132822 24660 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.182248 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:54.158260 22578 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.179301 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:54.126482 24357 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:54.090965 24656 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.146054 22331 catalog_manager.cc:5697] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 4, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 4 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:06:54.146884 24573 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:54.173499 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 215165us
I20260709 13:06:54.201457 22472 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:54.199708 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:54.202355 23113 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:54.145053 24637 consensus_queue.cc:1059] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 13:06:54.172974 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 216369us
I20260709 13:06:54.178798 24701 raft_consensus.cc:697] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:54.211900 22578 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:54.162173 23109 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:06:54.207384 22331 catalog_manager.cc:5697] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:06:54.213241 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 286450us
I20260709 13:06:54.204247 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:54.204658 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 229496us
I20260709 13:06:54.215342 22331 catalog_manager.cc:5697] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.223680 23076 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:54.197388 24662 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.227433 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.228992 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.186715 24574 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:06:54.089375 24622 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.234050 22331 catalog_manager.cc:5697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 3, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.232412 22504 raft_consensus.cc:2410] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:54.210626 24656 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.241122 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.241879 22502 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:54.244776 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.240255 22473 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:54.201767 24660 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.231959 24662 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.230844 24672 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:54.241603 24325 consensus_meta.cc:287] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.003s
I20260709 13:06:54.263652 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.264911 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.262035 24590 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:54.257889 24339 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:54.265564 24325 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.266300 24339 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.266988 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:54.268208 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:54.268388 23079 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:54.268832 23108 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.269381 23104 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEARNER]: Advancing to term 6
I20260709 13:06:54.270059 23079 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.270885 24463 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.271245 24463 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:54.271601 24463 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.265707 24590 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.277128 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:54.279529 23108 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:54.280223 24463 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.281273 24633 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.281582 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:54.281703 24633 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:54.282178 24633 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.282482 22474 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:54.282847 24463 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.284654 24655 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:54.285183 24655 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:54.285856 24357 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.286082 24655 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.243490 24656 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.287952 24656 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:54.290556 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 50382.5us
I20260709 13:06:54.291596 22473 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.292347 24330 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.268846 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:54.265089 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 60825.5us
I20260709 13:06:54.297585 22472 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.298108 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.301563 22398 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:54.302371 22547 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:54.302827 22398 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:54.241042 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:54.294021 23112 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:54.311285 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.311781 22331 catalog_manager.cc:5697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 2, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:06:54.259891 24425 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.257706 24664 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:54.322674 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:54.323693 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.324563 22581 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:54.325347 23106 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:54.325945 24590 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:54.327579 24385 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.329689 24483 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:54.330103 24708 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.330258 24483 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.330920 24647 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.331789 23104 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:54.332515 24325 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:54.314240 22547 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.307616 24672 raft_consensus.cc:697] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:54.333834 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:54.319631 22505 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.334789 22574 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:54.319542 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.246160 24619 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:06:54.321327 23113 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.334272 24672 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.262347 24573 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.301177 24339 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:54.344625 22582 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:54.341205 22547 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.337888 24385 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.293248 24662 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.333201 24449 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:54.351114 22547 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:54.345709 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 134512us
W20260709 13:06:54.153132 22330 rpcz_store.cc:269] 0709 13:06:36.917823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.919323 (+  1500us) service_pool.cc:224] Handling call
0709 13:06:54.127370 (+17208047us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:50.208788 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:50.686074 (+477286us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5400250228. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f00731de9e1 00007f00731dd64c 00007f007086cd5d 00007f00708580a6 00007f0070857d58 00007f007085c9f1 00007f007085c9a9 00007f007085c939 00007f007085c901 00007f007085bb2d 000000000038f354
0709 13:06:50.686235 (+   161us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:50.686287 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:06:50.686324 (+    37us) tablet.cc:662] Decoding operations
0709 13:06:50.687418 (+  1094us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:50.687532 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:50.687562 (+    30us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:06:50.688380 (+   818us) tablet.cc:701] Row locks acquired
0709 13:06:50.688428 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:06:50.736827 (+ 48399us) write_op.cc:270] Start()
0709 13:06:50.781606 (+ 44779us) write_op.cc:276] Timestamp: P: 1783602410710436 usec, L: 0
0709 13:06:50.785053 (+  3447us) op_driver.cc:348] REPLICATION: starting
0709 13:06:50.834251 (+ 49198us) log.cc:844] Serialized 3723 byte log entry
0709 13:06:51.170357 (+336106us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b5400260320. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006cd97dbe 00007f006cda2930 00007f006cda28d8 00007f006cda2858 00007f006cda2813 00007f006cda1a9c 00007f0072c8d626 00007f0072c87dd8 00007f006cdde7cb 00007f006cde12c0
0709 13:06:51.609155 (+438798us) op_driver.cc:464] REPLICATION: finished
0709 13:06:52.293129 (+683974us) write_op.cc:301] APPLY: starting
0709 13:06:52.308524 (+ 15395us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:52.388823 (+ 80299us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:52.411323 (+ 22500us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:52.533218 (+121895us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:52.675871 (+142653us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:06:52.722358 (+ 46487us) write_op.cc:312] APPLY: finished
0709 13:06:52.763641 (+ 41283us) log.cc:844] Serialized 71 byte log entry
0709 13:06:52.927480 (+163839us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.927626 (+   146us) write_op.cc:454] Released schema lock
0709 13:06:52.945312 (+ 17686us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:52.978108 (+ 32796us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:53.060709 (+ 82601us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1929,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":634431,"apply.run_cpu_time_us":43253,"apply.run_wall_time_us":699579,"num_ops":9,"prepare.queue_time_us":167706,"prepare.run_cpu_time_us":52826,"prepare.run_wall_time_us":841184,"raft.queue_time_us":297139,"raft.run_cpu_time_us":48658,"raft.run_wall_time_us":551076,"replication_time_us":765920,"spinlock_wait_cycles":22572288,"thread_start_us":874935,"threads_started":5,"wal-append.queue_time_us":459045,"wal-append.run_cpu_time_us":40821,"wal-append.run_wall_time_us":2396070}]]}
I20260709 13:06:54.346740 22331 catalog_manager.cc:5697] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 4, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.324225 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:54.341907 24590 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.358168 22547 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:54.359314 22399 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:54.316591 24357 raft_consensus.cc:697] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:54.360544 24449 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.347714 24701 consensus_queue.cc:237] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.351346 24339 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.363731 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:54.362064 22331 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:54.392904 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.364348 24637 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.314086 24711 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.378142 22547 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:54.342407 24660 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:54.322986 24664 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.381871 23079 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:54.386391 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.313592 24330 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:06:54.395316 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.405622 22576 raft_consensus.cc:2410] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:54.395985 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.396641 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:54.398100 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 222131us
I20260709 13:06:54.406690 22578 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.403538 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.405520 22331 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 3 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:54.407145 22547 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:54.409008 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.409183 24357 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.409785 24573 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.389174 24483 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:54.410060 24663 raft_consensus.cc:3055] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:54.410521 24663 raft_consensus.cc:740] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:54.411352 24663 consensus_queue.cc:260] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.389683 24647 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:54.413398 22577 raft_consensus.cc:3055] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:54.416291 22577 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:54.416079 24647 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.415724 24555 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.419407 24663 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.421983 23110 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:54.423532 24656 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.392588 24621 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.425696 22331 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:54.399453 24637 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:54.428646 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:54.430958 24662 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.433423 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:54.426877 23079 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.436784 24081 consensus_queue.cc:1059] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:54.390405 24633 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.444633 24449 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:54.446656 24664 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:54.412767 24704 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:54.466920 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 48825.2us
I20260709 13:06:54.451697 22578 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
W20260709 13:06:54.458600 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51664.2us
W20260709 13:06:54.460099 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46670.1us
I20260709 13:06:54.484051 23079 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.485843 22396 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:54.457713 24647 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:54.465387 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 162637us
I20260709 13:06:54.497143 22398 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:54.461050 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 178624us
I20260709 13:06:54.498611 22474 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:54.499683 23079 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.458599 24660 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.501999 23079 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:54.503619 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:54.462014 24603 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.503213 22331 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 2, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:06:54.504719 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:54.484794 24710 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.482044 24081 consensus_queue.cc:1243] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:54.488950 24697 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.457370 24711 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:06:54.465145 24637 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.511443 22331 catalog_manager.cc:5697] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.511454 24463 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:54.515988 24339 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.532912 23106 raft_consensus.cc:2410] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:54.510082 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:54.464730 24385 consensus_queue.cc:1059] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:06:54.509541 24704 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.511134 24425 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.503859 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:54.515558 24574 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.484597 24449 raft_consensus.cc:697] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:54.540562 22331 catalog_manager.cc:5697] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 5, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 5 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.516029 24483 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.513490 22398 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:54.501569 24330 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:06:54.544379 24357 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.564956 24357 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.567143 24357 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.567915 24662 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.569315 24621 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.570564 24449 consensus_queue.cc:237] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.572779 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:54.573210 22577 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.506033 24541 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.555471 24463 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:54.554108 24339 raft_consensus.cc:697] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:54.553714 24400 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.574811 24463 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:54.534565 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:54.575682 24541 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.574506 22577 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.578444 24633 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:54.545280 24722 consensus_queue.cc:1059] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:06:54.568361 24656 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:54.553973 22578 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:54.561566 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.561687 22576 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.542089 24587 consensus_queue.cc:1059] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:54.563365 24425 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:06:54.552508 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 254988us
I20260709 13:06:54.575325 24400 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:54.585671 24400 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.585377 24425 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.584887 24656 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.584859 24721 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:54.588532 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.559211 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 55415.8us
W20260709 13:06:54.589291 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.555955 24574 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:54.589756 22472 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.590534 22577 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:54.606216 22577 pending_rounds.cc:85] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:06:54.606525 22577 pending_rounds.cc:107] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:54.606758 22577 raft_consensus.cc:2889] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:54.608162 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 94759.8us
I20260709 13:06:54.609416 22472 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.610386 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.593143 23076 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:54.560590 22331 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 2, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 2 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.596838 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.598132 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:54.620069 22499 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:54.621208 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:54.626297 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45567.8us
W20260709 13:06:54.642086 22545 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.766s (SENT) [suppressed 5 similar messages]
I20260709 13:06:54.637247 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:54.646790 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53740.1us
W20260709 13:06:54.647372 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 126892us
I20260709 13:06:54.652567 23076 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:54.607229 24574 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.653898 22331 catalog_manager.cc:5697] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 3 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:06:54.654582 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 103002us
I20260709 13:06:54.626876 24357 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.635494 24662 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.621788 24660 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:54.666060 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 56990.4us
I20260709 13:06:54.661170 22331 catalog_manager.cc:5697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 4, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 4 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.661978 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:54.667168 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:54.667884 22505 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:54.649992 24330 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.650463 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:54.648618 24541 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.664502 24325 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.662428 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:54.671732 22500 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:54.773929 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.774629 22500 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:54.775692 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.672313 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.674408 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:54.622141 24656 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:54.657756 24555 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.741962 22579 raft_consensus.cc:1240] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:54.646683 24573 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:06:54.749891 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 83041.8us
I20260709 13:06:54.752794 22502 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:54.781950 22331 catalog_manager.cc:5697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.663347 24662 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:54.669086 24660 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.645967 24719 consensus_queue.cc:1059] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 13:06:54.761852 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 109421us
I20260709 13:06:54.764314 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.777217 22503 raft_consensus.cc:2393] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:54.777935 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.777853 22499 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:54.781517 22500 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.784742 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.786713 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:54.738304 24663 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:06:54.765272 24698 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:06:54.764820 24722 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:54.878444 22502 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:06:54.862982 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 72711.7us
I20260709 13:06:54.774150 24658 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.919198 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:54.900446 22504 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:54.854032 22331 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 4, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 4 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.786222 24555 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.943395 24662 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:54.992256 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.005151 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 52855.7us
W20260709 13:06:54.883359 24728 log.cc:927] Time spent T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
W20260709 13:06:55.008157 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 65524.1us
I20260709 13:06:54.895424 24386 raft_consensus.cc:3055] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:54.883031 24738 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:54.968353 22331 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 4, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 4 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.901321 24656 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:55.017663 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 375594us
I20260709 13:06:54.845762 24733 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:54.899900 24176 raft_consensus.cc:3055] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:54.999428 24330 raft_consensus.cc:3055] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:54.862828 24385 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.038928 22501 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:55.029220 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.044704 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:55.044921 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:54.776739 24339 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.006760 24555 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.101393 22503 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:54.884982 24387 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.049409 22545 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:54.789310 24587 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:55.016881 24386 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:55.071156 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.107395 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.090601 22506 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.791491 24325 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:55.097494 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:54.789677 24647 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.018704 24541 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.052462 22331 catalog_manager.cc:5697] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:55.105556 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 64560.8us
W20260709 13:06:55.103017 24400 consensus_meta.cc:287] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260709 13:06:55.119539 22545 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:55.021793 24468 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:06:55.051865 24330 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:55.054834 24176 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:55.008090 24574 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.109714 24387 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.109534 24587 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.129099 24325 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:55.123847 24541 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.130812 22545 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:55.132581 22574 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:55.134701 22576 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:55.135299 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:55.047374 24738 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.137825 22499 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:55.110677 24664 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.111505 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.124286 22331 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 4, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 4 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:55.167210 22331 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:06:55.110894 24703 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:55.102552 24385 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.129462 24647 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:55.126349 24698 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:55.138478 24081 raft_consensus.cc:2764] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:55.061436 24733 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.172894 22331 catalog_manager.cc:5697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.126039 24400 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.186968 22331 catalog_manager.cc:5697] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:55.159103 24603 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:55.162030 24449 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.191021 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.191473 22431 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:55.193188 22430 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:55.166193 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:55.176977 24714 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.202786 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.200239 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.191607 22331 catalog_manager.cc:5697] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:06:55.165546 24325 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:06:55.214548 22427 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:55.212698 22331 catalog_manager.cc:5697] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 3, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.240466 22424 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:06:55.241003 22424 pending_rounds.cc:85] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 3
I20260709 13:06:55.241240 22424 pending_rounds.cc:107] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:06:55.241503 22424 raft_consensus.cc:2889] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:55.247821 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 233633us
I20260709 13:06:55.249984 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.251062 22432 raft_consensus.cc:2410] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:55.183043 24698 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.201087 24664 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:55.264842 23105 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:55.296253 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:55.306509 22573 raft_consensus.cc:2410] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:55.269724 24400 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:55.184134 24176 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.273519 24541 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:55.274197 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.275837 24574 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:55.203788 24330 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.198169 24603 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.278136 24387 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:55.208819 24714 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.170464 24386 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.178303 24703 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.287281 22577 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:55.303426 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:55.673496 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.632795 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55062 (request call id 214) took 1247 ms. Trace:
I20260709 13:06:55.666961 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:55.632885 22580 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:55.676901 22424 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:06:55.677544 22425 raft_consensus.cc:3055] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.677995 22425 raft_consensus.cc:740] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:55.387379 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 238438us
I20260709 13:06:55.678866 22425 consensus_queue.cc:260] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.408227 22576 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:55.607914 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.608847 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.677211 22574 rpcz_store.cc:276] 0709 13:06:54.385715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.388253 (+  2538us) service_pool.cc:224] Handling call
0709 13:06:55.632544 (+1244291us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b540009b854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:55.632729 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661947264}
I20260709 13:06:55.686106 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:55.675297 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.688948 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:55.690594 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.694473 22425 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:55.623139 24745 log.cc:927] Time spent T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.324s	user 0.004s	sys 0.000s
I20260709 13:06:55.695968 23112 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:55.280300 24637 consensus_meta.cc:287] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.737s	user 0.006s	sys 0.002s
I20260709 13:06:55.707052 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:55.285296 24738 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:55.302696 24663 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.703272 22545 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:55.705351 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.636157 24425 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:55.605207 24715 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.692570 24325 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:55.297852 24587 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:55.298553 24385 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:55.518431 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:55.693940 22426 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:06:55.733032 24425 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.738042 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:55.407307 23110 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:55.688567 24081 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:06:55.709443 24708 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.545214 24717 raft_consensus.cc:3055] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:55.840752 22502 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.527009 24357 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.838835 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 290) took 1247 ms. Trace:
I20260709 13:06:55.553133 24737 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:55.851399 22505 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:55.721096 22425 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:06:55.370904 24662 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.387283 24711 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:55.724265 22500 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:55.725111 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.709295 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.717947 22424 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
W20260709 13:06:55.757215 24741 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.493s	user 0.000s	sys 0.002s
I20260709 13:06:55.987450 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:55.988090 22424 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:06:55.988979 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:55.710515 24555 consensus_meta.cc:287] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.600s	user 0.005s	sys 0.005s
I20260709 13:06:55.336154 24664 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.734618 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:55.991878 22428 raft_consensus.cc:2393] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:55.709357 24633 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:55.459154 24752 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:55.701694 24701 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:55.433365 24656 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.290s
I20260709 13:06:55.293908 24733 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:55.745656 24748 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
W20260709 13:06:55.746987 24743 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:06:55.715576 24637 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.747776 24658 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.833775 22432 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.842118 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2053) took 1053 ms. Trace:
W20260709 13:06:55.457957 24744 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:06:55.721307 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.722687 24386 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.811161 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:55.859422 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:06:55.810380 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 45389.9us
I20260709 13:06:56.006081 22580 rpcz_store.cc:276] 0709 13:06:54.789059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.789607 (+   548us) service_pool.cc:224] Handling call
0709 13:06:55.632687 (+843080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.678102 (+ 45415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.841935 (+163833us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540009b850. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:55.842061 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938154752}
I20260709 13:06:55.839428 24425 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:55.984275 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 131153us
I20260709 13:06:55.985692 22427 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:55.984822 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:56.019770 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:56.015259 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:56.021226 22580 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:06:55.875530 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:55.990567 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 287351us
I20260709 13:06:55.727406 24663 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.996767 22424 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:55.759980 24660 consensus_meta.cc:287] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.754s	user 0.005s	sys 0.006s
I20260709 13:06:55.810382 24541 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.201s
W20260709 13:06:56.000926 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 166958us
I20260709 13:06:55.990932 24483 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:06:55.835873 24714 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:55.754501 24603 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:55.847525 24717 raft_consensus.cc:740] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:55.832674 24622 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:56.007169 22432 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:55.740917 24325 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.810954 24619 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:55.848536 23113 rpcz_store.cc:276] 0709 13:06:54.591437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.591591 (+   154us) service_pool.cc:224] Handling call
0709 13:06:54.591913 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.646478 (+ 54565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.646509 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.657813 (+ 11304us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.131159 (+473346us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:55.131200 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.131264 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.532222 (+400958us) spinlock_profiling.cc:243] Waited 76 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:55.838544 (+306322us) raft_consensus.cc:1685] finished
0709 13:06:55.838565 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.838770 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136686,"raft.queue_time_us":61777,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3808,"spinlock_wait_cycles":174847232,"thread_start_us":369173,"threads_started":1,"wal-append.queue_time_us":559879}
I20260709 13:06:56.014317 22428 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:56.024588 22545 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:56.025693 22425 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:55.872922 24737 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:56.027674 22507 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:56.030675 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:55.875833 24357 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.002429 24578 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.999471 24385 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.996620 24698 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:55.997332 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:56.035153 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.998930 24555 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.989421 24711 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:55.738734 24715 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.017685 24658 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.031431 24647 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:06:56.052853 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2046) took 1457 ms. Trace:
I20260709 13:06:55.873680 24708 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.053293 22429 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:56.008946 24633 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.057772 24662 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:56.060600 24660 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:55.998904 24339 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:56.064523 22433 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:06:56.150841 24716 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:56.072184 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49113.6us
I20260709 13:06:56.083096 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:56.069514 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:56.084437 22424 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:55.757983 24755 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:56.086329 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.087001 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1255) took 1416 ms. Trace:
I20260709 13:06:55.991258 24463 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:06:56.013015 22426 raft_consensus.cc:1240] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.810799 24761 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.217s
I20260709 13:06:56.090179 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:56.214231 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 124154us
I20260709 13:06:56.145042 24619 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.096946 24746 consensus_queue.cc:1059] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:06:56.092442 24483 consensus_queue.cc:1243] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer 10c2f471167442c0b75d8cd50ed8c40c log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:56.108546 24767 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:56.113632 24664 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:56.115150 24637 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.118479 24703 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.121234 23106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 569) took 1550 ms. Trace:
I20260709 13:06:56.122272 24656 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:56.003155 24752 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.007025 24701 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.096130 24587 consensus_queue.cc:1059] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:06:56.129285 24717 consensus_queue.cc:260] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.131033 24449 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:06:56.140679 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 125156us
I20260709 13:06:56.218186 24750 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:06:56.149334 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 124852us
I20260709 13:06:56.274820 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:56.276145 22545 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:56.155462 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:56.212393 24771 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:56.162788 22500 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:56.163192 22578 rpcz_store.cc:276] 0709 13:06:54.595603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.595718 (+   115us) service_pool.cc:224] Handling call
0709 13:06:54.596073 (+   355us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:54.606538 (+ 10465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.606568 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:54.625853 (+ 19285us) log.cc:844] Serialized 78 byte log entry
0709 13:06:55.054255 (+428402us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.100693 (+ 46438us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.100943 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.101047 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.524550 (+423503us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b18004417c0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:06:56.052542 (+527992us) raft_consensus.cc:1685] finished
0709 13:06:56.052642 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.052791 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49474,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":3148,"raft.queue_time_us":3345,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":20107,"spinlock_wait_cycles":4826880,"thread_start_us":385480,"threads_started":1,"wal-append.queue_time_us":616820}
W20260709 13:06:56.176086 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.145242 24766 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.065579 24663 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.158098 24756 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.200444 22399 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:56.202142 22508 rpcz_store.cc:276] 0709 13:06:54.670206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.670320 (+   114us) service_pool.cc:224] Handling call
0709 13:06:54.670623 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.670946 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.670974 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.851766 (+180792us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b2c0000e678. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:06:54.866002 (+ 14236us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.206277 (+340275us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.206320 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.206405 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.070059 (+863654us) raft_consensus.cc:1685] finished
0709 13:06:56.070076 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.086933 (+ 16857us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7068,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9633,"spinlock_wait_cycles":15465216,"thread_start_us":199160,"threads_started":1,"wal-append.queue_time_us":519142}
I20260709 13:06:56.143301 24081 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:06:56.211403 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:56.214573 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 115413us
I20260709 13:06:56.141615 24622 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.094214 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:56.302496 22499 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:56.217792 23112 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:56.148015 24578 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.153460 24385 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.208843 24755 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.196523 23109 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:56.220336 24697 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:56.143918 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 113317us
I20260709 13:06:56.249225 24761 consensus_queue.cc:1243] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:56.159956 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:56.347175 22507 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:56.259222 24664 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.277554 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:56.220456 24704 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:06:56.265026 24710 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.209264 24339 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:56.300625 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 100255us
I20260709 13:06:56.273677 24541 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:56.261305 24740 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:06:56.384552 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.214366 24737 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.297964 24717 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:56.310537 24763 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:06:56.294524 24775 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.362504 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:56.415831 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 127010us
I20260709 13:06:56.271819 24656 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.312309 24663 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.293789 24750 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.427260 24647 raft_consensus.cc:1064] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
W20260709 13:06:56.427718 24647 raft_consensus.cc:1068] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Unable to promote non-voter 9cea93fb03e04e48a6dabc4094ee7c93: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:56.276154 24449 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.382668 24710 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.428617 24711 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:56.429574 24449 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:56.429952 24710 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.316931 24755 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.430784 24737 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:56.383790 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 90288.2us
I20260709 13:06:56.295946 24771 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.353320 24756 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.417850 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:56.479282 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 61515.9us
I20260709 13:06:56.373576 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:56.371316 24767 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:06:56.362471 24722 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:06:56.426159 24633 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.426744 24622 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.374563 22431 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:56.433102 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1217) took 1234 ms. Trace:
W20260709 13:06:56.412683 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.463578 24783 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.411821 24664 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.418704 24081 consensus_queue.cc:1059] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:56.412317 24716 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.508315 24578 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:56.508802 24716 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.511204 24716 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.511684 24385 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.261253 23106 rpcz_store.cc:276] 0709 13:06:54.571233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.571411 (+   178us) service_pool.cc:224] Handling call
0709 13:06:54.571808 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.635114 (+ 63306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.648387 (+ 13273us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.752557 (+104170us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.096345 (+343788us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.103894 (+  7549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.109448 (+  5554us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.756624 (+647176us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:56.110292 (+353668us) raft_consensus.cc:1685] finished
0709 13:06:56.110318 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.121160 (+ 10842us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40097,"raft.queue_time_us":54075,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":14878,"spinlock_wait_cycles":160907136,"thread_start_us":274826,"threads_started":1,"wal-append.queue_time_us":501008}
I20260709 13:06:56.304348 24766 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.511976 24081 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:56.500217 24555 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:56.495203 24746 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.515199 24701 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:56.514881 24746 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.515775 24701 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.516171 24701 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:56.418063 24541 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.517154 22505 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:56.487632 24770 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:06:56.518254 24715 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.522920 24541 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:56.426838 24656 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:56.497776 22430 rpcz_store.cc:276] 0709 13:06:55.201391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.201552 (+   161us) service_pool.cc:224] Handling call
0709 13:06:55.201934 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:55.304029 (+102095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.304064 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:55.304691 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 13:06:55.675224 (+370533us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:55.675270 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.675358 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.432866 (+757508us) raft_consensus.cc:1685] finished
0709 13:06:56.432886 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.433045 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35303,"raft.queue_time_us":91785,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"thread_start_us":289616,"threads_started":1,"wal-append.queue_time_us":370767}
I20260709 13:06:56.524768 24325 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.499699 24783 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.526520 24750 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.527817 24783 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:56.505415 24789 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:56.500001 24449 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:06:56.490139 24647 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.489416 24772 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.506789 24777 log.cc:927] Time spent T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:06:56.506026 24711 consensus_queue.cc:1059] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:56.529907 24772 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.530602 24711 raft_consensus.cc:3055] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.530982 24660 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:56.507089 24664 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:56.507601 24756 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:56.516953 24701 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:56.505924 24776 log.cc:927] Time spent T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:06:56.448617 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:56.490839 24768 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.608439 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 87964.7us
W20260709 13:06:56.603545 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.589358 24664 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.613493 24664 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.615617 24664 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:56.491181 24779 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.127s
I20260709 13:06:56.616528 24357 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.620841 24619 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.531044 24711 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:56.622363 24711 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.623728 24711 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.628895 24701 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.630028 24339 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:56.631673 24768 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.633466 24750 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:56.634111 24768 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.634045 24750 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.634938 23104 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.532119 24756 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.611946 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:56.612864 24752 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.636149 24750 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.639065 24756 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:56.591600 24761 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:56.640254 24761 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:56.644937 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.657058 24772 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:56.657481 24622 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.657995 24622 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.605358 24771 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.514348 24766 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:56.659921 24622 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:56.664319 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:56.666945 24386 consensus_meta.cc:287] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
I20260709 13:06:56.606597 24710 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.669143 24710 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.671558 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:06:56.672143 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.670332 23106 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:56.660959 24755 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.688429 23104 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:56.695485 24710 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:56.698174 24697 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:56.710541 22505 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:56.699033 23105 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:56.743821 24717 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.754992 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 109915us
I20260709 13:06:56.745469 24385 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.792600 22430 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.776376 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:56.952340 22430 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:06:56.783324 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.954914 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 472467us
I20260709 13:06:56.753764 24621 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:56.745167 24715 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.955508 22546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.002s	sys 0.022s
I20260709 13:06:56.750864 24733 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.962885 22430 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.776437 22424 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:56.950704 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:56.974831 22507 raft_consensus.cc:2393] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:56.951617 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:56.961280 22425 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:06:56.976850 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:56.977174 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:56.977571 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:56.949201 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1227) took 1228 ms. Trace:
W20260709 13:06:56.868808 24721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.002s	sys 0.010s
I20260709 13:06:56.967265 22429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1223) took 1277 ms. Trace:
I20260709 13:06:56.770638 24714 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.969132 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:56.971879 23108 raft_consensus.cc:1240] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.954389 24701 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.810889 24386 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:06:56.969389 22546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.002s	sys 0.022s
I20260709 13:06:56.949754 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:56.979136 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:56.979605 22429 rpcz_store.cc:276] 0709 13:06:55.690219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.690352 (+   133us) service_pool.cc:224] Handling call
0709 13:06:56.967099 (+1276747us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540043a654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:56.967208 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832297344}
I20260709 13:06:56.962334 24766 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:56.974177 24733 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.980260 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:56.978667 24449 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:56.961164 24385 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.965655 24664 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:56.967267 24621 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:06:56.810082 24717 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.964107 24339 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:56.965481 24756 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:56.980983 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:56.982458 24603 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.004668 24603 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:57.004969 23077 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:56.983554 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:56.983321 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:57.006191 22575 raft_consensus.cc:2410] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:57.006635 24710 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.982657 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:56.983829 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:56.973299 24715 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.983184 22427 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:56.985114 22425 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:57.011718 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:57.001304 24794 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:57.011201 24756 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.983875 24766 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:57.012964 24794 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.013743 22576 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:57.033175 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:56.967531 24795 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.002004 22579 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:56.984874 24386 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.985117 24714 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.984964 24701 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:57.005148 24603 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:56.983007 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 683521us
I20260709 13:06:57.117034 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:57.118257 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:56.984553 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:57.009466 24710 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:57.009817 24621 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.125006 24621 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:57.125591 24386 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:57.011199 24339 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:56.980521 22426 rpcz_store.cc:276] 0709 13:06:55.720929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.746565 (+ 25636us) service_pool.cc:224] Handling call
0709 13:06:55.746940 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.214047 (+467107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.948949 (+734902us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b540038efd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:56.949139 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583240960}
I20260709 13:06:57.122802 24711 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:57.127780 24711 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:57.006583 24717 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:57.106464 24795 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:57.112262 24798 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.002s
I20260709 13:06:57.124009 24789 consensus_queue.cc:1059] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:57.131021 24789 raft_consensus.cc:3055] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.131388 24789 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:57.119450 24793 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.985056 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:57.133145 24793 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.119287 24660 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.132253 24789 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:57.113389 24176 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.985532 24449 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:56.988171 24664 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.152549 24789 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:57.158433 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.188062 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.189265 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:57.190284 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 182185us
I20260709 13:06:57.221513 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:57.222329 22579 raft_consensus.cc:2368] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5.
I20260709 13:06:57.221839 24715 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:57.226526 22579 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:57.229738 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:57.230276 22573 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
W20260709 13:06:57.231053 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 111450us
I20260709 13:06:57.193953 24587 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:57.232105 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:57.232357 24587 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.234519 24587 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:57.234843 24603 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.237156 24697 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:57.237826 24697 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.240146 24697 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:57.242177 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.243820 24793 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:57.243862 24737 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.220144 24721 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:57.244833 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1263) took 1377 ms. Trace:
I20260709 13:06:57.253690 24737 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:57.254062 22503 rpcz_store.cc:276] 0709 13:06:55.867076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.867226 (+   150us) service_pool.cc:224] Handling call
0709 13:06:55.988256 (+121030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.262586 (+274330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.262616 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.262660 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:56.262696 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.244549 (+981853us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400426dd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:57.244601 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.244762 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630387968}
I20260709 13:06:57.256449 24737 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:57.252763 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:57.264231 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.246776 24714 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:57.253746 24721 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.264945 22427 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:57.266661 24721 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:57.267290 24766 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:57.262866 23112 raft_consensus.cc:1217] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Deduplicated request from leader. Original: 3.5->[5.6-5.6]   Dedup: 5.6->[]
I20260709 13:06:57.270622 23112 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:57.272763 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.260388 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:57.264665 22573 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:57.272809 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:57.273795 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.261556 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:57.275106 22425 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
W20260709 13:06:57.275513 22500 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1265) took 1405 ms (client timeout 1808 ms). Trace:
I20260709 13:06:57.269974 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:57.276336 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:57.276230 22500 rpcz_store.cc:269] 0709 13:06:55.870296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.984569 (+114273us) service_pool.cc:224] Handling call
0709 13:06:57.275309 (+1290740us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400183dd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:57.275452 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331268352}
I20260709 13:06:57.277237 22579 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:57.277590 22425 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:57.278406 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.280587 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:57.281304 22579 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:57.258745 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:57.260635 24176 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.260121 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:57.263541 24704 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:57.290071 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:57.290401 22473 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:57.293999 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.294765 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.287907 22500 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:57.288231 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.295074 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.295471 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.290413 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.297138 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.297590 22507 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:57.298535 22429 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:57.298370 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.298365 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.300807 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.303385 22507 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:57.303896 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:57.304772 22579 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:57.307183 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:57.307448 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:57.308835 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.309497 22428 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:57.311199 24751 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.311707 24751 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.312011 24751 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.303988 22427 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:57.257997 24746 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:57.262311 24658 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:57.314559 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:57.312968 23110 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:57.318657 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:57.319965 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:57.327732 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.328385 22503 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:57.288585 24788 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:57.328553 22507 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:57.331331 24603 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:57.332528 24788 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.342705 24788 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:57.343720 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.344549 22507 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:57.345623 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.346271 22507 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:06:57.347172 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.333717 24714 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:57.325299 24766 consensus_queue.cc:1059] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:57.350245 22472 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:57.350479 24449 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:57.351217 24655 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.352332 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.353235 22508 raft_consensus.cc:2410] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:57.353648 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1276) took 1266 ms. Trace:
I20260709 13:06:57.353941 24701 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:57.353947 22508 rpcz_store.cc:276] 0709 13:06:56.087157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.352035 (+1264878us) service_pool.cc:224] Handling call
0709 13:06:57.353588 (+  1553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.354776 22502 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:57.355404 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1272) took 1284 ms. Trace:
I20260709 13:06:57.313539 23104 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:57.355700 22502 rpcz_store.cc:276] 0709 13:06:56.071378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.354305 (+1282927us) service_pool.cc:224] Handling call
0709 13:06:57.354612 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.355165 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.355348 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.356400 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:57.355754 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:57.289727 24176 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:57.357793 24637 raft_consensus.cc:3055] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:57.358198 24637 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:57.358304 22472 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:57.357229 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.359100 24176 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:57.359416 22502 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:06:57.359490 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.359689 24721 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.360236 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:57.361133 24655 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.361445 22472 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:57.356988 22508 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.361658 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.348328 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.363188 22472 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:57.364039 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.313374 24704 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.377012 22398 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:57.488819 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:57.378948 22472 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:06:57.490756 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 113835us
W20260709 13:06:57.491400 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.492584 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 115458us
I20260709 13:06:57.493630 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.494525 22503 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:57.360349 24721 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:57.499982 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 246826us
I20260709 13:06:57.497900 22507 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:57.501582 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:57.498656 24779 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:57.501828 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:06:57.524041 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 85053.3us
I20260709 13:06:57.496016 24714 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.546612 22546 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:57.489750 24710 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:57.492623 24785 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.540503 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:57.563735 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.579461 22508 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:57.495746 24788 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.597450 24788 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.357016 24751 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.599169 24710 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.599766 24788 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.511984 24766 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:57.533855 24789 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.367976 24637 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.607182 24710 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:57.543263 24386 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.593576 24714 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:57.607697 24766 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:57.597782 24658 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:57.661104 22503 raft_consensus.cc:1240] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:57.604578 24176 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:57.535305 24793 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:06:57.604899 24655 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.634708 24789 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:57.533567 24779 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:57.685446 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.666047 24714 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:57.686453 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 308248us
W20260709 13:06:57.705260 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 158731us
I20260709 13:06:57.680805 24789 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.677860 24587 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:57.680085 24660 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.682039 24176 raft_consensus.cc:697] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:57.684376 24386 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:57.716159 23110 raft_consensus.cc:1240] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.674492 24658 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.732237 22472 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:57.693501 24802 consensus_queue.cc:1059] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:06:57.714389 24660 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:57.702003 24655 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:06:57.716463 24708 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:57.719578 24768 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:06:57.743628 24807 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:57.784575 24800 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:57.717216 24587 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:57.728729 24386 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:57.786803 24587 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:57.787951 24386 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:57.781637 24660 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.789129 24793 consensus_queue.cc:1059] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:57.792644 24779 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:57.793370 24779 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:57.771219 24766 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:57.773416 24751 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:57.774202 24704 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:57.774964 24176 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:57.777474 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:57.768200 24658 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:57.846520 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.815755 24788 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:06:57.853709 22499 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:06:57.853102 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 124680us
I20260709 13:06:57.855152 24788 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:57.854604 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 120587us
I20260709 13:06:57.856359 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:57.858371 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 317928us
I20260709 13:06:57.860157 22399 leader_election.cc:400] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5.
W20260709 13:06:57.861060 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.860630 22399 leader_election.cc:403] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:57.867087 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:57.865540 22399 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:57.869330 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 162679us
I20260709 13:06:57.869976 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:57.871220 22545 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:57.865185 24715 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.862947 24808 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.882602 22579 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:57.874908 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:57.884011 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:57.884742 23108 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:57.885538 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:57.886323 22547 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:06:57.887473 24795 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:57.875917 24817 consensus_queue.cc:1059] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:06:57.888852 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51860 (request call id 81) took 1891 ms. Trace:
I20260709 13:06:57.872792 24818 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.886263 22579 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:57.867903 24789 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:57.889277 22432 rpcz_store.cc:276] 0709 13:06:55.997584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.100045 (+102461us) service_pool.cc:224] Handling call
0709 13:06:57.888602 (+1788557us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540038efd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce28735 00007f006ce209fa 00007f0071de84c9 00007f006b364c54 00007f006b364be2 00007f006b364b11 00007f006b364a8c 00007f006b363d42 00007f006b15d48c 00007f006b15c8c6
0709 13:06:57.888791 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278128896}
W20260709 13:06:57.894647 22316 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e32ba8e6132b4f8e98a99066b6fffe05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:06:57.895244 24789 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:57.895725 22573 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:57.895892 24789 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.873013 24816 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:57.896289 24789 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:57.896827 24789 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.898020 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:57.900913 24816 raft_consensus.cc:1064] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
W20260709 13:06:57.901532 24816 raft_consensus.cc:1068] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Unable to promote non-voter 9cea93fb03e04e48a6dabc4094ee7c93: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:57.874562 24815 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.876319 24386 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.934558 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:57.909850 22396 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:06:57.938069 24782 log.cc:927] Time spent T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 1.513s	user 0.011s	sys 0.033s
I20260709 13:06:57.939725 24811 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.940099 23105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 582) took 1687 ms. Trace:
W20260709 13:06:57.942286 24820 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:06:57.942519 24751 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:57.891345 24802 consensus_queue.cc:1059] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:06:57.882676 24660 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.015314 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.026527 22430 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.951541 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:58.008570 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.990490 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 115617us
I20260709 13:06:58.028841 24823 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:58.029090 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:57.997687 24814 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:06:58.029276 24768 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.030479 24768 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.031072 23105 rpcz_store.cc:276] 0709 13:06:56.252538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.257037 (+  4499us) service_pool.cc:224] Handling call
0709 13:06:56.279552 (+ 22515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.754256 (+474704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.939649 (+1185393us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54001059d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:57.939990 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952136448}
I20260709 13:06:58.032008 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.995221 24733 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:58.032723 24768 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:58.033447 24733 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:57.910522 24795 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.876435 24176 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.035149 24176 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.034811 24795 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.035689 24795 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.032688 22502 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:58.035517 24176 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:58.036680 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 166883us
I20260709 13:06:58.036960 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.029119 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:58.033039 24823 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.037683 22399 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:58.038153 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.038546 22399 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:58.039180 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:58.039469 24823 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:58.040045 24823 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:58.040514 24823 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.040910 24823 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.041209 22502 raft_consensus.cc:2368] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5.
I20260709 13:06:58.042218 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:57.905135 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.043459 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.044100 22502 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:58.039989 24733 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.046320 22474 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:58.059015 24768 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.059408 24768 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:58.059767 24768 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.044971 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.063078 22502 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:58.050066 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.057857 22430 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:58.066303 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 228) took 1290 ms. Trace:
I20260709 13:06:58.066689 22430 rpcz_store.cc:276] 0709 13:06:56.791860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.792071 (+   211us) service_pool.cc:224] Handling call
0709 13:06:56.792438 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.991866 (+1199428us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b58001988d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006cd7e0aa 00007f006ce00447 00007f006ce18fe7 00007f006ce1a7de 00007f006ce24b49 00007f006ce25416 00007f006ce21d8f 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4
0709 13:06:58.066001 (+ 74135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.066226 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335483136}
I20260709 13:06:58.068527 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.071933 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.071931 22575 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:57.993147 24449 raft_consensus.cc:3055] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:58.076494 24449 raft_consensus.cc:740] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:57.978346 24807 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.077529 24807 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.077934 24660 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:58.078590 24818 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.027758 24386 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.079589 24386 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.080617 24807 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:58.081240 22507 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:58.078461 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1273) took 2006 ms. Trace:
I20260709 13:06:58.083786 22504 rpcz_store.cc:276] 0709 13:06:56.071615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.068206 (+1996591us) service_pool.cc:224] Handling call
0709 13:06:58.078395 (+ 10189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.084801 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:58.085572 22504 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:58.086737 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.088758 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.069090 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.076037 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:58.091718 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:58.094220 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 65169.8us
I20260709 13:06:58.094875 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:58.096804 22504 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.097121 24754 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:58.103674 24386 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.095882 22545 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:58.054334 24811 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.105012 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:58.065146 24751 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.152930 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.091935 24795 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.094340 22502 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:06:58.109602 24818 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:06:58.109965 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.110266 24802 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:58.113524 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:58.162393 22432 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:58.119645 22504 raft_consensus.cc:2410] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:58.121218 22430 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
W20260709 13:06:58.139498 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 43681.3us
I20260709 13:06:57.935453 24815 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.951664 24655 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:58.044961 24733 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.176294 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1262) took 2310 ms. Trace:
W20260709 13:06:58.149550 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 98417.5us
I20260709 13:06:58.154287 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:58.156316 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:58.166008 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:58.177443 22430 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 2.
I20260709 13:06:58.168975 23077 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:58.170218 22472 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:58.176757 22506 rpcz_store.cc:276] 0709 13:06:55.865811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.865975 (+   164us) service_pool.cc:224] Handling call
0709 13:06:55.866337 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.216287 (+349950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.216318 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.216361 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:56.216391 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.176066 (+1959675us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400218ed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:58.176110 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.176237 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804365568}
I20260709 13:06:58.173730 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.148566 22578 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:58.249547 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.148995 24660 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:58.179190 22472 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:58.179041 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:06:58.445894 24803 log.cc:927] Time spent T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
W20260709 13:06:58.465663 24789 consensus_meta.cc:287] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.005s
W20260709 13:06:58.474957 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 295484us
I20260709 13:06:58.261579 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.218501 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:06:58.479127 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 299996us
I20260709 13:06:58.159262 23106 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:58.472133 22502 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:58.504041 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.518812 22578 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:58.520265 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.521656 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.522367 22578 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:06:58.523101 22428 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:06:58.523350 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.524917 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.219732 24788 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:58.175834 24815 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.338609 24754 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.184242 24733 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.536257 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.477293 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.526242 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.538293 22506 raft_consensus.cc:2393] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:58.539971 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.540892 22502 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:58.542277 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.527115 22578 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:58.330797 24603 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:06:58.529498 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 360611us
I20260709 13:06:58.547067 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:58.476994 24714 consensus_meta.cc:287] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.770s	user 0.011s	sys 0.002s
I20260709 13:06:58.174806 24818 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.526825 24660 raft_consensus.cc:697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:06:58.517773 24704 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.544533 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.183828 24655 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.545274 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.534493 24768 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.551251 24587 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:58.555289 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1367) took 1564 ms. Trace:
W20260709 13:06:58.580379 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.548115 22578 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:58.531911 24788 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.580310 22506 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:06:58.597019 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.480985 24823 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.589315 22580 rpcz_store.cc:276] 0709 13:06:56.990639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.000098 (+  9459us) service_pool.cc:224] Handling call
0709 13:06:57.000339 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.014555 (+ 14216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.014582 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.014634 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:57.014664 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.554978 (+1540314us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b540009a954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:58.555026 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.555203 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32260864}
W20260709 13:06:58.552366 24715 consensus_meta.cc:287] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.676s	user 0.001s	sys 0.005s
I20260709 13:06:58.176537 24802 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.525995 24789 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.591976 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.556425 24637 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.554363 24330 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.556355 24795 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:58.556788 24831 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.609782 22396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.000s	sys 0.009s
W20260709 13:06:58.622363 22396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.000s	sys 0.009s
I20260709 13:06:58.596822 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.597561 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.623458 22581 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:06:58.599316 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:58.587182 24817 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.544498 24754 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.615097 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.617774 22502 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:06:58.629817 22574 raft_consensus.cc:2393] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:58.555685 24386 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:58.596009 24788 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.585247 24603 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.631310 24660 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.632278 24655 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:58.614563 24715 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5.
I20260709 13:06:58.716915 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.718326 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.718962 22580 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:06:58.719812 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:06:58.720546 24176 consensus_meta.cc:287] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.001s
I20260709 13:06:58.721047 24176 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.722278 24843 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.597718 24841 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.723282 24841 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:58.628924 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 159494us
W20260709 13:06:58.649287 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.588037 24714 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.593807 24587 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.726670 24754 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:58.727710 24587 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:58.730121 24587 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:58.730680 24587 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:58.713181 24840 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:06:58.713873 24655 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.723627 24832 log.cc:927] Time spent T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:06:58.733947 24655 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.628432 24844 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:06:58.736008 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.848610 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:58.760210 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 211913us
I20260709 13:06:58.735919 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.850195 22580 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:06:58.736785 22579 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:58.860931 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.861008 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.861575 22579 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:06:58.861765 22580 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:58.862754 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:58.849642 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 939828us
I20260709 13:06:58.850762 22472 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:58.863701 23077 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:58.850757 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.864766 24838 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.723681 24841 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.865718 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.867787 23077 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:58.868690 24843 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:58.869411 24838 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.691561 24664 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:58.870720 22502 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.864812 22472 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:58.872046 24811 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:58.872303 22472 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:06:58.872861 24811 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.873481 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:58.873448 24811 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.874161 24811 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.874601 24811 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.634004 24817 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:58.869261 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 324371us
I20260709 13:06:58.887934 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:58.880255 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:06:58.862946 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.876015 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:58.887923 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:58.895450 22425 raft_consensus.cc:2410] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:58.692939 24386 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.896658 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:58.897464 22429 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:58.895535 22432 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:58.880714 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.899502 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.900517 22580 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:06:58.901515 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.879240 22424 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:58.902868 23077 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:58.868579 24714 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:58.907778 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:58.904884 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:58.942917 22425 raft_consensus.cc:2393] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:06:58.941591 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.904997 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:58.848632 24603 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:58.922370 22396 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:58.931578 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:06:58.944686 22429 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:06:58.943874 22580 raft_consensus.cc:2410] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:58.630774 24831 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.877651 24587 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:58.951779 22432 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:06:58.951939 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1264) took 3083 ms. Trace:
I20260709 13:06:58.875293 24843 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.954470 22501 rpcz_store.cc:276] 0709 13:06:55.868687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.868849 (+   162us) service_pool.cc:224] Handling call
0709 13:06:55.987864 (+119015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.280646 (+292782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.280681 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.280725 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:56.280763 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.951711 (+2670948us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54002c9554. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:58.951757 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.951867 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672751488}
I20260709 13:06:58.955641 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:58.964416 22582 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:06:58.904590 24704 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:58.904242 24756 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:58.978181 22505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1274) took 2896 ms (client timeout 1797 ms). Trace:
W20260709 13:06:58.978763 22505 rpcz_store.cc:269] 0709 13:06:56.081589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.211140 (+129551us) service_pool.cc:224] Handling call
0709 13:06:58.977927 (+2766787us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54001766d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:58.978077 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499500928}
I20260709 13:06:58.980077 22508 raft_consensus.cc:1240] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.950129 24714 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.946977 24176 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:58.996587 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.997867 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.998929 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.999300 24714 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.999894 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:58.976850 24704 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:59.000510 24704 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.001621 24802 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:59.001901 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1201) took 1710 ms. Trace:
I20260709 13:06:59.002348 22503 rpcz_store.cc:276] 0709 13:06:57.291427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.495267 (+203840us) service_pool.cc:224] Handling call
0709 13:06:57.536260 (+ 40993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.667890 (+131630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.001643 (+1333753us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400184cd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:59.001835 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286687488}
I20260709 13:06:59.003611 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:59.007925 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1214) took 1681 ms. Trace:
I20260709 13:06:59.008149 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:59.009539 22582 raft_consensus.cc:2410] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:58.938030 24386 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:58.987957 24849 log.cc:927] Time spent T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:06:58.986819 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:58.993091 24733 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:58.993613 24768 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:58.994280 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:59.051268 22501 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:58.995308 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:58.995710 24751 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:58.986726 24831 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:59.014683 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:59.023329 24815 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.031819 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:59.062518 22580 raft_consensus.cc:2410] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:59.063462 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:59.063515 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:59.008390 22499 rpcz_store.cc:276] 0709 13:06:57.326323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.665465 (+339142us) service_pool.cc:224] Handling call
0709 13:06:57.675789 (+ 10324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.854168 (+178379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.007644 (+1153476us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003eab54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:59.007862 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408510848}
I20260709 13:06:59.064888 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:06:59.036258 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 133486us
I20260709 13:06:58.978571 24587 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.052311 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:59.082540 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:59.053503 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:59.160059 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:59.160866 22505 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:59.161758 22501 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:06:59.162755 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:06:59.148088 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 225642us
I20260709 13:06:59.080713 22580 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:06:59.166980 22396 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:59.159358 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:59.152516 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.170670 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2081) took 1028 ms. Trace:
I20260709 13:06:59.171156 22580 rpcz_store.cc:276] 0709 13:06:58.142187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.168751 (+1026564us) service_pool.cc:224] Handling call
0709 13:06:59.169579 (+   828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.170018 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.170052 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.170145 (+    93us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:59.170201 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.170296 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.170444 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.154115 22427 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:06:59.157756 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 153870us
I20260709 13:06:59.163765 22505 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:59.032754 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 132548us
I20260709 13:06:59.059492 22503 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:59.159291 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1294) took 1124 ms. Trace:
I20260709 13:06:59.163735 22501 raft_consensus.cc:1240] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.088094 22579 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:59.179165 22502 rpcz_store.cc:276] 0709 13:06:58.034776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.881691 (+846915us) service_pool.cc:224] Handling call
0709 13:06:58.882023 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:58.898235 (+ 16212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.898301 (+    66us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:58.944521 (+ 46220us) log.cc:844] Serialized 52 byte log entry
0709 13:06:59.158379 (+213858us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:59.158488 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.158645 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.158708 (+    63us) raft_consensus.cc:1685] finished
0709 13:06:59.158725 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.158988 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80222,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":54415,"thread_start_us":175138,"threads_started":1,"wal-append.queue_time_us":159959}
I20260709 13:06:59.180375 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 283) took 1138 ms. Trace:
I20260709 13:06:59.182201 22501 rpcz_store.cc:276] 0709 13:06:58.041937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.162729 (+1120792us) service_pool.cc:224] Handling call
0709 13:06:59.163352 (+   623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.180052 (+ 16700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.180274 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:59.181165 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.186976 22399 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:59.189242 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 223) took 2420 ms. Trace:
I20260709 13:06:59.189790 22433 rpcz_store.cc:276] 0709 13:06:56.768516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.774589 (+  6073us) service_pool.cc:224] Handling call
0709 13:06:56.952128 (+177539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.124680 (+172552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.124712 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.124755 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:57.124791 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.188669 (+2063878us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54000d7d54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:59.188755 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.189041 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396248320}
I20260709 13:06:59.187353 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1230) took 3348 ms. Trace:
I20260709 13:06:59.191762 22431 rpcz_store.cc:276] 0709 13:06:55.838699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.031862 (+193163us) service_pool.cc:224] Handling call
0709 13:06:56.032180 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.496135 (+463955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.186696 (+2690561us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b540003cd54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:59.187107 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767249792}
I20260709 13:06:59.192257 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:06:59.193267 22582 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.196983 22580 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.199113 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2083) took 1056 ms. Trace:
I20260709 13:06:59.199641 22580 rpcz_store.cc:276] 0709 13:06:58.142962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.174953 (+1031991us) service_pool.cc:224] Handling call
0709 13:06:59.196627 (+ 21674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.197588 (+   961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.198840 (+  1252us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b5400198f50. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:59.199017 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48451328}
I20260709 13:06:59.060618 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:59.204631 23109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 415) took 4101 ms. Trace:
I20260709 13:06:59.205296 23109 rpcz_store.cc:276] 0709 13:06:55.013089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.016524 (+  3435us) service_pool.cc:224] Handling call
0709 13:06:55.038125 (+ 21601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.352432 (+1314307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.112757 (+2760325us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002977d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:59.114817 (+  2060us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2663345920}
I20260709 13:06:59.098799 24385 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:59.117796 24425 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.207252 24483 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.210636 24425 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.212407 24715 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.213056 24715 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.213562 24715 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.087496 24848 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.214792 22500 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:59.092449 23111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 581) took 2944 ms. Trace:
W20260709 13:06:59.058732 23107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59008 (request call id 583) took 2631 ms (client timeout 1718 ms). Trace:
W20260709 13:06:59.221764 23107 rpcz_store.cc:269] 0709 13:06:56.427766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.428058 (+   292us) service_pool.cc:224] Handling call
0709 13:06:58.986632 (+2558574us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:06:59.058635 (+ 72003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46393216}
I20260709 13:06:59.202337 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2076) took 1061 ms. Trace:
I20260709 13:06:59.224653 22579 rpcz_store.cc:276] 0709 13:06:58.140754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.862499 (+721745us) service_pool.cc:224] Handling call
0709 13:06:59.201882 (+339383us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540016add4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:59.202111 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516513536}
I20260709 13:06:59.225186 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:06:59.226083 23105 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.227178 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2086) took 1083 ms. Trace:
I20260709 13:06:59.227640 22579 rpcz_store.cc:276] 0709 13:06:58.143718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.225937 (+1082219us) service_pool.cc:224] Handling call
0709 13:06:59.226400 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.226816 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.226843 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.226880 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:59.226960 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.227017 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.227124 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.103295 24386 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:59.230134 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55062 (request call id 238) took 1245 ms. Trace:
I20260709 13:06:59.230629 22574 rpcz_store.cc:276] 0709 13:06:57.951055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.951215 (+   160us) service_pool.cc:224] Handling call
0709 13:06:59.195987 (+1244772us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400198f54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:59.196281 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384462080}
I20260709 13:06:59.230279 24848 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.081521 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:59.087071 24587 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:59.255793 24587 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.102831 24704 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:59.195860 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:59.090559 24714 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:06:59.261278 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 71634.5us
I20260709 13:06:59.101750 24733 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:59.098258 24755 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:59.062209 24761 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:58.995360 24788 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.261754 24714 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.264031 24714 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:59.264452 24714 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.265475 24788 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:59.049727 24794 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:59.265919 24704 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:59.120029 24808 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:59.101215 24811 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.088804 24815 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:59.097694 24817 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:59.056740 24823 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:59.093524 24838 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.055984 24839 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.290794 24839 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:06:59.291394 24839 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.290980 24449 consensus_queue.cc:260] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:59.101373 24841 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.296654 24808 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:59.201529 22576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1363) took 2223 ms (client timeout 1709 ms). Trace:
I20260709 13:06:59.087877 24853 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:06:59.302672 22576 rpcz_store.cc:269] 0709 13:06:56.977715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.977851 (+   136us) service_pool.cc:224] Handling call
0709 13:06:59.201041 (+2223190us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b540009b354. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:59.201301 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11655424}
I20260709 13:06:59.303396 24853 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:58.954425 24854 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:06:59.219321 22582 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:06:59.306699 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 233) took 1419 ms. Trace:
I20260709 13:06:59.307155 22575 rpcz_store.cc:276] 0709 13:06:57.887331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.887469 (+   138us) service_pool.cc:224] Handling call
0709 13:06:57.887761 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.074078 (+186317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.280595 (+1206517us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54001ccad4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:59.306515 (+ 25920us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423089920}
I20260709 13:06:59.207600 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2068) took 1089 ms. Trace:
I20260709 13:06:59.310034 22577 rpcz_store.cc:276] 0709 13:06:58.115200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.115320 (+   120us) service_pool.cc:224] Handling call
0709 13:06:59.202148 (+1086828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.202693 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.202724 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.202792 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:59.202835 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.202913 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.204121 (+  1208us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540009b350. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:59.204273 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412415744}
I20260709 13:06:59.189580 22396 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:59.233855 23111 rpcz_store.cc:276] 0709 13:06:56.148449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.148616 (+   167us) service_pool.cc:224] Handling call
0709 13:06:56.148950 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.213908 (+ 64958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.213960 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.214419 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.335837 (+121418us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.335888 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.937217 (+1601329us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:06:59.092103 (+1154886us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b5400556754. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:59.092156 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.092201 (+    45us) raft_consensus.cc:1685] finished
0709 13:06:59.092214 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.092353 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5263,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6523,"spinlock_wait_cycles":173991680,"thread_start_us":61206,"threads_started":1,"wal-append.queue_time_us":164071,"wal-append.run_cpu_time_us":54135,"wal-append.run_wall_time_us":2612691}
I20260709 13:06:59.238381 24660 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.312764 24660 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.315557 24660 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:59.239415 24081 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:59.316594 24081 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.238438 24754 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:06:59.319499 24754 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.321971 24754 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:59.240640 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 229224us
I20260709 13:06:59.327872 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:59.328948 23109 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:06:59.332231 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:59.268987 22506 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:59.310715 24853 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:59.274554 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1209) took 1960 ms. Trace:
W20260709 13:06:59.275315 24637 consensus_meta.cc:287] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.655s	user 0.002s	sys 0.013s
I20260709 13:06:59.335222 24842 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.334411 22508 rpcz_store.cc:276] 0709 13:06:57.313718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.626409 (+312691us) service_pool.cc:224] Handling call
0709 13:06:58.979854 (+1353445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.980606 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.274034 (+293428us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001766d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:59.274325 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3031939328}
I20260709 13:06:59.336064 24842 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:59.253355 24848 consensus_queue.cc:1059] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:59.343868 24733 raft_consensus.cc:3055] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:59.344376 24733 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:59.305773 24339 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:59.332932 24449 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.272548 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 234) took 1384 ms. Trace:
I20260709 13:06:59.394232 22505 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:59.284807 22399 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:59.374130 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 292555us
I20260709 13:06:59.370091 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2091) took 1142 ms. Trace:
I20260709 13:06:59.399639 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:06:59.400745 24081 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:59.386469 24808 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.401469 22576 raft_consensus.cc:2393] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:06:59.398869 22579 rpcz_store.cc:276] 0709 13:06:58.145111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.231483 (+1086372us) service_pool.cc:224] Handling call
0709 13:06:59.232026 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.232544 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:59.246420 (+ 13876us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.286630 (+ 40210us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.286963 (+   333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.287008 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:59.287049 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.287114 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.287242 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32636,"prepare.queue_time_us":13677,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":109,"raft.queue_time_us":2949,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":1146,"spinlock_wait_cycles":253312,"thread_start_us":36621,"threads_started":1}
I20260709 13:06:59.402442 24794 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:06:59.410579 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 240505us
I20260709 13:06:59.402283 24587 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:06:59.403646 24764 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:06:59.415499 24818 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:06:59.414594 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 566437us
I20260709 13:06:59.405350 23108 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.405197 23105 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:06:59.397614 24714 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.406097 24789 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:59.394093 22573 rpcz_store.cc:276] 0709 13:06:57.887655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.888999 (+  1344us) service_pool.cc:224] Handling call
0709 13:06:57.889313 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.896840 (+  7527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.271903 (+1375063us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b5400047254. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:06:59.272291 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14270336}
I20260709 13:06:59.334723 24853 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.412786 24794 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:59.405251 24766 raft_consensus.cc:3055] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.414892 24715 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:06:59.402439 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.399667 24660 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:06:59.421212 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2084) took 1278 ms. Trace:
I20260709 13:06:59.421595 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:59.422521 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:59.423870 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:06:59.426937 22507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1278) took 1398 ms (client timeout 1678 ms). Trace:
I20260709 13:06:59.374310 24838 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:59.415462 23077 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:06:59.448307 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 167693us
W20260709 13:06:59.717166 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.479962 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1280) took 1449 ms. Trace:
I20260709 13:06:59.524121 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 290) took 1441 ms. Trace:
W20260709 13:06:59.823989 22507 rpcz_store.cc:269] 0709 13:06:58.028688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.028817 (+   129us) service_pool.cc:224] Handling call
0709 13:06:59.426585 (+1397768us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b540021b6d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:59.426768 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118210944}
I20260709 13:06:59.536335 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:06:59.542152 23109 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.452621 24764 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:59.447702 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:59.827931 22506 rpcz_store.cc:276] 0709 13:06:58.030830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.596777 (+565947us) service_pool.cc:224] Handling call
0709 13:06:59.479662 (+882885us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b54003ea154. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:06:59.479879 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539213184}
I20260709 13:06:59.586274 24081 raft_consensus.cc:1064] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:06:59.441882 24587 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:59.825392 22580 rpcz_store.cc:276] 0709 13:06:58.143216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.203405 (+1060189us) service_pool.cc:224] Handling call
0709 13:06:59.207578 (+  4173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.253457 (+ 45879us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:59.254228 (+   771us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.420856 (+166628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.420921 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:59.420970 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.421028 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.421141 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":209,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":291,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":204,"thread_start_us":166128,"threads_started":1}
I20260709 13:06:59.492440 24808 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:59.839066 24658 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.839764 22578 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
W20260709 13:06:59.837867 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 422535us
I20260709 13:06:59.824385 24853 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.829754 22499 rpcz_store.cc:276] 0709 13:06:58.083042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.168835 (+1085793us) service_pool.cc:224] Handling call
0709 13:06:59.169424 (+   589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.169897 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:59.279131 (+109234us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.523725 (+244594us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.523783 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:59.523828 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.523906 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.524053 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10269,"prepare.queue_time_us":47093,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":37865,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12324,"thread_start_us":196733,"threads_started":2}
I20260709 13:06:59.492525 24812 raft_consensus.cc:3055] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:59.826706 24766 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:06:59.846055 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.836544 24764 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.841697 24660 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:59.835966 24425 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:59.844769 24081 raft_consensus.cc:1068] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Unable to promote non-voter 9cea93fb03e04e48a6dabc4094ee7c93: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:59.837798 24838 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:06:59.602015 24839 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:59.847599 24853 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.852178 24621 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.845166 24658 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:59.849357 24764 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.849023 24812 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:06:59.542152 24733 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:59.446308 22581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49180
I20260709 13:06:59.856416 24663 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.856647 24658 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.858582 23077 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:06:59.861603 22499 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.864723 22399 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:06:59.867686 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:06:59.869343 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:59.865459 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:59.858136 24714 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:59.866142 22581 raft_consensus.cc:606] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Received request to transfer leadership
I20260709 13:06:59.865502 23110 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.869370 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:59.872834 22501 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:59.873198 22503 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:59.874469 22505 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:06:59.874280 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:06:59.875910 22504 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:06:59.856436 24621 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.873062 24704 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.879976 22502 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 1.
W20260709 13:06:59.880308 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 432704us
I20260709 13:06:59.881601 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:06:59.880988 23076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.302s (SENT) [suppressed 21 similar messages]
W20260709 13:06:59.891264 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 54676.6us
I20260709 13:06:59.886945 24766 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:06:59.897754 22505 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:59.895743 22396 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:59.889180 24655 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:59.890547 24714 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.903111 22581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49180
I20260709 13:06:59.903666 22581 raft_consensus.cc:606] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Received request to transfer leadership
I20260709 13:06:59.899768 22399 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:06:59.896566 24715 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:59.906661 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 53949.4us
I20260709 13:06:59.901398 24714 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:06:59.908295 24794 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:59.906261 24663 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.914474 24714 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.920524 24839 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:06:59.924144 24841 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:06:59.889663 24838 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:59.924942 24715 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.931517 23077 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:06:59.917587 23076 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:06:59.927536 24766 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.904868 24812 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:59.935518 24660 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:06:59.944506 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:06:59.948788 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 53987.1us
I20260709 13:06:59.946144 22396 leader_election.cc:400] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5.
W20260709 13:06:59.951248 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45402.4us
W20260709 13:06:59.953754 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 55869.9us
I20260709 13:06:59.939101 24839 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.954698 24704 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:59.964303 23113 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.960541 24704 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:06:59.978080 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 387894us
I20260709 13:06:59.960721 24621 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:06:59.983206 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 63390.5us
W20260709 13:06:59.988557 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 55057us
I20260709 13:06:59.977331 24841 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.978375 24704 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.991287 22575 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:00.001899 24655 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:59.986101 24621 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.003973 24658 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:06:59.977212 24839 consensus_queue.cc:1059] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:59.980378 24660 consensus_queue.cc:1059] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:00.009690 24812 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.015872 23079 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:00.022825 22545 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:00.034804 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.036255 24658 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.006979 24841 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.014878 24621 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:00.040656 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 76601.5us
I20260709 13:07:00.041973 22399 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:00.042084 24660 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.053293 24715 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.056535 24660 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:00.076582 22474 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.079015 24697 raft_consensus.cc:3055] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:00.079639 24697 raft_consensus.cc:740] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:00.080013 24842 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:00.081070 24697 consensus_queue.cc:260] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.082711 24697 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.072800 24660 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.091229 22396 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:00.094102 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1389) took 1505 ms. Trace:
W20260709 13:07:00.075385 22318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 108285us
I20260709 13:07:00.094565 22574 rpcz_store.cc:276] 0709 13:06:58.585610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.252026 (+666416us) service_pool.cc:224] Handling call
0709 13:06:59.252535 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.326738 (+ 74203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.326783 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.326834 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:59.326866 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.089246 (+762380us) spinlock_profiling.cc:243] Waited 73.9 ms on lock 0x7b5400099f54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:00.089297 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.090961 (+  1664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169919360}
I20260709 13:07:00.102216 24655 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:00.105938 22578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2074) took 1989 ms (client timeout 2049 ms). Trace:
I20260709 13:07:00.092957 24449 consensus_queue.cc:1059] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 13:07:00.108415 22578 rpcz_store.cc:269] 0709 13:06:58.116974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.596543 (+479569us) service_pool.cc:224] Handling call
0709 13:07:00.103546 (+1507003us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001cd254. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:00.105874 (+  2328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2792949120}
I20260709 13:07:00.101902 24751 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:00.110324 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:00.113739 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 93110.6us
I20260709 13:07:00.095096 24727 consensus_queue.cc:1059] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:07:00.113891 22399 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:00.117440 24715 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.117978 24751 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.136992 24751 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:00.110049 24655 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:00.118701 24766 raft_consensus.cc:3055] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:00.121119 22545 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:00.118623 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.122609 24621 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.123523 24449 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.128443 24853 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.131175 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.105103 24842 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:00.113795 22500 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1205) took 2821 ms (client timeout 2150 ms). Trace:
W20260709 13:07:00.154608 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 80738.7us
I20260709 13:07:00.146351 24794 raft_consensus.cc:3055] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.113929 24881 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.138670 24766 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:00.151813 23113 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
W20260709 13:07:00.143855 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 154535us
I20260709 13:07:00.136679 24808 raft_consensus.cc:3055] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:00.155267 22500 rpcz_store.cc:269] 0709 13:06:57.292652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.298120 (+  5468us) service_pool.cc:224] Handling call
0709 13:07:00.113519 (+2815399us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b5400176bd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:00.113683 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4392151936}
I20260709 13:07:00.160141 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59024 (request call id 313) took 1099 ms. Trace:
I20260709 13:07:00.139020 24655 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.131639 24714 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:00.163687 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 67451us
I20260709 13:07:00.160609 23113 rpcz_store.cc:276] 0709 13:06:59.057978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.058095 (+   117us) service_pool.cc:224] Handling call
0709 13:06:59.894650 (+836555us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:07:00.157756 (+263106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5842304}
I20260709 13:07:00.154506 24449 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:00.157115 24715 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.165313 24081 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.168612 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.158921 24812 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:00.159976 24727 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.159901 24808 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:00.158209 24881 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:00.156955 24794 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:00.162422 24841 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:00.175475 22582 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.175700 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.176419 22398 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:00.169687 24081 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.182660 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:00.177877 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:00.178062 24766 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:00.183053 24081 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.184278 24827 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.185401 24827 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.185781 24827 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.169564 24449 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.176753 24881 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.190014 23106 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:00.190660 24766 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.175860 24808 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.191916 24808 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.170799 24751 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.179797 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:00.178778 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.194483 22578 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:00.182994 22576 pending_rounds.cc:85] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 2
I20260709 13:07:00.194993 24811 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.195168 22576 pending_rounds.cc:107] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:00.195578 22576 raft_consensus.cc:2889] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:00.193882 22396 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:00.193516 24733 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.197163 24794 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:00.191129 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 60106.6us
I20260709 13:07:00.198329 24715 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:00.198457 24794 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.199581 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:00.200815 24841 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.201434 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:00.202768 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.203486 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:00.204653 24811 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.205144 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.196784 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:00.205816 22578 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:00.206321 23104 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:00.206947 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.207594 22575 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 2.
I20260709 13:07:00.208225 24714 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.205309 24811 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.169960 24621 consensus_queue.cc:1059] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:07:00.208920 22575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49180
I20260709 13:07:00.210109 24621 raft_consensus.cc:3055] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.210493 24621 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:00.210839 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.193662 24751 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.211869 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.212555 22574 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.214022 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:00.216113 24839 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.218570 24839 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:00.219058 24839 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.219424 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:00.220165 23104 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:00.181034 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:00.222705 24704 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.225113 24704 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.196594 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:00.225459 24853 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:00.229951 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 49656.8us
I20260709 13:07:00.234227 22328 catalog_manager.cc:5697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:00.236734 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 69337.1us
I20260709 13:07:00.238426 24663 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.238965 24663 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:00.239337 24812 raft_consensus.cc:697] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:00.239869 24663 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.242292 22474 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.211290 24621 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:00.211273 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.245018 24848 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:00.248723 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 54937.1us
I20260709 13:07:00.243569 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:00.252841 24727 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.253357 24727 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:00.253756 24727 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.254045 24838 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:00.254489 24838 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.254843 24838 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.255173 24811 consensus_queue.cc:1059] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:00.257208 22582 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:00.254889 22473 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:00.243640 24621 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.267932 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.267874 22472 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:00.270015 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 85202.9us
I20260709 13:07:00.271886 24660 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.274878 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.275545 24425 raft_consensus.cc:3055] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.275978 24425 raft_consensus.cc:740] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:00.276378 22575 raft_consensus.cc:606] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:00.276808 22575 raft_consensus.cc:614] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:00.268237 22328 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 3, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 3 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.240373 24812 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.268797 24867 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:00.270601 24853 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.269284 24842 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.278748 24811 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.288645 24811 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.289167 24811 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.276898 24425 consensus_queue.cc:260] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.294790 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.295639 22431 raft_consensus.cc:2393] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:00.264524 24655 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.295679 24425 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.276810 24660 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:00.270388 24449 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.281073 24808 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.298799 24655 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.305229 24842 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.271503 24827 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.318004 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:00.318044 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.307058 22398 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:00.320091 24827 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:00.319327 24842 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.285112 24867 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.321044 24842 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.315768 22574 raft_consensus.cc:2410] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:00.321496 24842 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.322078 24842 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.321486 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:07:00.322492 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 54658.1us
I20260709 13:07:00.327483 22474 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.328336 24655 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.328753 24655 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.329072 24655 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.330425 22396 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:00.321153 24867 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.330662 24663 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.335173 24663 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.335609 24663 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.337723 24714 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.338163 24714 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:00.338541 24714 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.340250 24655 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.330808 22328 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:00.333999 24081 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.315510 24808 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:00.342262 24811 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:00.343490 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:00.285436 24704 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:00.350764 24808 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.351606 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.290629 24853 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.353397 22425 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.354206 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.355219 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.355681 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:00.377651 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47346.9us
I20260709 13:07:00.352763 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.389823 22424 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
W20260709 13:07:00.387852 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 120090us
W20260709 13:07:00.382350 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 109325us
I20260709 13:07:00.389216 24867 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.408236 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.387756 23104 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:00.330418 24727 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.337618 24839 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.377754 24733 consensus_queue.cc:1059] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:07:00.404624 22426 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.377570 24697 consensus_queue.cc:1059] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:00.415616 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.415679 22431 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.386529 24881 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.436280 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.437680 24081 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:00.438627 24449 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:00.439132 24727 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.442065 24808 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.443799 24663 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:00.446117 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.446434 24838 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.446794 24714 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.448128 22430 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.425390 24812 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.452085 22473 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:00.426679 24764 consensus_meta.cc:287] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.006s
I20260709 13:07:00.454254 22432 raft_consensus.cc:2393] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:00.452837 22429 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:00.453486 22428 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:07:00.452297 22472 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:00.455307 24621 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.424728 24811 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:00.455808 23113 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.454471 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:00.444237 24808 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:00.463992 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 79991.7us
W20260709 13:07:00.464389 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 80785.4us
I20260709 13:07:00.446201 24663 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:00.462404 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 206539us
I20260709 13:07:00.457576 24621 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:00.468873 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53500.2us
I20260709 13:07:00.470642 24621 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:00.470937 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 102968us
I20260709 13:07:00.471979 24839 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.473470 22399 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:00.474867 22399 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:00.475090 24867 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:00.475940 24740 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.481093 22431 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:07:00.452096 24812 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.464953 24425 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.484261 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.484191 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.463578 24733 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:00.487263 22474 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.488824 22399 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:00.487713 22396 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:00.490778 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:00.491665 23104 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:00.492606 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.493018 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.467752 24838 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.494385 22573 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:00.493330 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.495036 22579 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:00.497339 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.500290 22472 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.457641 24764 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.500047 24848 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.502529 24808 consensus_queue.cc:1059] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:00.473820 24587 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:00.463867 24811 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:00.514801 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 48947us
I20260709 13:07:00.519197 24663 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.519886 24733 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.520495 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.520813 24764 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.521540 24853 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:00.522457 24587 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.486084 24425 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:00.532138 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.527491 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.542457 22574 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:00.510373 24848 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.548089 22547 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:00.512558 24655 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:00.549319 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 66933.8us
I20260709 13:07:00.525966 24727 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.555375 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.557586 22574 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:00.541744 24663 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.558403 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.548046 24425 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.567582 22426 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:00.560890 24663 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.569422 24715 raft_consensus.cc:3055] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.569854 24715 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:00.570689 24715 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.571911 24715 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.572450 24900 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:00.573150 24900 raft_consensus.cc:697] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:00.573901 24587 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.574211 24900 consensus_queue.cc:237] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:00.576797 24898 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:00.578732 24882 raft_consensus.cc:3055] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.579213 24882 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:00.579263 24812 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.548504 24808 raft_consensus.cc:3055] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.580747 24808 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:00.581293 24811 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.549532 24841 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.552917 24848 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.564244 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:00.564057 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.583731 24714 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:00.563984 24899 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.587103 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 86903.8us
I20260709 13:07:00.587438 24899 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.581632 24808 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.590062 24899 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:00.590070 24621 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.559566 24842 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.594426 22472 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.594661 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:00.595340 23104 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.595847 22472 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:00.596760 22474 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.600035 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:00.603950 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 55944.3us
W20260709 13:07:00.606523 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.607726 22472 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.596676 24841 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.609391 24841 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.610157 24841 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:00.610256 24727 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:00.610916 24841 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.609582 22472 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:00.606285 24655 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:00.614464 23077 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:00.617347 23077 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:00.603171 24621 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:00.622143 24901 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:00.620890 24697 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:00.611176 24867 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.630595 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:00.626116 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:00.626432 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:00.580163 24882 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.628006 24751 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:00.632259 24882 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.628458 24842 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:00.629464 24704 raft_consensus.cc:3055] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:00.633586 24704 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:00.634596 24901 raft_consensus.cc:697] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:00.634449 24704 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.635721 24704 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.635550 24901 consensus_queue.cc:237] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.629976 24808 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.617048 24839 consensus_queue.cc:1059] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:07:00.641224 24839 raft_consensus.cc:3055] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.641639 24839 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:07:00.642132 22379 auto_rebalancer.cc:893] Removing replace marker failed: Replica 10c2f471167442c0b75d8cd50ed8c40c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:07:00.642666 22379 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:07:00.642930 23104 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:00.630975 24697 raft_consensus.cc:697] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:00.649981 22473 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:00.642997 22379 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:00.628297 22426 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:00.657902 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.659267 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.659381 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.660152 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.664335 22576 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:00.664786 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 55329.5us
I20260709 13:07:00.665177 22573 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.665551 22472 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:00.668761 22581 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.680936 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.651660 24751 raft_consensus.cc:697] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:00.636008 24663 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.672816 24907 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.687996 22581 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:00.668790 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.689520 22582 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
W20260709 13:07:00.692999 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 74549.3us
I20260709 13:07:00.642470 24839 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.672003 24425 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.701879 22396 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:00.702242 24425 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.703094 23109 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:00.704834 24697 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.705163 24751 consensus_queue.cc:237] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.707142 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.707959 22430 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:00.708396 24714 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:00.708992 24714 raft_consensus.cc:697] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:00.700611 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.711885 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.695775 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:00.713809 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.714551 22582 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:00.715296 22581 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:00.700433 24663 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.715520 24811 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.715989 24811 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:00.716529 22500 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.716873 24811 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.718040 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.718185 24811 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.719975 22573 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:00.696396 24727 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.721290 24727 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:00.723443 24727 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.721527 23109 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:00.724653 24881 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.725363 24894 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.726033 24894 raft_consensus.cc:697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:00.727005 24894 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.730818 22474 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:00.734094 22429 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:00.731029 24839 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.735692 22427 raft_consensus.cc:2410] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:00.723766 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:00.737860 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49307.7us
W20260709 13:07:00.723493 22331 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43174 (request call id 252) took 15941 ms (client timeout 15000 ms). Trace:
I20260709 13:07:00.741489 22425 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:00.741575 22428 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.743577 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.744536 22574 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:00.745779 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.746469 22429 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:00.745784 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.748100 22431 raft_consensus.cc:2410] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:00.735054 24907 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:00.732679 24621 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.749385 24621 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:00.749830 24621 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.749717 24907 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.748907 24794 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.753111 24794 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:00.754144 24794 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.755084 22573 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.757598 22545 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:00.710047 24714 consensus_queue.cc:237] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:00.757462 24902 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:00.761276 24886 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:00.760562 24848 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:00.762238 24715 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:00.756735 22428 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:00.764117 24848 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:00.764536 24789 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.764760 22425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:00.765527 22425 raft_consensus.cc:606] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:00.765872 22425 raft_consensus.cc:614] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:00.765003 24789 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:00.766281 22573 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:00.767097 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.758059 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.771721 22427 raft_consensus.cc:2410] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:00.765988 22545 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:00.775280 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.777199 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.777367 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.776724 22573 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:00.778425 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.779583 22545 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:00.779795 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.781296 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.780344 22429 raft_consensus.cc:2376] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7. Re-sending same reply.
I20260709 13:07:00.782078 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.781147 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:00.762281 24886 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.784818 22433 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:00.779265 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:00.774044 24789 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.784857 22506 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:07:00.786708 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:00.790752 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:00.832283 22501 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.788033 22500 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
W20260709 13:07:00.791399 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.789880 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:00.833336 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 59309.3us
I20260709 13:07:00.833860 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.787709 24886 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:00.832842 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:00.835955 22505 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:00.840179 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:00.840648 22427 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:00.841068 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:00.841593 22499 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.832508 22508 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:00.781270 24081 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:00.843851 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:00.845182 22507 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:00.784194 24449 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.771888 24425 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:07:00.853727 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:00.855907 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.858934 22581 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.872908 22472 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:00.845749 24081 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:00.881281 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:00.867535 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:00.852890 24449 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.892676 22506 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:00.891896 22507 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:00.874871 22474 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:00.884977 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:00.901108 24905 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:00.901420 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:00.902351 22504 raft_consensus.cc:2410] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:00.903640 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:00.904584 24811 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.905256 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:00.906030 22505 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:00.740240 22331 rpcz_store.cc:269] 0709 13:06:44.781641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.781852 (+   211us) service_pool.cc:224] Handling call
0709 13:07:00.723241 (+15941389us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:56.165888 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:56.269000 (+103112us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:56.271352 (+  2352us) write_op.cc:435] Acquired schema lock
0709 13:06:56.273321 (+  1969us) tablet.cc:662] Decoding operations
0709 13:06:56.602085 (+328764us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:56.602158 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:56.602187 (+    29us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:06:56.604138 (+  1951us) tablet.cc:701] Row locks acquired
0709 13:06:56.604159 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:56.604337 (+   178us) write_op.cc:270] Start()
0709 13:06:56.604468 (+   131us) write_op.cc:276] Timestamp: P: 1783602416604284 usec, L: 0
0709 13:06:56.611004 (+  6536us) op_driver.cc:348] REPLICATION: starting
0709 13:06:56.693359 (+ 82355us) log.cc:844] Serialized 9963 byte log entry
0709 13:06:57.334192 (+640833us) op_driver.cc:464] REPLICATION: finished
0709 13:06:57.727136 (+392944us) write_op.cc:301] APPLY: starting
0709 13:06:57.727225 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:57.727678 (+   453us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:57.727806 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:57.759717 (+ 31911us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:57.760102 (+   385us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 13:06:57.760162 (+    60us) write_op.cc:312] APPLY: finished
0709 13:06:57.794694 (+ 34532us) log.cc:844] Serialized 170 byte log entry
0709 13:06:57.796154 (+  1460us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:57.802140 (+  5986us) write_op.cc:454] Released schema lock
0709 13:06:57.802216 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:57.804980 (+  2764us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:57.805016 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33526,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":385406,"apply.run_cpu_time_us":6053,"apply.run_wall_time_us":77809,"num_ops":25,"prepare.queue_time_us":313379,"prepare.run_cpu_time_us":17465,"prepare.run_wall_time_us":672894,"raft.queue_time_us":203872,"raft.run_cpu_time_us":96000,"raft.run_wall_time_us":325022,"replication_time_us":723046,"thread_start_us":684106,"threads_started":4,"wal-append.queue_time_us":280173,"wal-append.run_cpu_time_us":85135,"wal-append.run_wall_time_us":1845646}]]}
I20260709 13:07:00.860981 24808 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.900323 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:00.887926 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:00.901110 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:00.910045 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:00.926343 22581 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:00.881996 24655 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.927356 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.883942 24081 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:00.929509 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 56651us
I20260709 13:07:00.976969 22472 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:00.926602 22503 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:00.933102 22425 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:00.928102 22573 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.928612 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:00.980511 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:00.981303 22428 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:00.973212 22508 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:00.904713 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.896576 24449 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:00.985733 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 57228.8us
W20260709 13:07:00.986850 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 155279us
I20260709 13:07:01.001124 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:00.886373 24896 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:07:00.989926 22399 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:00.993757 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:00.927700 24808 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:01.005667 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.008002 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.974079 24848 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.932677 24655 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.010620 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:01.014321 23104 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:01.015260 22573 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
W20260709 13:07:01.036871 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 162079us
I20260709 13:07:00.987715 24764 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.004666 24751 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.009968 24808 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.043875 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.045298 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.006075 24842 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:01.017627 24655 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.037883 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.056161 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.059960 22428 raft_consensus.cc:2368] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7.
I20260709 13:07:01.060192 22506 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:01.060225 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.062902 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.013150 24848 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.068631 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:01.046062 24887 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:01.020156 24715 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:01.078358 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.004009 24733 consensus_queue.cc:1059] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:07:01.019356 24900 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:01.043807 24764 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.058458 24660 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.082675 24906 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.104955 22428 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:01.038621 24621 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.112941 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.072008 24842 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:01.116334 22500 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:01.119643 24715 raft_consensus.cc:697] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:01.123449 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.123775 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.124576 24926 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:01.125176 24926 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:01.126108 24926 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:01.112571 24660 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:01.129747 24660 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.132740 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.117555 24900 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.133437 24918 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:01.135216 24900 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:01.136305 24915 log.cc:927] Time spent T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:07:01.117280 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 140352us
I20260709 13:07:01.072294 24848 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.160967 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.123502 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:00.980388 24886 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:01.138129 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 294361us
I20260709 13:07:01.162454 22427 raft_consensus.cc:2393] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:01.162961 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.124012 24715 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.120014 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.091333 22506 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:01.121114 22431 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:01.163213 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.104910 24882 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:01.083851 24841 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.165980 22433 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:01.188218 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.174705 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.165993 22432 raft_consensus.cc:2410] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:07:01.133208 24922 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:01.193377 22426 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:01.195320 24621 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:01.195698 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.196959 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.197695 22506 raft_consensus.cc:2393] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:01.198457 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.199250 22506 raft_consensus.cc:2410] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:01.199999 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.200841 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.202325 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.202570 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:01.203557 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.204281 22432 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:01.204512 24842 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.205061 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.206358 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.202219 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:01.208935 24917 log.cc:927] Time spent T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:07:01.210312 22429 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:01.200666 24882 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.200887 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.162652 24907 raft_consensus.cc:3055] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:01.220293 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.215413 22506 raft_consensus.cc:2393] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:01.218163 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.213382 22501 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:01.220088 22499 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
W20260709 13:07:01.202257 24914 log.cc:927] Time spent T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.276s	user 0.004s	sys 0.000s
I20260709 13:07:01.225966 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.226856 22427 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:01.227761 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.228358 22506 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.228583 23076 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:01.231453 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.231678 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.233644 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.234618 24841 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:01.236114 24928 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.236769 24928 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.239627 24928 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:01.239794 24081 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:01.242599 24727 consensus_meta.cc:287] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.518s	user 0.003s	sys 0.004s
I20260709 13:07:01.243866 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.244032 24906 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.245023 24449 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.168591 24867 consensus_queue.cc:1059] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:07:01.230266 24886 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.220767 24907 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:01.258633 24081 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:01.260129 22427 raft_consensus.cc:1240] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:01.255401 23076 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:01.263132 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 273269us
I20260709 13:07:01.264915 22499 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:01.265870 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.268033 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:01.268818 23109 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:01.269009 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.272358 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.246104 24789 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.275959 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:01.277371 22427 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:01.258769 24881 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.278339 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.282341 22501 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:01.283118 24925 log.cc:927] Time spent T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:01.283471 24449 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:01.259621 24727 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.296352 22502 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:01.284202 24764 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:01.285518 24789 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:01.285988 22578 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:01.281627 22428 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:01.287101 24867 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.289927 23113 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:01.274325 22399 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:01.292080 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.293437 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.301168 22430 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:01.296819 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.302498 22432 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:01.300971 22399 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:01.275257 24697 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:01.304633 22499 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:01.302016 24764 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:01.291544 24883 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.308573 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:01.312292 22425 raft_consensus.cc:1240] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.311229 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.313666 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.314466 22430 raft_consensus.cc:2410] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:01.313191 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.307251 24764 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:01.315793 22432 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:01.317900 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.319038 22428 raft_consensus.cc:2368] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4.
I20260709 13:07:01.303948 24867 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.320312 24764 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.322217 24867 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:01.307054 24808 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.325858 24808 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:01.327008 24660 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.329263 24660 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:01.301663 24907 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.306782 23106 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:01.330345 24882 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:01.299996 24655 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.331632 22500 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:01.332036 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.334657 24655 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:01.339754 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.340617 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.338493 22425 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:01.342200 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:01.343001 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.343703 22499 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.344763 24715 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.344991 24842 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.345412 24715 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:01.345968 24913 log.cc:927] Time spent T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:07:01.348189 24715 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:01.348412 24892 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:01.348857 24892 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:01.350153 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:01.313402 24930 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:07:01.337301 24839 consensus_meta.cc:287] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.002s
I20260709 13:07:01.353012 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.353730 22502 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:07:01.354187 24842 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:01.354588 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.355152 22502 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.355512 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.357748 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.357925 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.358249 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:01.358407 22503 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:07:01.358883 22500 raft_consensus.cc:2410] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:01.359246 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.360004 22503 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:01.359874 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.358894 23106 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:01.361851 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.362018 22398 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:01.362681 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 452144us
I20260709 13:07:01.362843 24733 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.363297 24733 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.363646 24733 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.364359 22424 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:01.366184 22474 leader_election.cc:336] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.718s (SENT)
I20260709 13:07:01.366660 22474 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:01.365648 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.318054 24883 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:01.368607 24808 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.369441 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.369678 24883 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.370225 22505 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:01.371336 22505 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:01.373646 24727 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:01.374104 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.374534 24733 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.376235 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.389158 22424 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:01.391616 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:01.392304 23109 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.392812 24789 consensus_queue.cc:1059] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:01.393658 24789 consensus_queue.cc:1243] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:01.394140 24789 raft_consensus.cc:3055] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:01.394454 24789 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:01.377106 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.304908 24937 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:01.396837 24937 raft_consensus.cc:697] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:01.397107 23076 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:01.397737 24937 consensus_queue.cc:237] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.398548 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.399140 22582 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.399490 24697 raft_consensus.cc:2764] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:01.377816 22500 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:01.378551 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.400418 22430 raft_consensus.cc:2376] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5. Re-sending same reply.
W20260709 13:07:01.378767 24934 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
I20260709 13:07:01.381620 22504 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:01.401708 22318 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4d35c45e33c4336b33461cdbe7f7b6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 10c2f471167442c0b75d8cd50ed8c40c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:01.401968 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.402590 22575 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:01.402612 24841 raft_consensus.cc:3055] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:01.404994 24841 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:01.384899 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.385716 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:01.387054 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 376509us
I20260709 13:07:01.405820 24841 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.406370 22545 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:01.406824 24841 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.406858 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.407517 24794 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:01.407992 24794 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:01.408921 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.408828 24794 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.387804 24927 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:01.412238 24927 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:01.412703 24927 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.407207 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:01.416853 24081 consensus_queue.cc:1059] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.417743 24900 raft_consensus.cc:3055] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:01.416683 24660 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:01.418251 24900 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:01.418614 24660 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:01.419251 24900 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.419536 24660 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.420428 24900 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.421043 24081 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:01.422005 23113 raft_consensus.cc:1240] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:01.432796 24081 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.368160 24848 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.425112 22508 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:01.434631 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.435340 22508 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.437219 24449 consensus_queue.cc:1059] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:01.438105 24449 consensus_queue.cc:1243] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:01.438566 24449 raft_consensus.cc:3055] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.438918 24449 raft_consensus.cc:740] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:01.435357 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.395335 24789 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.439774 24449 consensus_queue.cc:260] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:01.442153 24920 log.cc:927] Time spent T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 13:07:01.418236 23109 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:01.445523 24789 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.446381 22501 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.434520 24697 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:01.447551 24896 consensus_queue.cc:1059] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.426623 24907 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.432960 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.423264 22575 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:01.448057 24697 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:01.530352 24697 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:01.531430 24697 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.532562 24449 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.483647 24927 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.534657 22398 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:01.535631 24906 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:01.536252 24906 raft_consensus.cc:697] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:01.537099 22426 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 5. Ops: []
I20260709 13:07:01.537578 24081 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:01.537986 24812 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.538117 24848 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:01.538506 24812 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:01.539029 24812 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.451999 24892 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.539919 24906 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.405395 22506 raft_consensus.cc:2410] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:01.540870 24894 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.541311 24894 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:01.542049 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 199931us
W20260709 13:07:01.480623 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.542852 22399 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:01.543689 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.544082 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.491653 22507 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:01.543851 22508 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
I20260709 13:07:01.538327 22428 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.545442 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.546299 22507 raft_consensus.cc:2393] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:01.547657 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:01.452915 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.537616 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.550558 22545 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:01.554589 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:01.555315 23113 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:07:01.532722 24697 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.559690 22499 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:01.527009 22502 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:01.563993 24853 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.564246 22500 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:01.592311 22505 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:07:01.564145 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:01.565735 22582 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:01.565735 22503 raft_consensus.cc:2368] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6.
I20260709 13:07:01.566771 22399 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:01.567533 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.569166 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.595556 22581 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.598289 22399 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:01.571609 22501 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:01.573525 22547 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:01.573849 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.581450 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:01.582309 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.603506 22581 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:01.593966 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:01.604259 22508 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.612723 22428 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:01.621212 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:01.622663 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 72187.3us
I20260709 13:07:01.623229 22501 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:01.536197 24927 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:01.458437 24733 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:01.628752 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:01.629370 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 55932.2us
I20260709 13:07:01.631531 22499 raft_consensus.cc:2376] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5. Re-sending same reply.
I20260709 13:07:01.632303 24081 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:01.632799 24081 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:01.633134 24081 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.634351 22502 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:01.629419 22573 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.636749 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.627022 22503 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:01.605302 24811 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.007s
I20260709 13:07:01.640719 22503 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.591250 24886 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.642778 22508 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
W20260709 13:07:01.645202 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.652061 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:01.652307 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.596669 24896 raft_consensus.cc:3055] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:01.649022 22574 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:01.655952 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.649163 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.653077 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:01.644151 24811 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.013s	sys 0.007s
I20260709 13:07:01.653427 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:01.662214 22581 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:01.662096 22501 raft_consensus.cc:2393] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:01.652697 22573 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:01.641537 24714 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.641117 24425 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.678406 24714 raft_consensus.cc:697] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:01.678488 24425 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.679379 24714 consensus_queue.cc:237] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.680531 24811 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:01.680788 24425 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:01.681170 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.659862 24853 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:07:01.682015 24811 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.682499 24842 raft_consensus.cc:3055] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:01.682893 24842 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:01.683642 24842 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.683779 22502 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
W20260709 13:07:01.664103 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 58504.6us
I20260709 13:07:01.686090 22396 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:01.687151 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.687776 22396 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:01.668716 24908 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:01.669324 22504 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:01.672601 24923 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.673159 22575 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:01.673693 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.674154 22579 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:01.693567 22573 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:01.660806 24896 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:01.651345 24892 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.700910 22396 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:01.662985 24886 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.639901 24794 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:01.663599 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.706717 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.674665 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.695891 24081 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.708256 22582 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:01.701332 22580 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:01.684769 24842 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.710074 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.705271 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.711444 22573 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.711901 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.712515 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.692878 24908 raft_consensus.cc:697] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:01.709733 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.714985 24908 consensus_queue.cc:237] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.715941 22426 raft_consensus.cc:2368] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5.
I20260709 13:07:01.700707 24733 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:01.700510 24923 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.722720 24923 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:01.700927 24715 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.725169 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.725569 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.726233 22431 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.726814 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:01.727128 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.727559 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.728775 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:01.726430 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.709437 24883 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:01.724677 24853 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.729753 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.733171 22581 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:01.725930 22575 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:01.724615 24886 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:01.733144 24896 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.737725 24896 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.728766 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.739868 22582 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:01.744643 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 43823.5us
I20260709 13:07:01.744850 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:01.745309 24081 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:01.760058 22579 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:01.745394 22427 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:01.764689 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:01.766593 22429 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:01.766952 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.732956 24883 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.775672 22426 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:01.765023 22573 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:01.768854 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.775596 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:01.791321 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.763142 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:01.760393 22431 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:01.799854 22582 raft_consensus.cc:2393] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:01.804334 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.767004 22396 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:01.808625 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.810971 22573 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:01.811285 23104 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
W20260709 13:07:01.813114 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 46190.3us
I20260709 13:07:01.772884 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:01.814800 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.760703 24839 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:01.819660 22573 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.823997 22432 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:01.820281 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:01.831162 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:01.832234 22580 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:01.831334 22425 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:01.834455 22580 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:01.836035 22472 leader_election.cc:400] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5.
I20260709 13:07:01.836366 22472 leader_election.cc:403] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:01.815689 24908 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.839195 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:01.841518 22431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:01.842214 22431 raft_consensus.cc:606] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:01.842584 22431 raft_consensus.cc:614] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:01.843151 22582 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:01.843403 24926 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:01.844378 22582 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.844722 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:01.845568 22581 raft_consensus.cc:2410] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:01.851279 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:01.852010 22425 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:01.839836 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:01.777009 24812 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.856447 24957 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:01.857443 22428 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:01.858843 22425 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:01.837699 24907 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.862517 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:01.837841 24894 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:01.866889 22577 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:01.840878 24811 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.875979 22472 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:01.880839 24848 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:01.881374 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 202851us
I20260709 13:07:01.881848 24794 raft_consensus.cc:697] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:01.882416 24923 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:01.885581 24955 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:01.887799 24883 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:01.874874 24808 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:01.846622 24715 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.836737 24839 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:01.901499 24081 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.965936 24081 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:01.969128 24808 raft_consensus.cc:697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:01.969383 24794 consensus_queue.cc:237] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.970316 24808 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:01.908565 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:01.973412 22575 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:01.858491 24908 raft_consensus.cc:697] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:01.973937 24839 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:01.960831 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.962677 22431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:01.974815 22431 raft_consensus.cc:606] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:01.975180 22431 raft_consensus.cc:614] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:01.963363 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 73526.7us
I20260709 13:07:01.968320 24081 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:01.976871 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:01.875535 24926 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:07:01.979928 22396 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.000322 24848 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:01.965793 24950 log.cc:927] Time spent T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:07:02.010080 22576 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:01.889410 24587 consensus_queue.cc:1059] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
W20260709 13:07:02.014037 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 390101us
W20260709 13:07:02.020076 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.020545 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 144620us
I20260709 13:07:02.022818 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:02.023622 22500 raft_consensus.cc:2393] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:02.025115 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:02.025732 22500 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:02.027107 22546 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.028043 24449 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.029987 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:02.030395 22507 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:02.030858 24449 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.003630 24848 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.043090 22545 leader_election.cc:400] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6.
I20260709 13:07:02.043533 22545 leader_election.cc:403] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.046828 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.051369 22424 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.056138 22505 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:02.052546 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:01.975924 24908 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.053135 22545 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:02.063416 22545 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:02.063865 22506 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:02.034497 24954 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.041698 24941 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:02.065267 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:02.045259 24848 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.067631 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:02.068403 22499 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:02.069312 24961 consensus_queue.cc:1059] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:02.070393 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:02.070978 24962 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:02.055738 24789 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:07:02.066576 24081 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:02.073318 22580 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:02.049271 24896 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6.
I20260709 13:07:02.084085 24081 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.049718 24425 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:07:02.086266 22505 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.056023 24449 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.087282 24794 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:02.087498 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:02.062378 24906 consensus_queue.cc:1059] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:07:02.074919 24900 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:07:02.053524 24937 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:02.090000 24081 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.113997 22501 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.083173 22506 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:02.092916 23076 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:02.072520 24941 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.096700 24927 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.073158 24907 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.103874 22499 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:02.104579 23104 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEARNER]: Advancing to term 7
I20260709 13:07:02.110327 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:02.115883 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.116834 24714 raft_consensus.cc:3055] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:02.104593 24962 raft_consensus.cc:697] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:02.118497 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:02.128314 23113 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:02.129791 22473 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:02.122581 24839 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:02.137542 22504 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:02.120853 24941 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.139358 24081 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.127691 24764 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 13:07:02.109660 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 253606us
I20260709 13:07:02.143287 23104 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:02.126170 24937 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:02.147456 24697 consensus_queue.cc:1059] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:02.141077 24892 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.137054 24962 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.148581 24697 raft_consensus.cc:3055] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:02.149024 24697 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:02.149935 24697 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.151175 24697 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.125278 24927 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.144064 23104 pending_rounds.cc:85] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 3
I20260709 13:07:02.162732 23104 pending_rounds.cc:107] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:02.163233 23104 raft_consensus.cc:2889] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.164911 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.164135 22546 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.171581 22427 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:02.127924 24714 raft_consensus.cc:740] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:02.136982 24839 raft_consensus.cc:697] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:07:02.172387 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.162968 24960 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.176563 24794 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.176301 24926 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:02.176115 22546 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.197081 22546 leader_election.cc:400] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4.
I20260709 13:07:02.197480 22546 leader_election.cc:403] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.183385 23109 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:02.188107 24953 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:02.209386 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.210595 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:02.172693 24882 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:02.184235 24960 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.195909 24892 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.217569 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.219692 22504 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:02.220290 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:02.230834 22426 raft_consensus.cc:2376] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6. Re-sending same reply.
I20260709 13:07:02.230726 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:02.224676 24794 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4.
I20260709 13:07:02.232218 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.232241 22546 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:02.232774 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.228850 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.237381 22396 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.239835 22427 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:07:02.239895 22546 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:02.241466 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.212663 24953 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:02.246591 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.211757 24907 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:02.249121 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:02.236651 24449 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.251303 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:02.254695 22504 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:02.255950 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.258239 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.242475 24962 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:02.263616 22546 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.248925 24764 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.249958 24953 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.246299 24896 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.235184 24900 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:02.266510 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.211815 24714 consensus_queue.cc:260] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.273492 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.248747 24733 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:02.275238 22426 raft_consensus.cc:2410] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:02.251179 24842 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:07:02.253031 24853 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:07:02.256767 24587 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:07:02.260211 24937 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:07:02.269665 24449 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:02.289116 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:02.290671 22547 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.273741 24906 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:02.292865 24906 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.247102 24839 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.297377 22430 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:02.290004 22429 raft_consensus.cc:2368] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6.
I20260709 13:07:02.281989 24848 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.309857 24848 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:02.311815 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:02.316362 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.317286 22430 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:02.265762 24907 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.322316 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:02.323074 22429 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.282876 24908 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.278246 24811 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5.
I20260709 13:07:02.314098 24896 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:02.324052 24714 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.343600 22508 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:02.344727 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.345144 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.320092 24954 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:07:02.345914 22428 raft_consensus.cc:2368] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6.
I20260709 13:07:02.346572 24960 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:02.355068 22429 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
W20260709 13:07:02.346835 24969 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:07:02.336367 24896 raft_consensus.cc:697] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:02.359390 22546 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.327672 24908 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.361399 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:02.356078 24966 log.cc:927] Time spent T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:07:02.362954 22430 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:02.356611 24906 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:02.366555 22546 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:02.368218 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.373978 24960 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.374575 24960 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.373543 23104 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:02.372189 24952 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.554s	user 0.006s	sys 0.007s
I20260709 13:07:02.382934 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:02.363852 24660 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:02.390137 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.392045 22546 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.397085 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.397904 22432 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:02.385196 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:02.403126 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.389343 24449 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:02.389894 24812 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:02.414812 22432 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:02.383685 23109 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:02.422851 24962 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:02.424074 24973 log.cc:927] Time spent T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:02.425086 24848 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:02.425575 24848 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:02.426404 24848 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.428889 24808 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.404728 24900 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.405781 24811 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.437642 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:02.448690 22503 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
W20260709 13:07:02.454460 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 51399.8us
I20260709 13:07:02.455647 22546 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:02.454416 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 59371.3us
I20260709 13:07:02.458467 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.459158 22429 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:02.431746 24449 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:02.488133 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:02.491855 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 87831.8us
I20260709 13:07:02.495828 23113 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:02.479701 24848 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.478214 24839 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.493710 22398 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:02.479511 24900 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.447984 24808 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.453656 24811 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.500501 22396 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:02.504119 24449 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.504802 24853 raft_consensus.cc:2764] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:02.511557 24907 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:02.512888 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.513672 24811 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:02.513813 24081 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:02.517432 24908 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:02.518092 24908 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:02.517969 24812 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:02.519256 24812 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:02.477756 24941 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.520153 24812 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.521742 24715 raft_consensus.cc:3055] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:02.522167 24715 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:02.522262 24941 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:02.437171 24896 consensus_queue.cc:237] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.499575 24962 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:02.525023 24962 raft_consensus.cc:697] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:02.526017 24962 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.526678 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.528136 22546 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:02.528846 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.529279 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:02.531100 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.533442 22425 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:02.534574 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:02.535476 24081 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:02.535148 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1254) took 1112 ms. Trace:
I20260709 13:07:02.490514 24960 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:02.535140 22425 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.536125 22507 rpcz_store.cc:276] 0709 13:07:01.422766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.581136 (+158370us) service_pool.cc:224] Handling call
0709 13:07:02.534989 (+953853us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54003eb054. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:02.535094 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990785280}
I20260709 13:07:02.539991 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:02.544324 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:02.546125 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.547086 22431 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:02.554011 24789 raft_consensus.cc:3055] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:02.554880 24789 raft_consensus.cc:740] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:02.528855 24808 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:02.541782 24660 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.503125 24953 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.551980 24794 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:02.503321 24839 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:02.555833 24789 consensus_queue.cc:260] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.593916 22431 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:02.597625 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 67360.5us
I20260709 13:07:02.599478 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:02.617789 24839 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:02.619117 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:02.619824 22431 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:07:02.596500 24789 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.625599 22427 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 2.
W20260709 13:07:02.633004 22318 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4d35c45e33c4336b33461cdbe7f7b6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 10c2f471167442c0b75d8cd50ed8c40c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:02.633742 24953 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:02.685876 22579 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:02.605495 24896 raft_consensus.cc:2764] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:02.844163 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1429) took 1130 ms. Trace:
I20260709 13:07:03.253060 22580 rpcz_store.cc:276] 0709 13:07:01.714042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.840235 (+126193us) service_pool.cc:224] Handling call
0709 13:07:01.857767 (+ 17532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.084387 (+226620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.843898 (+759511us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400099f54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:02.844098 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495295744}
I20260709 13:07:02.988138 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:03.257218 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:03.246603 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 717358us
I20260709 13:07:03.056705 22505 raft_consensus.cc:1275] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.243917 22503 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 7. Ops: []
I20260709 13:07:02.859131 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:03.259654 22508 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:07:03.055619 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.261780 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.112318 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.839524 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.801472 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2101) took 1040 ms. Trace:
I20260709 13:07:02.766539 22425 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:02.826706 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:02.828768 22504 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:02.802736 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:03.266424 22506 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:03.267261 22504 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:03.267634 22506 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:03.265813 22502 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:03.269047 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.269419 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.269805 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.264070 22424 rpcz_store.cc:276] 0709 13:07:01.760968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.761189 (+   221us) service_pool.cc:224] Handling call
0709 13:07:01.763788 (+  2599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.051914 (+288126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.801217 (+749303us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400275954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:02.801405 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660966656}
W20260709 13:07:03.099998 24988 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
W20260709 13:07:02.732673 24956 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.911s	user 0.008s	sys 0.005s
W20260709 13:07:03.274544 22432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.022s	sys 0.022s
I20260709 13:07:03.275130 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:02.640923 23109 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:03.278439 22503 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:02.714648 24715 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:02.769325 24764 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.062610 24886 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.280061 22432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.022s	sys 0.022s
I20260709 13:07:03.258039 22499 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:02.754343 24927 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:02.955041 24906 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.686172 24449 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.769119 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:03.293012 22499 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:03.294945 22499 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:03.285630 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.307950 22396 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:02.925101 24941 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:03.289624 24715 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.288298 24933 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:02.922842 24425 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.376s
W20260709 13:07:03.310631 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.274745 24808 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.301888 24449 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:03.301884 24906 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:03.302418 24587 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:03.320582 22502 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
W20260709 13:07:03.349752 24789 consensus_meta.cc:287] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.002s
I20260709 13:07:03.281874 22504 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:03.327596 22430 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:03.305307 24927 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:03.350980 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 91929.8us
I20260709 13:07:03.359145 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1291) took 1147 ms. Trace:
I20260709 13:07:03.359292 22546 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:03.360216 24927 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.360749 22546 leader_election.cc:400] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6.
I20260709 13:07:03.306314 23106 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:03.350397 24663 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.303839 24886 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:03.359586 22430 rpcz_store.cc:276] 0709 13:07:02.211338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.369017 (+157679us) service_pool.cc:224] Handling call
0709 13:07:03.358984 (+989967us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b5400389fd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:03.359091 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089994624}
W20260709 13:07:03.382516 22328 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43642 (request call id 131) took 21606 ms (client timeout 15000 ms). Trace:
I20260709 13:07:03.385087 22546 leader_election.cc:400] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6.
I20260709 13:07:03.383678 22330 catalog_manager.cc:5697] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 3 to 4, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 4 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.385938 22546 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:03.349954 24941 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:03.360739 24927 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:03.389948 22330 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:07:03.394348 22330 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 6, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 6 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:03.395810 22330 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 4 to 5, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 5 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:07:03.386420 23110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.021s
W20260709 13:07:03.410334 24812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.005s	sys 0.008s
I20260709 13:07:03.410236 22330 catalog_manager.cc:5697] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 4, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 4 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:03.418510 22330 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 3, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:03.355417 24933 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:03.414546 22546 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:03.361773 24982 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:03.354416 24808 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:03.361389 24587 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:03.387765 24764 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:07:03.417248 24997 log.cc:927] Time spent T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.063s	user 0.006s	sys 0.001s
W20260709 13:07:03.415220 23110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.006s	sys 0.021s
I20260709 13:07:03.420013 22330 catalog_manager.cc:5697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 5, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 5 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:07:03.430620 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 185604us
W20260709 13:07:03.382987 22328 rpcz_store.cc:269] 0709 13:06:41.756881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.757109 (+   228us) service_pool.cc:224] Handling call
0709 13:07:03.362726 (+21605617us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:00.395961 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:00.490972 (+ 95011us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:00.491028 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:07:00.491070 (+    42us) tablet.cc:662] Decoding operations
0709 13:07:00.491730 (+   660us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:00.491825 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:00.491855 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:00.492349 (+   494us) tablet.cc:701] Row locks acquired
0709 13:07:00.492425 (+    76us) write_op.cc:260] PREPARE: finished
0709 13:07:00.492636 (+   211us) write_op.cc:270] Start()
0709 13:07:00.492802 (+   166us) write_op.cc:276] Timestamp: P: 1783602420492564 usec, L: 0
0709 13:07:00.492827 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:07:00.497716 (+  4889us) log.cc:844] Serialized 1293 byte log entry
0709 13:07:00.777667 (+279951us) op_driver.cc:464] REPLICATION: finished
0709 13:07:01.058800 (+281133us) write_op.cc:301] APPLY: starting
0709 13:07:01.080953 (+ 22153us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:01.082438 (+  1485us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:01.082593 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:01.134678 (+ 52085us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:01.134969 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:07:01.135016 (+    47us) write_op.cc:312] APPLY: finished
0709 13:07:01.135310 (+   294us) log.cc:844] Serialized 35 byte log entry
0709 13:07:01.135523 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:01.135616 (+    93us) write_op.cc:454] Released schema lock
0709 13:07:01.135668 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:01.136061 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:01.136088 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53279,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":209791,"apply.run_cpu_time_us":3158,"apply.run_wall_time_us":117288,"num_ops":3,"prepare.queue_time_us":38453,"prepare.run_cpu_time_us":19140,"prepare.run_wall_time_us":164399,"raft.queue_time_us":138188,"raft.run_cpu_time_us":22623,"raft.run_wall_time_us":117664,"replication_time_us":284684,"thread_start_us":278999,"threads_started":4,"wal-append.queue_time_us":113825,"wal-append.run_cpu_time_us":27135,"wal-append.run_wall_time_us":1554816}]]}
I20260709 13:07:03.416640 24993 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.431394 22330 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.438845 22330 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 3 to 5, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 5 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:03.421448 24812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.006s	sys 0.008s
W20260709 13:07:03.444103 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 181303us
I20260709 13:07:03.445868 23077 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:03.440636 22330 catalog_manager.cc:5697] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 4, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 4 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.463584 22330 catalog_manager.cc:5697] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 4, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 4 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:03.473012 25009 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:07:03.476778 25000 log.cc:927] Time spent T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:07:03.498148 24933 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:03.472841 24962 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.480886 24994 log.cc:927] Time spent T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:03.499011 24962 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:03.476033 24996 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:07:03.476397 24995 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:07:03.500078 24933 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:03.484678 24449 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:03.453233 24927 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:03.485342 24886 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:03.501274 24933 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:03.492789 24906 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:03.494122 24789 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.503038 24941 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:03.504614 24933 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:03.494211 25009 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:03.496496 24587 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:03.475696 24998 log.cc:927] Time spent T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:07:03.512853 22429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 267) took 1230 ms. Trace:
I20260709 13:07:03.513231 22429 rpcz_store.cc:276] 0709 13:07:02.282114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.459794 (+177680us) service_pool.cc:224] Handling call
0709 13:07:02.460095 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.460407 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.460444 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.481668 (+ 21224us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.247380 (+765712us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:03.247420 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.247485 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.512617 (+265132us) raft_consensus.cc:1685] finished
0709 13:07:03.512638 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.512775 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":524,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":339209,"threads_started":1,"wal-append.queue_time_us":822799}
I20260709 13:07:03.484436 24839 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:03.516219 24839 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:03.487442 24808 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:03.474880 22330 catalog_manager.cc:5697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 4 to 5, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 5 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:03.519909 24839 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:03.538172 24839 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.538565 24839 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.538861 24839 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.501132 24962 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:03.543322 25009 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:03.544857 24808 raft_consensus.cc:1064] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
W20260709 13:07:03.545352 24808 raft_consensus.cc:1068] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Unable to promote non-voter 9cea93fb03e04e48a6dabc4094ee7c93: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:07:03.548555 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.550431 24789 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.551273 24663 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.453966 24993 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:03.541265 22330 catalog_manager.cc:5697] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 2 to 4, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:03.561479 24993 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:03.562702 22330 catalog_manager.cc:5697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 4, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 4 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:03.572357 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:03.574275 23113 raft_consensus.cc:2410] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:03.564258 22330 catalog_manager.cc:5697] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 3, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:03.581892 22330 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:03.582593 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:03.586860 23109 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
W20260709 13:07:03.584314 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 257071us
W20260709 13:07:03.585994 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 273236us
I20260709 13:07:03.598940 22473 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:03.597877 22396 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:03.626206 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 355415us
W20260709 13:07:03.629096 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 183202us
I20260709 13:07:03.648175 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:03.649591 22425 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:03.657140 22429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:03.658162 22429 raft_consensus.cc:606] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:03.622684 24941 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.665939 22472 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:03.666898 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 157623us
I20260709 13:07:03.671748 25025 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:03.673228 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:03.673506 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:03.673913 23109 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:03.674332 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 266) took 1452 ms. Trace:
I20260709 13:07:03.675523 23109 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.674731 22432 rpcz_store.cc:276] 0709 13:07:02.222188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.432004 (+209816us) service_pool.cc:224] Handling call
0709 13:07:02.432329 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:02.451628 (+ 19299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.451661 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:02.760419 (+308758us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b2c00000f48. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:02.761055 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 13:07:03.290968 (+529913us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.622418 (+331450us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.673895 (+ 51477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.673976 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.674019 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:03.674117 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.674270 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51359,"raft.queue_time_us":16639,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":23967,"spinlock_wait_cycles":4712832,"thread_start_us":845254,"threads_started":2,"wal-append.queue_time_us":669268}
I20260709 13:07:03.673393 25025 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:03.677343 23104 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:03.678833 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:03.680228 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:03.627601 25015 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.685521 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:07:03.686594 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 414230us
I20260709 13:07:03.639920 24715 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:03.711311 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:03.702715 22579 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:03.704653 22576 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:03.705363 22575 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:07:03.682803 25003 log.cc:927] Time spent T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:07:03.625636 24933 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:07:03.700825 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:03.720342 22580 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:03.709229 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 294761us
I20260709 13:07:03.721925 22546 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:03.708225 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:03.734714 23109 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:03.685225 24961 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.712671 25002 log.cc:927] Time spent T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:03.685035 24808 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.698951 25019 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.699411 24886 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:03.711936 24715 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:03.765728 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 136468us
W20260709 13:07:03.771410 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.735263 25009 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:03.738976 24789 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:03.734022 25013 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:03.685688 24941 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:03.776283 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 106137us
I20260709 13:07:03.700630 25007 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:07:03.779402 22581 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:03.745021 24808 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:03.789580 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 138400us
I20260709 13:07:03.711711 24962 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:07:03.783968 22398 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:03.776065 24715 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.795248 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:03.796286 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:03.797394 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.793535 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:03.706915 24764 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:07:03.772118 24886 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.757098 23110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 475) took 1064 ms. Trace:
I20260709 13:07:03.806644 22574 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:03.806913 22508 raft_consensus.cc:3055] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:03.850193 22508 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:03.811005 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:03.851991 22503 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:03.807600 22579 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:03.711951 25016 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
W20260709 13:07:03.802146 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 136268us
I20260709 13:07:03.808552 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:03.809374 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:03.809146 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:03.711614 25015 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:03.816676 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:03.771487 24425 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:07:03.809140 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:03.772444 25019 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:03.881093 22577 raft_consensus.cc:2376] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7. Re-sending same reply.
I20260709 13:07:03.757493 24961 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:03.853046 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:03.864130 22573 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:03.856684 22506 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:03.803879 25032 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.799045 24808 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.887566 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:03.889319 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:03.799324 25009 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:03.808686 24663 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:03.923704 22424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:03.978602 22424 raft_consensus.cc:606] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:03.978996 22424 raft_consensus.cc:614] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:03.800937 24900 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:07:03.984894 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:03.985534 22576 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.932648 23109 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:03.851022 22508 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:03.853997 24886 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.940779 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:03.948029 22581 raft_consensus.cc:2368] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 5. Current term is 6.
I20260709 13:07:03.895877 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:03.971740 22577 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:07:04.008772 22504 raft_consensus.cc:2393] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:03.805541 24839 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:03.977291 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 168604us
I20260709 13:07:04.009264 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:03.931006 24953 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.991593 22508 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.992647 24933 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:03.998327 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.022505 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:04.001277 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:04.023388 22429 raft_consensus.cc:2410] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:04.004139 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:04.024096 22577 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:03.806738 25012 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 13:07:03.801287 25013 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.021714 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:04.022648 22580 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:03.999338 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:04.006556 25025 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.024634 22425 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 7. Ops: [5.4-5.4]
I20260709 13:07:04.025542 22577 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:04.019560 22581 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:04.078672 22581 pending_rounds.cc:85] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 3
I20260709 13:07:04.078936 22581 pending_rounds.cc:107] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:04.079173 22581 raft_consensus.cc:2889] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.030236 22427 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:04.023716 22579 raft_consensus.cc:2376] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10. Re-sending same reply.
I20260709 13:07:03.987051 24663 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.984896 24993 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.033901 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:04.082808 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:04.083050 22429 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:04.076617 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:04.079718 22574 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:04.049306 23113 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.081518 22546 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:04.029187 25005 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:04.383665 25015 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.386211 25019 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.300547 24961 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.340658 24896 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.133374 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:04.273304 24425 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:04.383015 25041 log.cc:927] Time spent T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:07:04.382300 25023 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:04.109251 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:04.377265 25009 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:04.274672 25045 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:07:04.383682 25035 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.428s	user 0.001s	sys 0.000s
I20260709 13:07:04.300135 25013 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:03.862772 23110 rpcz_store.cc:276] 0709 13:07:02.676408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.676598 (+   190us) service_pool.cc:224] Handling call
0709 13:07:02.676980 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.677234 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:02.871972 (+194738us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.668020 (+796048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.684931 (+ 16911us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.697985 (+ 13054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.711470 (+ 13485us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.740988 (+ 29518us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":604665,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":95952,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"thread_start_us":979181,"threads_started":3,"wal-append.queue_time_us":643017}
I20260709 13:07:04.178378 22474 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:04.240484 24812 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:04.460554 24812 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:04.077376 24933 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.466359 24933 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.386745 24764 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.461083 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 64633.1us
I20260709 13:07:04.305857 25027 raft_consensus.cc:3055] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:04.471024 25027 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:04.472206 25027 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:04.096640 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 243438us
I20260709 13:07:04.474012 22472 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:04.094584 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:04.358024 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:04.222178 24900 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:04.475194 24900 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:04.382117 25036 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 13:07:04.302639 25051 consensus_queue.cc:1059] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:04.237896 25044 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:04.293852 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:04.359335 22576 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:04.479992 25044 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.480434 25044 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.481630 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1354) took 1228 ms. Trace:
I20260709 13:07:04.301255 25030 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:04.303926 25054 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:04.077016 25028 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.007675 25017 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 13:07:04.482992 25054 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:03.971238 25032 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.485249 25054 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.485930 25032 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.486523 25032 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.486999 25032 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.310887 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:04.488286 23109 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:04.488605 25062 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:04.120337 22433 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:04.489285 25062 raft_consensus.cc:697] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:04.489554 25047 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.387960 24886 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.146409 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:04.490113 25047 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.490348 25062 consensus_queue.cc:237] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.491797 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:04.019503 24953 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.492520 25047 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.494145 24953 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.084280 24663 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.496100 22573 raft_consensus.cc:2393] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:04.496662 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45084.3us
I20260709 13:07:04.497999 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:04.412668 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.499644 22473 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:04.322417 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.108182 24993 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:04.305070 25042 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:07:04.223220 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:04.507647 22579 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:04.095845 22432 raft_consensus.cc:2410] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:07:04.412070 24982 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.008s	sys 0.002s
I20260709 13:07:04.444499 25007 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.380370 24839 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:04.416700 22318 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4d35c45e33c4336b33461cdbe7f7b6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 10c2f471167442c0b75d8cd50ed8c40c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:04.234782 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:04.147632 22508 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:04.517197 22508 pending_rounds.cc:85] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 2
I20260709 13:07:04.517488 22508 pending_rounds.cc:107] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:04.517724 22508 raft_consensus.cc:2889] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:04.421963 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.100179 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:04.423506 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 342058us
I20260709 13:07:04.519229 22428 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:04.383625 25039 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.435577 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:04.521942 22574 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:04.444532 22581 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
W20260709 13:07:04.454082 23076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.004s	sys 0.015s
W20260709 13:07:04.522810 23076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.004s	sys 0.016s
W20260709 13:07:04.523142 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 859144us
I20260709 13:07:04.523831 23076 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:04.454636 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 434393us
I20260709 13:07:04.292526 24941 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.467814 25013 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.534693 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:04.468516 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 290181us
I20260709 13:07:04.536172 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:04.463378 24812 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.469972 24764 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.107677 25025 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.147048 25018 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:04.482071 22505 rpcz_store.cc:276] 0709 13:07:03.253269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.261425 (+  8156us) service_pool.cc:224] Handling call
0709 13:07:03.294846 (+ 33421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.587909 (+293063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.587940 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.588417 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.748574 (+160157us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:03.748652 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.748778 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.481370 (+732592us) raft_consensus.cc:1685] finished
0709 13:07:04.481406 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.481568 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":208502,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"thread_start_us":436129,"threads_started":2,"wal-append.queue_time_us":263611}
W20260709 13:07:04.215737 25006 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:07:04.500188 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:04.501825 22398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.016s
W20260709 13:07:04.500653 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.430976 25016 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.292619 25049 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 13:07:04.435334 24927 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.432164 25029 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.520417 22545 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:04.505792 25024 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.016s	sys 0.007s
I20260709 13:07:04.530037 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:04.531478 22503 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.000s	sys 0.035s
I20260709 13:07:04.531095 25055 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:04.576072 22503 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.000s	sys 0.035s
I20260709 13:07:04.576628 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:04.577266 22508 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:04.533258 22575 raft_consensus.cc:2368] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7.
I20260709 13:07:04.510610 25054 raft_consensus.cc:993] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
W20260709 13:07:04.518323 24982 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.009s	sys 0.003s
I20260709 13:07:04.514580 24961 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.546430 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.552074 24993 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.557155 22474 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:04.529569 25058 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:07:04.561416 22398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.004s	sys 0.017s
I20260709 13:07:04.455039 24789 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 13:07:04.537240 22318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 114867us
I20260709 13:07:04.454845 24896 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.552752 25043 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:04.564440 24715 consensus_meta.cc:287] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.001s
I20260709 13:07:04.483120 25028 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:04.590530 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63844.2us
I20260709 13:07:04.529024 25019 consensus_queue.cc:1048] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:07:04.594206 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:04.595948 22430 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:04.595867 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 150191us
I20260709 13:07:04.534384 24953 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:07:04.617856 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 60788us
I20260709 13:07:04.589725 24933 raft_consensus.cc:1081] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Signalling peer e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:07:04.647675 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:04.646876 22474 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:04.618607 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.595582 25014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.005s	sys 0.014s
I20260709 13:07:04.532527 25007 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.595536 25040 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:04.571640 24839 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:07:04.643543 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:04.615262 25043 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.600741 24993 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:04.610476 25013 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.501060 25023 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.540933 25039 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.679774 23079 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:04.570926 25018 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.685434 22546 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:04.688624 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 168278us
I20260709 13:07:04.688812 24982 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.568898 25016 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:04.691210 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44501.8us
I20260709 13:07:04.595952 24961 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.641566 22506 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:04.660048 24941 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.664023 25049 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:04.674217 23106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 622) took 1092 ms. Trace:
I20260709 13:07:04.673326 25051 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.664685 25060 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:04.642925 24715 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.717818 22431 raft_consensus.cc:2410] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:04.716115 23079 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:04.721606 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:04.675734 25084 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:04.690626 25043 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.580542 25029 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.590687 25055 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.724367 25090 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.699868 24993 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.724817 25037 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.725116 24886 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.722289 25051 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:04.726260 25071 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:04.726920 24715 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.698938 25062 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.733258 22578 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.735548 23079 leader_election.cc:400] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 5. Current term is 6.
I20260709 13:07:04.772943 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:04.716167 24808 consensus_meta.cc:287] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.001s
I20260709 13:07:04.747184 22474 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:04.698220 25030 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:04.715293 25070 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.766099 25066 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.744565 25084 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:04.769129 25051 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.695812 25040 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.750214 25015 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:04.710841 25049 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.772200 25032 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.776182 25057 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.793143 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46055.3us
I20260709 13:07:04.804107 22474 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:04.716864 24982 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:04.790570 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 65330.8us
I20260709 13:07:04.806473 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:04.799494 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 94905.7us
W20260709 13:07:04.801162 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 164399us
I20260709 13:07:04.813369 22546 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:04.816519 24927 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:04.816947 24927 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.817301 24927 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.817368 22546 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:04.775653 24953 consensus_queue.cc:1059] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:07:04.750702 25037 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.797569 25062 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.796808 25047 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.797201 24839 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.799304 24764 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.786026 24789 consensus_queue.cc:1059] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:04.782243 24808 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.802541 25015 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:04.746526 25090 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.810153 25032 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.734675 25060 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.838435 25047 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.845186 25056 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.846601 25037 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.846819 25047 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.847239 25022 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.847775 25026 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:04.848526 25029 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.849699 25029 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.849815 25015 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.851122 25039 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.852167 24789 raft_consensus.cc:3055] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:04.852632 24789 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:04.853684 24982 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.853477 24789 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.854664 24789 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.855386 24808 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.787420 25066 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.857594 25066 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.829237 24886 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.858819 25023 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.841100 24896 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.838222 24953 raft_consensus.cc:3055] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:04.861119 24953 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:04.860615 25084 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.863520 22500 raft_consensus.cc:1240] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.865217 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:04.865890 23109 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:04.819097 25057 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.714390 23106 rpcz_store.cc:276] 0709 13:07:03.573604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.573980 (+   376us) service_pool.cc:224] Handling call
0709 13:07:03.588277 (+ 14297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.640778 (+ 52501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.641635 (+   857us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.709027 (+ 67392us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.893732 (+184705us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:03.893787 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.893880 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.625086 (+731206us) raft_consensus.cc:1685] finished
0709 13:07:04.634729 (+  9643us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.665974 (+ 31245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53027,"raft.queue_time_us":147709,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":18434,"thread_start_us":184247,"threads_started":1,"wal-append.queue_time_us":373293}
I20260709 13:07:04.872630 25068 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:04.840463 25025 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.875209 25086 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.875798 25057 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.876608 25080 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:04.876880 25068 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:04.877334 25068 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:07:04.878351 25093 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:07:04.878211 25068 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.879437 25068 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.879832 24927 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.882099 25044 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:04.787027 25070 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.882897 25037 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:04.847512 24839 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:04.877547 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:04.841280 25030 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.866087 24764 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:04.888402 25007 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.877233 25080 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.907289 25043 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.908529 25044 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.908954 25080 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.889384 24993 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.852274 25018 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.893536 22473 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:04.900780 23112 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.900830 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 84478.3us
W20260709 13:07:04.901938 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.903288 22578 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:04.904220 25016 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.898542 25026 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.904685 25040 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.892592 24900 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:04.905195 24839 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:04.902024 25030 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:04.893563 25090 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.918668 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1376) took 1105 ms. Trace:
I20260709 13:07:04.919124 22503 rpcz_store.cc:276] 0709 13:07:03.813268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.855338 (+ 42070us) service_pool.cc:224] Handling call
0709 13:07:03.855721 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:04.576841 (+721120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.576871 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:04.593557 (+ 16686us) log.cc:844] Serialized 52 byte log entry
0709 13:07:04.698072 (+104515us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.713629 (+ 15557us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.723750 (+ 10121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.724156 (+   406us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.888833 (+164677us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b1800352600. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d35522 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:07:04.918355 (+ 29522us) raft_consensus.cc:1685] finished
0709 13:07:04.918455 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.918605 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53509,"prepare.queue_time_us":32470,"prepare.run_wall_time_us":34,"raft.queue_time_us":472671,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":25210,"spinlock_wait_cycles":16506624,"thread_start_us":707452,"threads_started":2,"wal-append.queue_time_us":241530}
I20260709 13:07:04.917824 25030 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.921744 25070 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.923251 25051 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.929005 25051 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:04.944763 23104 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:04.884188 24663 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.992455 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:04.914940 25018 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:04.981053 25040 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:07:05.006057 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.007481 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.008800 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:04.990357 25051 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:05.010164 25051 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.010576 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:05.011255 23111 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.012733 24764 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.013193 22399 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:05.014599 24933 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:05.015316 24933 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:05.018329 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 191728us
I20260709 13:07:05.019212 22426 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.021870 23079 leader_election.cc:400] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7.
I20260709 13:07:05.022420 23079 leader_election.cc:403] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:05.023478 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.024502 23108 raft_consensus.cc:2410] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 13:07:05.033721 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 99103.9us
I20260709 13:07:05.038344 25099 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:05.038348 24906 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:07:05.040028 25053 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:07:05.047084 23111 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:05.048386 25043 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:05.048621 25099 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.049175 25099 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:04.934183 24953 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.051606 24993 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.051947 24900 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.053100 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:05.052939 24900 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.053488 25030 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.053977 25031 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7.
I20260709 13:07:05.052129 24993 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.055262 25007 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.049686 24927 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.934000 25026 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.055739 25007 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:05.057230 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.057881 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.058266 25007 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:05.004105 25037 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:07:05.058538 24993 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:05.059494 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:04.980000 25072 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:07:05.060272 22576 raft_consensus.cc:2410] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:05.060372 24900 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:04.917977 24839 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.001611 25018 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.063433 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:05.033133 22399 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:05.063854 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.066661 22580 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.069211 23112 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:05.069947 23113 raft_consensus.cc:1240] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:05.070340 22473 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:05.071218 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.071429 22399 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:05.074399 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.076184 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.055709 25030 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:05.074873 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.076462 23079 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:05.080801 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.020403 25051 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:05.081465 22575 raft_consensus.cc:2376] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6. Re-sending same reply.
I20260709 13:07:05.082087 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:05.085455 22501 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:05.085654 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.080960 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.086246 22582 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.086573 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.086970 25070 consensus_queue.cc:1059] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:05.088696 25026 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:05.075495 25007 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:05.089540 25007 raft_consensus.cc:697] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:05.087373 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:05.074456 24906 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.091146 24906 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:05.091562 24906 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.067239 25018 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.086505 22574 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:05.114225 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.114851 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:05.115302 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.073796 24961 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:05.117156 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 45776.5us
I20260709 13:07:05.117969 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.119029 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.078356 25072 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:05.119678 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.138298 22574 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:05.119889 22582 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:05.120348 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.096611 25015 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.143417 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:05.137008 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.144773 22581 raft_consensus.cc:2376] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7. Re-sending same reply.
I20260709 13:07:05.145694 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.077762 25043 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.138221 22575 raft_consensus.cc:2376] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6. Re-sending same reply.
I20260709 13:07:05.119256 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.072448 25055 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:05.078061 25053 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:05.136798 22503 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:07:05.138233 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:05.141309 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.146878 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.147555 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.090417 25007 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.138732 25037 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.185760 25019 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.234452 22573 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:05.172231 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:05.235401 22503 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.152812 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.149086 22580 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:05.152128 22399 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:05.238845 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 86820.7us
I20260709 13:07:05.239631 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:05.138447 25099 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:05.214191 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.147723 25072 raft_consensus.cc:697] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:05.241278 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.214640 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:05.233878 22582 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.243990 25055 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.248881 25090 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.247066 23076 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:05.255100 24906 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.152310 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.257170 24425 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.271205 24425 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:05.241593 25042 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:05.248996 25110 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:05.271960 24839 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.272450 24839 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.272881 24839 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.272450 25110 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.273456 24425 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:05.262650 22577 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:05.268174 23076 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:05.262998 25037 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.263262 25018 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.219919 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.286324 25018 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:05.185921 25053 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.265241 22503 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:05.151943 25043 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.270526 25055 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:05.259565 25107 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.002s
I20260709 13:07:05.301697 22582 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:05.240724 24993 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:05.277988 22581 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.185686 25106 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.308347 25106 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:05.308759 25106 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.265120 22474 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:05.275756 24663 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:05.290934 22501 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:05.292688 24906 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:05.293581 25090 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.298444 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.298698 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.307968 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:05.311694 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46655us
I20260709 13:07:05.235564 25019 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.374150 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.367308 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.312460 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.367897 22507 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:05.368149 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1373) took 1555 ms. Trace:
I20260709 13:07:05.375767 22502 rpcz_store.cc:276] 0709 13:07:03.812359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.814194 (+  1835us) service_pool.cc:224] Handling call
0709 13:07:03.947152 (+132958us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:07:03.947393 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.290316 (+342923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.290350 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.353049 (+ 62699us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.434157 (+ 81108us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:04.434277 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.434880 (+   603us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.366406 (+931526us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b24002b1078. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069bbb9c4 00007f0069bb9acb 00007f0069d74dc9 00007f0069d74a55 00007f0069d73fb0 00007f006c9ea488 00007f006c9eabe8 00007f006c9c2398 00007f006c9bd76a 00007f006c9bcbb6
0709 13:07:05.367920 (+  1514us) raft_consensus.cc:1685] finished
0709 13:07:05.367940 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.368079 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38329,"raft.queue_time_us":411622,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":10445824,"thread_start_us":300094,"threads_started":2,"wal-append.queue_time_us":348661}
I20260709 13:07:05.375696 22474 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:05.377889 23106 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:05.331863 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.378319 25026 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.378991 22579 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.379195 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:05.376892 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.379992 22573 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:05.380203 22574 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:05.380919 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.381181 25019 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:05.299190 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.382409 22573 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:05.382794 22474 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:05.381711 25026 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:05.385694 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.388283 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.388960 22573 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:07:05.389660 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.390113 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:05.394716 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.395838 22581 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:05.399665 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.331765 25018 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.331488 24993 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.314355 25055 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.411541 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:05.379614 25090 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.413242 22432 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:05.414148 25090 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:05.418396 25067 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.419006 25067 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.420913 22428 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:05.421799 25074 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.422318 25074 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.429522 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.431710 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.433022 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.435468 22573 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:07:05.435858 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:05.435470 22546 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.651s (SENT) [suppressed 45 similar messages]
I20260709 13:07:05.437296 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.443841 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.445123 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.445905 22429 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
W20260709 13:07:05.448516 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 66222.5us
I20260709 13:07:05.450052 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:05.402222 24425 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:05.451085 22429 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.458336 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:05.459055 22573 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.459553 25106 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.440198 24993 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:05.440543 25074 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:05.464099 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.463325 22474 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:05.464931 22580 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:05.430776 25043 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:05.466228 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1307) took 1441 ms. Trace:
I20260709 13:07:05.469071 22430 rpcz_store.cc:276] 0709 13:07:04.025207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.025323 (+   116us) service_pool.cc:224] Handling call
0709 13:07:04.025589 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.633506 (+607917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.465921 (+832415us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b540043ba54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:05.466155 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310934912}
I20260709 13:07:05.470717 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.467728 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.471804 22580 raft_consensus.cc:2410] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:05.477003 25092 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.477433 25106 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:05.445125 25067 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:05.485879 22573 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:05.488693 22429 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:05.490710 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.499899 22429 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:05.408607 25072 consensus_queue.cc:237] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.501026 22474 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:05.509497 22399 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:05.510809 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.514115 22474 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:05.512303 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:05.516530 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.517899 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.518536 22427 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:07:05.519426 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.520099 22430 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:05.505630 22472 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:05.523954 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:05.525166 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:05.511773 22429 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 2.
I20260709 13:07:05.469184 24425 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:05.529167 22472 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:05.530606 22573 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:05.532343 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:05.505013 25074 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.529376 25018 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.529100 25067 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.477631 25092 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:05.554777 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 119309us
I20260709 13:07:05.533561 25044 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:05.532630 25023 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.544358 25026 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:05.555624 25067 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:05.563638 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:05.567278 22427 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.470621 25053 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:05.556237 25043 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:05.561050 25023 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.572796 25067 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.563830 25026 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:05.573796 25074 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:05.582827 25023 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.596100 22427 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:07:05.598042 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.599855 22427 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:05.582561 25043 raft_consensus.cc:697] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:05.588766 25026 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.594926 25074 raft_consensus.cc:697] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:05.619393 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.602250 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.616698 25017 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:05.655998 23077 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:05.660284 25048 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:05.660974 25048 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.663064 25048 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:05.667414 24839 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:05.668565 25043 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.673487 25092 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:05.674604 25121 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:05.584323 24425 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:05.679950 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.679734 25017 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.682142 25017 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:05.691504 25055 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:05.644728 25120 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
W20260709 13:07:05.697077 25125 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:07:05.702075 25088 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.796s	user 0.002s	sys 0.000s
I20260709 13:07:05.703722 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:05.704965 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.705925 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:05.706391 22425 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.712960 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:05.713725 22505 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
W20260709 13:07:05.721088 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 65187.4us
I20260709 13:07:05.724107 22579 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:05.726373 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1377) took 1694 ms. Trace:
I20260709 13:07:05.727990 22504 rpcz_store.cc:276] 0709 13:07:04.032405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.033001 (+   596us) service_pool.cc:224] Handling call
0709 13:07:04.033323 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.515307 (+481984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.515378 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.542023 (+ 26645us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.657994 (+115971us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:04.658082 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.658202 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.701528 (+1043326us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:05.712882 (+ 11354us) raft_consensus.cc:1685] finished
0709 13:07:05.712904 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.726302 (+ 13398us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":350970,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":21454080,"thread_start_us":523273,"threads_started":2,"wal-append.queue_time_us":336643}
I20260709 13:07:05.727047 25048 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:05.737668 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 223716us
I20260709 13:07:05.732916 23077 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:05.745133 22474 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:05.745750 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 216697us
I20260709 13:07:05.745549 23107 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:05.758517 23076 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:05.759639 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:05.747751 25017 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.751246 22472 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:05.769860 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:05.751070 25015 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:05.757913 25027 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.747838 25018 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.838251 22425 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:05.839772 22425 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:05.841127 22425 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.743975 25074 consensus_queue.cc:237] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.754820 25072 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:07:05.771627 25053 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:05.888296 22504 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.899284 25043 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:05.890178 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 145995us
I20260709 13:07:05.906316 23077 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:05.868139 24962 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:05.868467 25015 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:05.911746 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:05.941062 25119 log.cc:927] Time spent T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.698s	user 0.003s	sys 0.000s
W20260709 13:07:05.941812 25124 log.cc:927] Time spent T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:07:05.937546 25043 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:05.901198 25053 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:05.951591 22505 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
W20260709 13:07:06.041306 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 135197us
I20260709 13:07:06.077366 23077 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:06.082067 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 318610us
W20260709 13:07:06.085101 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 315302us
I20260709 13:07:06.086651 22472 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:05.949478 25146 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:06.091403 25146 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.093626 25146 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:06.016111 25043 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:06.102213 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 1.28903e+06us
W20260709 13:07:05.982050 25127 log.cc:927] Time spent T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:07:06.103190 22545 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:06.107936 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 278) took 1046 ms. Trace:
I20260709 13:07:05.885877 25048 raft_consensus.cc:697] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:06.111706 22576 rpcz_store.cc:276] 0709 13:07:05.061151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.061254 (+   103us) service_pool.cc:224] Handling call
0709 13:07:05.061582 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.061948 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.062016 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.062520 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.277497 (+214977us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:05.280368 (+  2871us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.313328 (+ 32960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.313404 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.911699 (+598295us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:06.107622 (+195923us) raft_consensus.cc:1685] finished
0709 13:07:06.107715 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.107869 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8380,"prepare.queue_time_us":2328,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":32691,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":25495,"spinlock_wait_cycles":52242816,"thread_start_us":209366,"threads_started":1,"wal-append.queue_time_us":174653}
I20260709 13:07:05.949334 25018 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:06.124128 25136 log.cc:927] Time spent T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:07:06.086571 25133 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:06.125839 25133 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.135915 25145 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:06.021220 25144 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:07:06.136988 25145 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.988758 25015 raft_consensus.cc:697] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:06.086007 24663 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.110898 25129 log.cc:927] Time spent T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:07:06.166663 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.100414 24839 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:06.172374 22573 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:06.172518 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:06.124130 25137 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:07:05.983660 24962 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.100095 25132 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:06.115868 25146 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:06.166304 25023 consensus_meta.cc:287] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.556s	user 0.002s	sys 0.008s
I20260709 13:07:06.146600 25055 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:06.142383 25018 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.191066 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:06.141857 25017 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:06.204913 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 127638us
I20260709 13:07:06.208012 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.209760 24962 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:06.210619 24962 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:06.210984 24962 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.211302 24962 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.211401 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:06.212008 22433 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:06.213012 25026 consensus_meta.cc:287] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.003s
I20260709 13:07:06.213454 25026 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.215453 25026 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.175076 24663 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.218529 24663 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.219209 22433 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:06.190177 25132 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.221184 25132 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.227126 23077 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:06.228626 25030 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:06.232918 25030 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:06.234207 25143 raft_consensus.cc:3055] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:06.234584 25143 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:06.235374 25143 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.237030 25143 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.244563 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:06.249434 25075 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:06.250097 25075 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:06.250993 25075 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.252837 25030 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:06.254014 25030 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:06.254371 25030 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:06.255164 25030 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.196580 25018 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.261515 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:06.252859 25087 log.cc:927] Time spent T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 1.370s	user 0.002s	sys 0.010s
I20260709 13:07:06.128401 25133 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:06.192377 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.195204 25015 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.199227 25017 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.280094 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1310) took 2249 ms. Trace:
I20260709 13:07:06.284998 22426 rpcz_store.cc:276] 0709 13:07:04.030189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.030305 (+   116us) service_pool.cc:224] Handling call
0709 13:07:04.100862 (+ 70557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.019738 (+918876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.279823 (+1260085us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b540043bf54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:06.280026 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111614080}
I20260709 13:07:06.262326 25144 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:06.262543 25072 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:06.194432 25023 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.192915 25146 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:06.282609 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 179513us
I20260709 13:07:06.293905 22545 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:06.318349 25023 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.279136 25150 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:06.289180 25017 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:06.288456 25106 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.270488 25048 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.384543 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:06.385536 23112 raft_consensus.cc:2410] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:06.326573 25150 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:06.383448 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 89618.9us
I20260709 13:07:06.390472 22545 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:06.394286 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:06.312335 25072 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.399204 25012 raft_consensus.cc:3055] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:06.399756 25012 raft_consensus.cc:740] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:06.400703 25012 consensus_queue.cc:260] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.402277 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1283) took 1904 ms. Trace:
I20260709 13:07:06.402716 22500 rpcz_store.cc:276] 0709 13:07:04.498038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.498797 (+   759us) service_pool.cc:224] Handling call
0709 13:07:04.515311 (+ 16514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.863972 (+348661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.402007 (+1538035us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54000cc1d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:06.402211 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800277760}
I20260709 13:07:06.330646 25106 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.330904 25043 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.425414 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:06.429575 25146 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.390100 25053 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.390477 25150 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.432782 25161 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:06.440095 25161 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.440518 25161 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.443593 25028 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.445031 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1459) took 1999 ms. Trace:
I20260709 13:07:06.445466 22578 rpcz_store.cc:276] 0709 13:07:04.445739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.499694 (+ 53955us) service_pool.cc:224] Handling call
0709 13:07:04.521006 (+ 21312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.914227 (+393221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.444734 (+1530507us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400085f54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:06.444959 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487760256}
W20260709 13:07:06.460664 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 70272us
I20260709 13:07:06.469920 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1479) took 1048 ms. Trace:
I20260709 13:07:06.473400 23111 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:06.474828 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:06.480393 22431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1311) took 2446 ms (client timeout 2197 ms). Trace:
W20260709 13:07:06.481025 22431 rpcz_store.cc:269] 0709 13:07:04.030587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.030688 (+   101us) service_pool.cc:224] Handling call
0709 13:07:06.475551 (+2444863us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540003d254. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:06.476822 (+  1271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558308096}
I20260709 13:07:06.487290 25161 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.488436 25143 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.489007 25143 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.489516 25161 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:06.497655 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1483) took 1074 ms. Trace:
I20260709 13:07:06.498217 22573 rpcz_store.cc:276] 0709 13:07:05.423051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.278841 (+855790us) service_pool.cc:224] Handling call
0709 13:07:06.293267 (+ 14426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.293481 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:06.325012 (+ 31531us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.497216 (+172204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.497282 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:06.497335 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.497414 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.497580 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31913,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2606,"thread_start_us":171744,"threads_started":1}
W20260709 13:07:06.507100 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 103123us
W20260709 13:07:06.511818 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 181284us
I20260709 13:07:06.473017 25163 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.526672 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:06.538934 25143 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.541388 25106 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.543987 25072 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:06.544682 25146 raft_consensus.cc:1064] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:07:06.552680 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:06.553853 23111 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
W20260709 13:07:06.477577 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 389894us
I20260709 13:07:06.568663 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 2114) took 1195 ms. Trace:
I20260709 13:07:06.569315 22432 rpcz_store.cc:276] 0709 13:07:05.373627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.373782 (+   155us) service_pool.cc:224] Handling call
0709 13:07:06.568329 (+1194547us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b540038c2d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:06.568522 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86910336}
W20260709 13:07:06.575179 25027 consensus_meta.cc:287] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.002s
W20260709 13:07:06.575698 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.575971 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1478) took 1154 ms. Trace:
I20260709 13:07:06.576426 22582 rpcz_store.cc:276] 0709 13:07:05.421553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.250551 (+828998us) service_pool.cc:224] Handling call
0709 13:07:06.251047 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.251420 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.251448 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.252000 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.340681 (+ 88681us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:06.340729 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.340812 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.568726 (+227914us) raft_consensus.cc:1685] finished
0709 13:07:06.568758 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.575893 (+  7135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129311,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":10623,"thread_start_us":88237,"threads_started":1,"wal-append.queue_time_us":262417}
I20260709 13:07:06.576574 22398 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:06.589195 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2156) took 1344 ms. Trace:
I20260709 13:07:06.589079 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.590096 22580 rpcz_store.cc:276] 0709 13:07:05.244779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.534543 (+289764us) service_pool.cc:224] Handling call
0709 13:07:05.549847 (+ 15304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.550210 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.550236 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.550737 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.110045 (+559308us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b180001e400. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b 00007f006c9c1d23 00007f006c9c20d1 00007f006cddda0f
0709 13:07:06.338866 (+228821us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:06.579659 (+240793us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.580033 (+   374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.580116 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.580153 (+    37us) raft_consensus.cc:1685] finished
0709 13:07:06.588989 (+  8836us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.589137 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5130,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":1626,"spinlock_wait_cycles":3305216,"thread_start_us":403752,"threads_started":2,"wal-append.queue_time_us":911734}
I20260709 13:07:06.472169 22575 rpcz_store.cc:276] 0709 13:07:05.421915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.253093 (+831178us) service_pool.cc:224] Handling call
0709 13:07:06.253516 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.253754 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:06.262956 (+  9202us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.469572 (+206616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.469620 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.469670 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.469737 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.469861 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40605,"prepare.queue_time_us":15329,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":87931,"spinlock_wait_cycles":9384320,"thread_start_us":165578,"threads_started":2,"wal-append.queue_time_us":136034}
I20260709 13:07:06.595683 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.603457 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.580305 25060 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:06.611230 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.588655 24941 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.609639 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:06.612066 22507 raft_consensus.cc:2410] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:06.613068 22502 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.613206 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:06.617213 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.617748 22503 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.597550 24764 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:06.618877 22429 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.548445 25146 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.620297 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.602455 25163 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:06.623440 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.634879 22433 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:06.608652 24425 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.621408 25149 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:06.627609 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.624210 24941 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.632848 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.610929 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:06.588212 25024 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:06.588451 25018 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.664114 22575 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:06.649418 22502 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:06.664355 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:06.649727 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.611311 25155 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.611027 25133 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:06.608750 25170 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:06.618436 25176 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:06.679952 23104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 344) took 1689 ms. Trace:
I20260709 13:07:06.682852 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1476) took 1343 ms. Trace:
I20260709 13:07:06.684947 25176 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.685494 22576 rpcz_store.cc:276] 0709 13:07:05.339767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.201296 (+861529us) service_pool.cc:224] Handling call
0709 13:07:06.271026 (+ 69730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.391699 (+120673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.391768 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.393908 (+  2140us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.537601 (+143693us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:06.537663 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.537770 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.682651 (+144881us) raft_consensus.cc:1685] finished
0709 13:07:06.682669 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.682788 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135022,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":11983,"thread_start_us":230213,"threads_started":2,"wal-append.queue_time_us":250330}
I20260709 13:07:06.680286 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1477) took 1292 ms. Trace:
I20260709 13:07:06.687602 25170 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.687400 22574 rpcz_store.cc:276] 0709 13:07:05.387827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.203693 (+815866us) service_pool.cc:224] Handling call
0709 13:07:06.204076 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.291912 (+ 87836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.291942 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.314286 (+ 22344us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.473988 (+159702us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:06.474637 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.474850 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.680073 (+205223us) raft_consensus.cc:1685] finished
0709 13:07:06.680090 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.680225 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":650,"raft.queue_time_us":131249,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":47534,"thread_start_us":229845,"threads_started":2,"wal-append.queue_time_us":346740}
I20260709 13:07:06.687362 25176 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.687873 23104 rpcz_store.cc:276] 0709 13:07:04.990292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.990469 (+   177us) service_pool.cc:224] Handling call
0709 13:07:04.990803 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.991165 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.991193 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.402664 (+1411471us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b2c00047618. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:06.403120 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.592306 (+189186us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.592346 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.592419 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.679593 (+ 87174us) raft_consensus.cc:1685] finished
0709 13:07:06.679612 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.679888 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":261,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4873,"spinlock_wait_cycles":13300096,"thread_start_us":188793,"threads_started":1,"wal-append.queue_time_us":274080}
I20260709 13:07:06.690649 25170 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:06.691586 25133 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.677532 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.691655 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:06.693688 25133 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.677206 25155 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.695554 22429 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:06.695457 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.697185 22427 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:06.649308 25067 consensus_meta.cc:287] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 1.055s	user 0.009s	sys 0.005s
I20260709 13:07:06.702463 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.701865 22503 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:06.705892 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.706514 22500 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:06.706677 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.664333 25149 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.708367 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.709249 22506 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:06.709949 25149 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:06.710251 25116 log.cc:927] Time spent T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 1.467s	user 0.000s	sys 0.002s
I20260709 13:07:06.710096 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:06.716912 22499 raft_consensus.cc:2393] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:06.681046 25132 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:06.636209 25172 consensus_queue.cc:1059] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:07:06.721525 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.701203 25043 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:06.723541 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.723421 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.731602 22503 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:06.727392 25017 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.737406 23104 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:06.737406 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.663885 24425 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.740088 23109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 338) took 1799 ms. Trace:
I20260709 13:07:06.739257 22427 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:06.741640 22429 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:06.739300 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.739681 22398 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:06.749114 23109 rpcz_store.cc:276] 0709 13:07:04.940267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.940449 (+   182us) service_pool.cc:224] Handling call
0709 13:07:04.940877 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.981064 (+ 40187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.981092 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.024209 (+ 43117us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.211190 (+186981us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:05.211233 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.211302 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.709568 (+1498266us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:06.711313 (+  1745us) raft_consensus.cc:1685] finished
0709 13:07:06.711335 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.740028 (+ 28693us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":331,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6462,"spinlock_wait_cycles":3190656,"thread_start_us":127651,"threads_started":1,"wal-append.queue_time_us":175710}
I20260709 13:07:06.756875 22425 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:06.757673 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:06.758204 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:06.758260 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.759095 23104 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.759279 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:06.759743 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:06.679483 25163 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.712459 25176 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:06.762290 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.704589 25067 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.767877 22500 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:06.762588 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.770016 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.770728 22425 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:06.762754 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.764700 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.771795 22427 raft_consensus.cc:2393] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:06.765553 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.772236 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.766547 22433 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:06.772871 22429 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:06.774061 25185 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:06.774531 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.774727 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.776994 22500 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:07:06.772648 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.777854 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:06.769882 22545 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:06.778383 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.778890 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.779034 22425 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:06.779704 22500 raft_consensus.cc:2410] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:06.780525 22502 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:06.773698 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.785583 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.787103 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.787753 22500 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:06.788669 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.789270 22500 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:06.790297 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:06.790879 22500 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
W20260709 13:07:06.792138 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 46653.4us
I20260709 13:07:06.793970 22500 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:06.795892 22500 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:06.798184 22424 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:06.800582 25172 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.801127 24425 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.801864 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:06.810097 23104 raft_consensus.cc:2410] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:06.729346 25132 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.815125 22545 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:06.815949 22431 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:06.816290 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:06.785959 25170 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:07:06.818205 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:06.818509 24961 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:06.819566 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.820065 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:06.820314 22429 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:06.802515 24962 consensus_meta.cc:287] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.001s
I20260709 13:07:06.827664 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:06.829959 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.831349 22429 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:06.801577 25185 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:06.838526 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:06.827848 25156 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:06.839920 22503 raft_consensus.cc:2410] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:06.803670 25172 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.841856 22545 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:06.763835 25150 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.775962 25176 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:06.834565 25170 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:06.827543 24896 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:06.843719 25172 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.853125 23108 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.853353 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.854135 22424 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
W20260709 13:07:06.855901 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 68907us
I20260709 13:07:06.843685 24961 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.833532 25048 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:07:06.846436 25170 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.846935 25016 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.835012 24962 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.849427 24896 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:06.849277 25156 consensus_queue.cc:1059] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:07:06.857658 24961 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.877285 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.878991 22427 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:06.862923 25170 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.873333 24896 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.881959 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:06.886348 22424 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:06.891947 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.893164 25163 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:06.893515 25150 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:06.895452 25017 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.897003 25176 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:06.897128 23107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59018 (request call id 491) took 1600 ms (client timeout 1817 ms). Trace:
W20260709 13:07:06.897682 23107 rpcz_store.cc:269] 0709 13:07:05.297239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.298817 (+  1578us) service_pool.cc:224] Handling call
0709 13:07:06.896796 (+1597979us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400543654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:06.897056 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794746112}
W20260709 13:07:06.901034 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 108038us
I20260709 13:07:06.901791 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:06.902513 22574 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:06.862078 25016 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:06.879714 24961 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.907933 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:06.913393 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.915835 25170 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.918514 25170 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:06.922451 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 323) took 1782 ms. Trace:
I20260709 13:07:06.936724 22508 rpcz_store.cc:276] 0709 13:07:05.140502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.140788 (+   286us) service_pool.cc:224] Handling call
0709 13:07:05.150798 (+ 10010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.408186 (+257388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.408214 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.408256 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:05.408286 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.922194 (+1513908us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54002e95d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:06.922251 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.922388 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591489792}
I20260709 13:07:06.939217 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1480) took 1517 ms. Trace:
I20260709 13:07:06.940446 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.939635 22579 rpcz_store.cc:276] 0709 13:07:05.422204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.256762 (+834558us) service_pool.cc:224] Handling call
0709 13:07:06.257179 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:06.257518 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.257544 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:06.258128 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 13:07:06.341010 (+ 82882us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.585047 (+244037us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b18003b64a0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069cafc0a 00007f00733ef219 00007f0069d37a40 00007f0069d324e4 00007f0069d32455 00007f007081a3c7 00007f006ce2c9a7 00007f006ce3c0bf 00007f006ce3c038
0709 13:07:06.700691 (+115644us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.702941 (+  2250us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.704058 (+  1117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.704115 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.929714 (+225599us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18003b64a0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:07:06.939009 (+  9295us) raft_consensus.cc:1685] finished
0709 13:07:06.939029 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.939153 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64083,"prepare.queue_time_us":295163,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":141579,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":39360,"spinlock_wait_cycles":15723136,"thread_start_us":172547,"threads_started":2,"wal-append.queue_time_us":142056}
I20260709 13:07:06.928395 22504 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:06.933643 22575 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:06.935811 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.943432 22574 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
W20260709 13:07:06.934196 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.945119 22582 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:06.946341 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.947962 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:06.949360 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:06.950868 22474 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:06.906450 25016 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.954509 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:06.955977 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.956975 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.958070 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:06.960935 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:06.958359 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.958998 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.962527 25171 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.962393 25193 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:07:06.963532 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.960870 22574 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:06.964236 22428 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:06.924640 25030 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.966979 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.967754 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.969043 22427 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:06.920440 24941 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.923293 25132 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.923569 25067 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:06.969743 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:06.922524 25155 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:06.954556 25053 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:06.969919 25170 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.970311 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:06.974095 25170 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:06.975593 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 340) took 2032 ms. Trace:
I20260709 13:07:06.976002 23113 rpcz_store.cc:276] 0709 13:07:04.942803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.981238 (+ 38435us) service_pool.cc:224] Handling call
0709 13:07:05.069729 (+ 88491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.070394 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.975357 (+1904963us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b54005573d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:06.975512 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10894720}
I20260709 13:07:06.978307 24663 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:06.981312 25113 log.cc:927] Time spent T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 1.756s	user 0.008s	sys 0.004s
I20260709 13:07:06.952342 25133 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:06.988304 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:06.962988 25171 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.970028 25060 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:06.986313 24962 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:06.954641 25146 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:06.995266 25171 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.987229 24941 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:07.013468 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.030022 24789 raft_consensus.cc:3055] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:07.043046 25032 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:07:07.061100 23077 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:07.064952 23077 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:07.065796 25015 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.066532 25015 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.066911 25015 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:07.067355 25015 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:07.068840 22581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2147) took 1948 ms (client timeout 2160 ms). Trace:
W20260709 13:07:07.069263 22581 rpcz_store.cc:269] 0709 13:07:05.120204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.152084 (+ 31880us) service_pool.cc:224] Handling call
0709 13:07:07.068666 (+1916582us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b540016d0d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:07.068780 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20376448}
I20260709 13:07:07.071174 23105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 486) took 2067 ms. Trace:
I20260709 13:07:07.071606 23105 rpcz_store.cc:276] 0709 13:07:05.003441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.009824 (+  6383us) service_pool.cc:224] Handling call
0709 13:07:05.010148 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.024587 (+ 14439us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:05.143135 (+118548us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.375996 (+232861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.382165 (+  6169us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:05.385478 (+  3313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.070910 (+1685432us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b54002977d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:07.070960 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.071110 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34631,"prepare.queue_time_us":131470,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":22957,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7716,"spinlock_wait_cycles":17903872,"thread_start_us":246113,"threads_started":2,"wal-append.queue_time_us":427046,"wal-append.run_cpu_time_us":1820,"wal-append.run_wall_time_us":1094415}
I20260709 13:07:07.077039 25015 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.063308 25012 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.080276 25145 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:07.083976 25145 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:07.084897 25145 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.085443 25049 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:07.064460 24962 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:07.086638 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:07.086035 25049 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:07.087240 22432 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.087661 25049 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:07.088034 25049 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:07.089095 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 280) took 1585 ms. Trace:
I20260709 13:07:07.060890 25110 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:07.037428 25172 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.088802 25049 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.093042 25049 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.089515 22430 rpcz_store.cc:276] 0709 13:07:05.503634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.608168 (+104534us) service_pool.cc:224] Handling call
0709 13:07:06.475726 (+867558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.475931 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:06.476191 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.589921 (+113730us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.589980 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:06.590021 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.590090 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.088930 (+498840us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b540003d250. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:07.089039 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1073,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":41,"raft.queue_time_us":7548,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5102,"spinlock_wait_cycles":2150183936,"thread_start_us":113424,"threads_started":1,"wal-append.queue_time_us":231452}
I20260709 13:07:07.086788 24962 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:07.100510 24962 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:07.096632 22432 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:07.061137 24789 raft_consensus.cc:740] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:07.093542 25172 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:07.103361 24789 consensus_queue.cc:260] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.106010 24789 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.104854 23077 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:07.108275 24839 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.108842 24839 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:07.104015 25150 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:07.109697 24839 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.110472 25150 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:07.119406 22501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 321) took 2005 ms (client timeout 2133 ms). Trace:
I20260709 13:07:07.119580 22507 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:07:07.119824 25178 log.cc:927] Time spent T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.412s	user 0.000s	sys 0.003s
W20260709 13:07:07.119939 22501 rpcz_store.cc:269] 0709 13:07:05.113769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.114594 (+   825us) service_pool.cc:224] Handling call
0709 13:07:07.119101 (+2004507us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54001829d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:07.119331 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397654400}
W20260709 13:07:07.143231 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.174597 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:07.060364 24896 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.181941 22399 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:07.185964 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:07.187297 22399 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:07.191495 22399 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:07.193536 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:07.197232 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:07.189883 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 342281us
I20260709 13:07:07.190058 24587 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.189958 25106 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.190220 25067 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:07.221208 24663 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:07.207996 25043 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.246068 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:07.247668 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:07.246872 23108 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 3.
I20260709 13:07:07.231240 25185 raft_consensus.cc:697] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:07.259855 22424 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
W20260709 13:07:07.259299 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 47459.3us
I20260709 13:07:07.232972 25194 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.241022 25067 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:07.242324 24663 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:07.285064 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 334851us
I20260709 13:07:07.255416 25106 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.250536 25053 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:07.297278 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.297796 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 311722us
I20260709 13:07:07.299342 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:07.300904 25044 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:07.301345 25044 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:07.301723 25044 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.302485 25133 consensus_queue.cc:1059] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:07.303452 25133 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:07.304693 25074 raft_consensus.cc:3055] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:07.305202 25074 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:07.305301 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:07.309052 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:07.311060 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:07.311102 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:07.316511 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 414730us
I20260709 13:07:07.293337 25067 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.293241 24663 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.343637 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:07.344277 22501 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.247391 25043 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.346184 22502 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:07.295077 25172 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:07.352770 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:07.352950 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.354413 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:07.355146 22575 raft_consensus.cc:2368] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8.
I20260709 13:07:07.357893 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.358541 22508 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:07.359361 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.360985 24896 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:07.353436 22500 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:07.364789 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:07.365512 22508 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.351976 22502 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:07.368455 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.371016 22499 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:07.372623 22472 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:07.318138 25143 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.378393 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.318588 25106 raft_consensus.cc:697] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:07.386407 22501 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:07.347046 24587 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:07:07.343176 24993 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.395139 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:07.351138 25149 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:07.398975 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 134515us
I20260709 13:07:07.370005 24941 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.348896 25203 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:07.349915 25176 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.379958 25060 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:07.407588 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:07.429069 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:07.430189 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:07.433332 22499 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.433946 22581 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:07.407416 25026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.045s	sys 0.054s
I20260709 13:07:07.433213 22501 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.318238 25185 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.372998 25172 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.425208 25203 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.392076 25143 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.469946 22508 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:07.471527 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:07.474967 22581 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.406322 24961 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.446585 24425 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.486426 22499 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:07.487449 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.488041 22499 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 3.
I20260709 13:07:07.490211 22508 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:07.491305 22581 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
W20260709 13:07:07.480394 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 107899us
W20260709 13:07:07.492408 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.493522 22472 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:07.494809 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:07.498978 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:07.424911 24993 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.518260 25074 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.519611 25074 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.521734 25172 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:07.523124 25204 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.523574 25204 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:07.523933 25204 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.467715 25106 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.528523 25133 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:07.442301 25176 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.505110 24961 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:07.497504 25163 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:07.537485 22581 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:07:07.511538 25030 consensus_meta.cc:287] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
W20260709 13:07:07.513329 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.513516 25170 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:07.514328 25208 log.cc:927] Time spent T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:07:07.515726 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:07.440738 25060 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.427474 24941 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.462133 25203 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.536258 22501 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:07.537096 22508 raft_consensus.cc:1240] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:07.423213 25053 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.512666 25155 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:07.538446 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:07.558115 22577 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.496140 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:07.476778 25205 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:07.536264 25172 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.563203 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 67131us
I20260709 13:07:07.567219 22577 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:07.586287 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:07:07.589324 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 231163us
I20260709 13:07:07.595886 23112 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:07.597496 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:07.598523 22573 raft_consensus.cc:2410] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:07.598563 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:07.529798 25171 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.603905 22508 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:07.553262 25143 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:07.609141 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 200556us
I20260709 13:07:07.610409 22472 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:07.541476 25163 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.615029 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:07.615592 22472 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:07.615845 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 298432us
I20260709 13:07:07.589656 25026 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:07.617645 22472 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:07.621165 22508 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:07.621340 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:07.606951 25149 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:07.625543 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:07.626475 22577 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:07.597877 25172 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.629347 25172 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:07.625844 22545 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:07.634826 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:07.607754 25181 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.638899 25181 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.611860 24425 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:07.645205 22573 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.645357 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:07.603036 25030 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:07.601827 25044 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.649847 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:07.650451 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:07.656814 22508 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.623072 25027 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.631299 25170 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.590026 25205 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.644023 25214 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:07.663403 25214 raft_consensus.cc:697] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:07.663779 25200 log.cc:927] Time spent T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:07:07.665352 25205 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:07.655164 25173 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.666240 25173 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:07.662700 25170 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:07.653417 24961 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.644331 24425 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:07.644567 25181 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:07.672391 24789 consensus_meta.cc:287] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.566s	user 0.018s	sys 0.002s
I20260709 13:07:07.663681 24953 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.644017 25143 consensus_queue.cc:1059] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:07.659446 25027 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.681121 22472 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:07.689177 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:07.655121 25156 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:07.660235 25224 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.697362 25171 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:07.655236 25012 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:07:07.706761 24941 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:07.709650 25044 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:07.712505 23112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59018 (request call id 501) took 1113 ms. Trace:
I20260709 13:07:07.712931 23112 rpcz_store.cc:276] 0709 13:07:06.599159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.623307 (+ 24148us) service_pool.cc:224] Handling call
0709 13:07:07.712317 (+1089010us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b5400606b54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:07.712424 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2014768000}
W20260709 13:07:07.676571 25016 consensus_meta.cc:287] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.002s
I20260709 13:07:07.692353 25176 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:07.677943 25170 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.704705 24993 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:07.667112 25173 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:07.698951 25049 consensus_meta.cc:287] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.605s	user 0.017s	sys 0.004s
I20260709 13:07:07.681998 24425 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.705132 25060 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:07.745193 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:07.690879 24961 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:07.713213 25132 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:07.752946 22508 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:07.766101 22500 raft_consensus.cc:2410] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:07.766449 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.767185 22508 raft_consensus.cc:2393] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 3: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:07.754645 24663 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:07.701905 25043 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:07.699330 25027 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.720078 22573 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
W20260709 13:07:07.754514 25226 log.cc:927] Time spent T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:07.756613 25214 consensus_queue.cc:237] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.762353 22578 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
W20260709 13:07:07.768314 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 87275.3us
I20260709 13:07:07.689976 25220 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.741305 25163 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:07.788195 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.791018 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:07.799575 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.800922 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.801985 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:07.802377 25074 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:07.803067 25074 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.804075 24663 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:07.806512 25222 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:07:07.744364 25016 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.808068 24425 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.802955 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:07.819320 22318 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4d35c45e33c4336b33461cdbe7f7b6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 10c2f471167442c0b75d8cd50ed8c40c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:07.821635 24425 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:07.782586 24900 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.822695 22508 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:07.688277 25149 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.783223 25060 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:07.772092 25132 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:07.801996 25179 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 1.033s	user 0.001s	sys 0.008s
I20260709 13:07:07.846534 23109 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:07.846668 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:07.847334 23108 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.851709 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.854424 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.855578 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.856954 25132 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.858227 25132 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.856125 22508 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:07.858608 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.860926 22503 raft_consensus.cc:2393] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:07.828675 24993 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:07.859680 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.821601 25016 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:07.764379 24961 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.865631 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:07.896378 23109 raft_consensus.cc:2393] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:07:07.868991 25225 log.cc:927] Time spent T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:07:07.872774 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:07.874650 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2130) took 1280 ms. Trace:
I20260709 13:07:07.881072 22508 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:07.902909 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.903828 22503 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:07.902631 22431 rpcz_store.cc:276] 0709 13:07:06.594382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.594562 (+   180us) service_pool.cc:224] Handling call
0709 13:07:06.606452 (+ 11890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.816358 (+209906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.874401 (+1058043us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001e73d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:07.874586 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481355136}
I20260709 13:07:07.824887 25067 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.810523 25203 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.908025 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.863648 25060 raft_consensus.cc:697] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:07.888680 23108 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:07.843343 24900 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:07.875731 24993 raft_consensus.cc:697] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:08.131419 24425 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.103158 25067 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:07.910013 23107 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:08.083329 25170 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:08.144917 22577 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:08.145843 23076 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:08.146168 25170 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:08.104251 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2134) took 1500 ms. Trace:
I20260709 13:07:07.945540 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1298) took 1272 ms. Trace:
I20260709 13:07:08.101768 25181 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:08.070031 25204 consensus_meta.cc:287] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.004s
W20260709 13:07:08.123154 22504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1291) took 1512 ms (client timeout 1651 ms). Trace:
W20260709 13:07:08.150197 22504 rpcz_store.cc:269] 0709 13:07:06.610607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.610709 (+   102us) service_pool.cc:224] Handling call
0709 13:07:08.122942 (+1512233us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b54003ab954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:08.123085 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95694080}
W20260709 13:07:08.119885 22545 leader_election.cc:336] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.651s (SENT)
I20260709 13:07:07.954655 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:08.147068 22426 rpcz_store.cc:276] 0709 13:07:06.604310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.604540 (+   230us) service_pool.cc:224] Handling call
0709 13:07:06.621312 (+ 16772us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:07.443550 (+822238us) spinlock_profiling.cc:243] Waited 897 us on lock 0x7b180021d2a0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f006c9ca4bc 00007f0069d1848b 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f006ce1a060 00007f006ce1abfb 00007f006ce2564b
0709 13:07:07.443713 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.443738 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:07.444360 (+   622us) log.cc:844] Serialized 52 byte log entry
0709 13:07:07.612513 (+168153us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:07.612578 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.612676 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.103910 (+491234us) raft_consensus.cc:1685] finished
0709 13:07:08.103930 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.104172 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3821,"raft.queue_time_us":12142,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":26803,"spinlock_wait_cycles":2063744,"thread_start_us":174580,"threads_started":2,"wal-append.queue_time_us":195299}
W20260709 13:07:07.988979 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.148322 22505 rpcz_store.cc:276] 0709 13:07:06.672889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.673053 (+   164us) service_pool.cc:224] Handling call
0709 13:07:06.703786 (+ 30733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.711876 (+  8090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.711904 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.711945 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.711976 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.945274 (+1233298us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b54003eb554. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:07.945319 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.945474 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18131200}
I20260709 13:07:08.171669 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:07.939900 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:08.173070 22500 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.144390 24425 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:08.180116 22501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.003s	sys 0.032s
W20260709 13:07:08.180502 22501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.003s	sys 0.032s
I20260709 13:07:08.149474 25204 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:08.130807 22473 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:08.121563 25015 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:08.193589 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:08.195010 22504 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:08.197806 25204 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:08.197939 24425 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:08.201236 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:08.201874 22503 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.116034 25043 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.203459 22547 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:08.205385 23113 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:08.206221 22506 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.921169 25150 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:08.220105 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 89414.6us
I20260709 13:07:08.221318 22473 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:08.240535 22500 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:08.251375 22545 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:08.254074 25060 consensus_queue.cc:237] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:08.254586 24993 consensus_queue.cc:237] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:07.905905 25027 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:08.209403 25016 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:08.258808 25016 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:08.259295 25016 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.253942 23107 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:08.209600 25043 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:08.271450 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:08.206923 25132 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:08.212034 25213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.015s	sys 0.039s
I20260709 13:07:08.272346 22500 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:08.271831 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:08.281809 22504 raft_consensus.cc:2393] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:08.218483 25196 consensus_queue.cc:1059] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:07:08.283746 25196 raft_consensus.cc:3055] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:08.284102 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:08.271104 25170 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:08.288658 22504 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:08.284942 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:08.218278 25193 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 13:07:08.299202 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.284118 25204 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:08.291424 22503 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:08.313005 22506 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:08.281888 25156 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:08.286329 25213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.015s	sys 0.040s
I20260709 13:07:08.288057 25196 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:08.280961 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 59764.8us
I20260709 13:07:08.327368 22473 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:08.293910 25043 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:08.276436 25209 consensus_queue.cc:1059] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:07:08.294800 25181 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:08.316985 25204 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:08.343585 22473 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:08.317983 25055 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:08.294364 25170 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:08.330233 25231 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:07:08.329036 22399 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.006s	sys 0.044s
I20260709 13:07:08.362255 24425 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:08.365048 22399 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.007s	sys 0.044s
W20260709 13:07:08.365510 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 719786us
I20260709 13:07:08.375178 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.376293 22429 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:07:08.377980 22424 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:08.380055 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.380283 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.381767 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.382265 22430 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:08.383385 22433 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:08.320261 25156 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:08.383859 22426 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:08.345923 25204 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.350360 25043 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.392804 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.393081 22431 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:08.401399 25181 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:08.402393 25181 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:08.384238 25027 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:08.425415 22396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.014s	sys 0.019s
I20260709 13:07:08.426867 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:08.427601 22396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.014s	sys 0.019s
I20260709 13:07:08.427798 22429 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.371479 25055 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:08.438205 25170 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:08.441545 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.442165 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.442273 22432 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:08.445910 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.449554 22429 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:08.450729 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.451380 22429 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:08.453014 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.453410 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.453893 22432 raft_consensus.cc:2393] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:08.453836 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.454494 22425 raft_consensus.cc:2410] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:08.455389 22424 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.456419 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.457103 22426 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.458182 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.459430 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.460660 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.472076 22427 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:08.433233 25213 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:08.476358 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.476078 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.440228 25156 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:08.481606 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.483598 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1296) took 1819 ms. Trace:
I20260709 13:07:08.484076 22507 rpcz_store.cc:276] 0709 13:07:06.664358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.664529 (+   171us) service_pool.cc:224] Handling call
0709 13:07:07.119291 (+454762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.120409 (+  1118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.483411 (+1363002us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54001829d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:08.483540 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044950784}
I20260709 13:07:08.396744 25196 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:08.487547 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.488250 22427 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.499454 22426 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:08.505446 22428 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.509464 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:08.512850 22574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.018s	sys 0.016s
W20260709 13:07:08.513223 22574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.018s	sys 0.016s
I20260709 13:07:08.477437 25181 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:08.489534 25154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.012s	sys 0.029s
W20260709 13:07:08.510291 25143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.017s	sys 0.025s
I20260709 13:07:08.533349 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.534052 22431 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.462921 25153 consensus_queue.cc:1059] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:07:08.544376 22424 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:08.452237 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.559195 22429 raft_consensus.cc:2410] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:07:08.546160 25143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.018s	sys 0.026s
W20260709 13:07:08.572930 22575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.005s	sys 0.018s
W20260709 13:07:08.573405 22575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.005s	sys 0.018s
I20260709 13:07:08.516505 25196 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:08.538395 25154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.014s	sys 0.029s
I20260709 13:07:08.485106 24425 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:07:08.583451 22427 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
W20260709 13:07:08.545578 24961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.002s	sys 0.010s
I20260709 13:07:08.597384 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.597782 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.510368 25156 consensus_queue.cc:1059] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:07:08.602130 25018 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:08.609084 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1489) took 1110 ms. Trace:
W20260709 13:07:08.658123 23111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.011s	sys 0.014s
I20260709 13:07:08.658385 22581 rpcz_store.cc:276] 0709 13:07:07.498365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.498690 (+   325us) service_pool.cc:224] Handling call
0709 13:07:08.608831 (+1110141us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b540009bd54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:08.609011 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86655744}
I20260709 13:07:08.609284 25016 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:08.610379 25132 consensus_queue.cc:1059] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:08.611558 25232 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:08.612196 25203 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:08.614410 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.617223 23076 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:08.665998 22427 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:08.665990 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48847.3us
I20260709 13:07:08.619166 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.627950 22431 raft_consensus.cc:2410] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:08.630422 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.573213 25181 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:08.483605 25213 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:08.633957 25055 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:08.610431 25056 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:07:08.657217 22429 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:08.673677 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.675380 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:08.663556 23111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.011s	sys 0.014s
I20260709 13:07:08.667568 22424 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
W20260709 13:07:08.653244 25026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.044s	sys 0.058s
I20260709 13:07:08.678378 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.679212 22433 raft_consensus.cc:2410] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:08.646533 25219 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.681389 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.690101 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:08.634645 25173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.011s	sys 0.007s
I20260709 13:07:08.679958 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.697129 22431 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.646680 25032 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:08.696286 22546 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.019s
W20260709 13:07:08.664634 24961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.002s	sys 0.010s
W20260709 13:07:08.681870 25185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.045s	sys 0.056s
W20260709 13:07:08.700495 22546 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.005s	sys 0.019s
I20260709 13:07:08.703928 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:08.681089 25026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.044s	sys 0.058s
W20260709 13:07:08.706128 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 523146us
I20260709 13:07:08.706312 22424 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.726616 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.765822 22427 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:08.767154 22429 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:08.768923 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:08.769294 22429 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:08.771028 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.771651 22429 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
W20260709 13:07:08.773609 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.703202 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.678272 25143 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:08.696767 25173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.012s	sys 0.007s
I20260709 13:07:08.787206 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1322) took 1432 ms. Trace:
I20260709 13:07:08.787648 22501 rpcz_store.cc:276] 0709 13:07:07.354292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.561894 (+207602us) service_pool.cc:224] Handling call
0709 13:07:07.562236 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.599818 (+ 37582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.599851 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.606686 (+  6835us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.180943 (+574257us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:08.180984 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.181051 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.786971 (+605920us) raft_consensus.cc:1685] finished
0709 13:07:08.786993 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.787141 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37173,"raft.queue_time_us":37780,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6271,"thread_start_us":547271,"threads_started":1,"wal-append.queue_time_us":841130}
I20260709 13:07:08.789616 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:08.764732 25185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.045s	sys 0.056s
I20260709 13:07:08.782052 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.695461 25048 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:08.784186 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.802549 22433 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.776228 25132 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.681979 25181 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:08.786207 25156 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.779286 22431 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
W20260709 13:07:08.699640 24933 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.006s	sys 0.019s
I20260709 13:07:08.765959 25026 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:08.765007 25032 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:08.784632 25143 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.806788 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:08.868525 22501 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:08.810895 25051 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.799875 22424 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
W20260709 13:07:08.873910 22579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.017s	sys 0.013s
W20260709 13:07:08.811004 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.873729 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1386) took 1229 ms. Trace:
I20260709 13:07:08.813930 25181 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:08.804642 24953 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:07:08.858919 24587 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.776434 25054 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.075s	user 0.008s	sys 0.029s
I20260709 13:07:08.834110 22433 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:08.792588 24961 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:08.805117 25194 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.851569 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:08.892532 22505 raft_consensus.cc:2393] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:08.810761 25132 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:08.838670 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1495) took 1166 ms. Trace:
I20260709 13:07:08.811797 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:08.810936 25233 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:07:08.794503 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:08.888581 25053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.010s	sys 0.023s
I20260709 13:07:08.839089 25182 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.775552 25219 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:08.874466 22501 rpcz_store.cc:276] 0709 13:07:07.644647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.872957 (+1228310us) service_pool.cc:224] Handling call
0709 13:07:08.873251 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.873424 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.873451 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.873490 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:08.873521 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.873573 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.873676 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.872143 24933 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.007s	sys 0.019s
I20260709 13:07:08.804544 25089 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:07:08.804366 25154 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:07:08.831195 25048 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.811770 22546 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:08.819471 24839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.008s	sys 0.022s
W20260709 13:07:08.973230 24839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.009s	sys 0.022s
I20260709 13:07:08.974984 23112 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:08.890796 22579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.017s	sys 0.013s
I20260709 13:07:08.869904 25143 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.865837 23110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 339) took 3909 ms. Trace:
I20260709 13:07:08.852413 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:08.980895 23110 rpcz_store.cc:276] 0709 13:07:04.940632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.989958 (+ 49326us) service_pool.cc:224] Handling call
0709 13:07:05.006598 (+ 16640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.006994 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.007026 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.059786 (+2052760us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b2c00047618. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:07.060247 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.258591 (+198344us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:07.345935 (+ 87344us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.803729 (+1457794us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5400553aa0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006cd9d733 00007f006ce22dbf 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c
0709 13:07:08.805270 (+  1541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.809172 (+  3902us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.819121 (+  9949us) raft_consensus.cc:1685] finished
0709 13:07:08.819143 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.849997 (+ 30854us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55789,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":23929,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":7396,"spinlock_wait_cycles":70290688,"thread_start_us":424223,"threads_started":2,"wal-append.queue_time_us":231721,"wal-append.run_cpu_time_us":3800,"wal-append.run_wall_time_us":1401303}
I20260709 13:07:08.818799 25156 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:08.859227 25015 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:08.871687 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:08.889492 24587 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.010001 22426 raft_consensus.cc:2368] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5.
I20260709 13:07:09.013638 25032 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:09.016306 23113 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:09.017843 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:09.018486 23111 raft_consensus.cc:2376] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7. Re-sending same reply.
I20260709 13:07:08.895716 25238 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
W20260709 13:07:09.030542 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 228217us
W20260709 13:07:09.033070 22548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.012s	sys 0.026s
W20260709 13:07:09.033499 22548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.012s	sys 0.026s
W20260709 13:07:08.870266 25198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.015s	sys 0.015s
I20260709 13:07:08.923563 22429 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
W20260709 13:07:08.889534 25054 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.008s	sys 0.029s
W20260709 13:07:08.889685 25214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.002s	sys 0.031s
W20260709 13:07:08.889575 24993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.012s	sys 0.018s
I20260709 13:07:08.860177 25173 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:07:08.885670 25209 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.939133 25182 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:08.939478 22501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:58706
I20260709 13:07:09.076934 22501 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:09.077353 22501 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.897537 22577 rpcz_store.cc:276] 0709 13:07:07.672596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.673163 (+   567us) service_pool.cc:224] Handling call
0709 13:07:07.673460 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.145326 (+471866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.838373 (+693047us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400045e54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:08.838597 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083818240}
W20260709 13:07:08.925261 25053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.010s	sys 0.023s
I20260709 13:07:08.893664 25016 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:08.894721 25195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.215s	user 0.025s	sys 0.015s
W20260709 13:07:08.960736 25163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.039s	sys 0.063s
I20260709 13:07:09.096508 22398 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:08.923650 23078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.245s	user 0.012s	sys 0.025s
W20260709 13:07:09.097591 23078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.419s	user 0.012s	sys 0.025s
W20260709 13:07:09.073712 24993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.012s	sys 0.018s
W20260709 13:07:09.056545 22472 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.003s	sys 0.015s
I20260709 13:07:09.055625 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:09.055892 22430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.038s	sys 0.053s
W20260709 13:07:09.032655 25060 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.003s	sys 0.031s
I20260709 13:07:08.997686 25155 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.997460 25213 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:09.123594 22430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.038s	sys 0.060s
W20260709 13:07:09.061151 25198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.017s	sys 0.016s
W20260709 13:07:09.064550 25214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.003s	sys 0.031s
I20260709 13:07:08.992924 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1499) took 1184 ms. Trace:
I20260709 13:07:09.075959 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:08.977634 25026 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:09.125128 22472 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.003s	sys 0.015s
I20260709 13:07:09.121570 22499 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:07:09.165104 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1492) took 1564 ms. Trace:
W20260709 13:07:09.158020 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 615531us
W20260709 13:07:09.164333 22578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2173) took 2230 ms (client timeout 1746 ms). Trace:
W20260709 13:07:09.165830 22578 rpcz_store.cc:269] 0709 13:07:06.934135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.941599 (+  7464us) service_pool.cc:224] Handling call
0709 13:07:09.140754 (+2199155us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54002d14d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:09.164259 (+ 23505us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874888448}
W20260709 13:07:09.165169 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 68751.8us
W20260709 13:07:09.164652 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 109230us
I20260709 13:07:09.169920 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:09.131985 22579 rpcz_store.cc:276] 0709 13:07:07.808831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.809159 (+   328us) service_pool.cc:224] Handling call
0709 13:07:07.844026 (+ 34867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.844267 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:07.860160 (+ 15893us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.992511 (+1132351us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.992580 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:08.992633 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.992709 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.992851 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234015,"prepare.queue_time_us":50805,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":12962,"raft.queue_time_us":19895,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":16541,"thread_start_us":1115928,"threads_started":1,"wal-append.queue_time_us":1167452}
I20260709 13:07:09.165575 22573 rpcz_store.cc:276] 0709 13:07:07.601209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.602494 (+  1285us) service_pool.cc:224] Handling call
0709 13:07:09.140963 (+1538469us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b540009a954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:09.165047 (+ 24084us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68022016}
I20260709 13:07:09.173923 22425 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:07:09.094691 25195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.422s	user 0.026s	sys 0.020s
W20260709 13:07:09.124812 25060 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.004s	sys 0.037s
W20260709 13:07:09.096843 25163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.039s	sys 0.063s
W20260709 13:07:09.187776 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.176741 25153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.024s	sys 0.028s
I20260709 13:07:09.164824 25161 raft_consensus.cc:3055] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:09.166421 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:09.200941 23108 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:09.182103 25245 log.cc:927] Time spent T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.154s	user 0.001s	sys 0.001s
I20260709 13:07:09.223875 22582 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:09.217718 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 436384us
W20260709 13:07:09.185564 25243 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 13:07:09.187194 25220 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.181109 25242 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:09.101441 25106 consensus_queue.cc:1059] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 13:07:09.217985 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 369200us
I20260709 13:07:09.216856 22501 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.236171 23076 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:09.236419 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 293) took 2284 ms. Trace:
W20260709 13:07:09.195694 25153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.024s	sys 0.028s
I20260709 13:07:09.183401 24993 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:09.093825 25209 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:09.195608 25170 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.017s	sys 0.035s
I20260709 13:07:09.199059 22546 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:09.315284 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 116282us
I20260709 13:07:09.183859 25181 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:09.178972 24961 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:09.202909 25252 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.232s	user 0.000s	sys 0.002s
W20260709 13:07:09.223031 25218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.522s	user 0.015s	sys 0.019s
I20260709 13:07:09.316207 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:09.331295 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:09.268169 22472 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:09.331910 22501 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:09.332393 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 64317.4us
I20260709 13:07:09.295907 22582 rpcz_store.cc:276] 0709 13:07:06.951917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.187178 (+2235261us) service_pool.cc:224] Handling call
0709 13:07:09.223662 (+ 36484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.236126 (+ 12464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.236354 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.206862 25154 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:09.317345 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 81180.7us
I20260709 13:07:09.326201 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:09.203256 25161 raft_consensus.cc:740] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:09.318290 25170 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.018s	sys 0.035s
I20260709 13:07:09.293768 25195 raft_consensus.cc:3055] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:09.333907 22472 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:09.398443 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 64603.3us
I20260709 13:07:09.294296 25146 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.301133 25132 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:09.386163 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 54946.7us
I20260709 13:07:09.317775 25016 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.383800 24587 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:09.330073 25218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.636s	user 0.018s	sys 0.019s
I20260709 13:07:09.392746 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58706 (request call id 1388) took 1681 ms. Trace:
I20260709 13:07:09.317699 25024 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:09.396550 22425 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:09.319799 25219 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:09.323140 25156 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:09.326886 25173 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.399326 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1498) took 1634 ms. Trace:
I20260709 13:07:09.324777 25242 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:09.401336 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:09.335489 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:09.394070 25154 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.266548 25220 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:09.410426 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:09.412045 25240 log.cc:927] Time spent T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.310s	user 0.000s	sys 0.000s
I20260709 13:07:09.388381 24993 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.388082 25163 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:09.413503 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.325939 25181 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:09.398026 25195 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:09.337313 25260 consensus_queue.cc:1059] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:07:09.409818 25146 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.416742 25043 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:09.669373 22501 rpcz_store.cc:276] 0709 13:07:07.658967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.926964 (+1267997us) service_pool.cc:224] Handling call
0709 13:07:09.332359 (+405395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.681192 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:09.681919 22501 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
W20260709 13:07:09.417371 25257 log.cc:927] Time spent T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:07:09.672835 25024 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.670900 22575 rpcz_store.cc:276] 0709 13:07:07.765276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.766769 (+  1493us) service_pool.cc:224] Handling call
0709 13:07:07.767102 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.767449 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.767474 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.779841 (+ 12367us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.573768 (+793927us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:08.573813 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.573893 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.399110 (+825217us) raft_consensus.cc:1685] finished
0709 13:07:09.399129 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.399256 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9553,"raft.queue_time_us":5089,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4861,"thread_start_us":751596,"threads_started":1,"wal-append.queue_time_us":1141687}
I20260709 13:07:09.669986 25195 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:09.685874 25195 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:09.474457 25249 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:07:09.671099 25173 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:09.650744 25251 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260709 13:07:09.474982 25255 log.cc:927] Time spent T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:07:09.687925 25173 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:09.676039 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 265710us
I20260709 13:07:09.676170 25220 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:09.676797 25156 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.691743 22546 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:09.407967 25149 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:09.489553 25161 consensus_queue.cc:260] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:09.473898 25250 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
W20260709 13:07:09.469745 25262 log.cc:927] Time spent T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:09.520897 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:09.678275 25154 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:09.462284 24900 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:09.679036 25204 consensus_meta.cc:287] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 1.266s	user 0.009s	sys 0.024s
W20260709 13:07:09.412362 25239 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:07:09.407182 25235 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:09.700135 25173 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:09.660430 25264 log.cc:927] Time spent T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 13:07:09.670248 25209 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:09.682785 25132 raft_consensus.cc:3055] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:09.684794 25024 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:09.702832 25204 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:09.473726 25247 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:07:09.642007 25253 log.cc:927] Time spent T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.456s	user 0.000s	sys 0.001s
I20260709 13:07:09.693053 24993 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.696244 25156 consensus_queue.cc:1059] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:09.587756 25171 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:09.695734 25149 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.686452 25043 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:09.705565 25171 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.706380 25043 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:09.686556 25143 consensus_meta.cc:287] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.007s
I20260709 13:07:09.707546 25143 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:09.699386 25181 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:09.701934 25235 raft_consensus.cc:697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:09.671588 25242 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:09.702896 25132 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:09.709712 25143 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:09.709550 25132 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:09.704911 25204 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:09.709507 25235 consensus_queue.cc:237] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.711124 25132 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.714689 25149 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:09.704524 25173 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:09.752394 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.391487 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:09.756856 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1334) took 1322 ms. Trace:
W20260709 13:07:09.759617 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 360118us
I20260709 13:07:09.760274 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1346) took 1296 ms. Trace:
I20260709 13:07:09.760905 22428 rpcz_store.cc:276] 0709 13:07:08.463852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.482874 (+ 19022us) service_pool.cc:224] Handling call
0709 13:07:08.505228 (+ 22354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.505897 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.759686 (+1253789us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b54001e64d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:09.760054 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50583424}
I20260709 13:07:09.764945 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:09.766244 22431 raft_consensus.cc:3055] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:09.766757 22431 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:09.768368 22431 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.770366 22431 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.677820 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1387) took 2032 ms. Trace:
W20260709 13:07:09.777087 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 85302.6us
I20260709 13:07:09.777273 22505 rpcz_store.cc:276] 0709 13:07:07.644925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.893219 (+1248294us) service_pool.cc:224] Handling call
0709 13:07:08.928503 (+ 35284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.928889 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.928919 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.948131 (+ 19212us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.192966 (+244835us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:09.193030 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.193126 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.482077 (+288951us) raft_consensus.cc:1685] finished
0709 13:07:09.482097 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.677757 (+195660us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"thread_start_us":160919,"threads_started":1,"wal-append.queue_time_us":404416}
I20260709 13:07:09.774885 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:09.781545 22501 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:09.782145 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:09.782878 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:09.776520 22507 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.757485 22430 rpcz_store.cc:276] 0709 13:07:08.434505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.434804 (+   299us) service_pool.cc:224] Handling call
0709 13:07:08.435162 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:08.435547 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.435575 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:08.437694 (+  2119us) log.cc:844] Serialized 52 byte log entry
0709 13:07:09.124900 (+687206us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:09.124962 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.125034 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.756284 (+631250us) raft_consensus.cc:1685] finished
0709 13:07:09.756318 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.756646 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":546,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":120,"thread_start_us":686442,"threads_started":1,"wal-append.queue_time_us":807324}
I20260709 13:07:09.785892 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:09.700110 23110 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:09.791905 22546 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:09.802748 22546 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:09.806378 25149 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:09.807189 25235 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:09.811056 24900 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:09.811951 25154 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.815871 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:09.817078 22501 raft_consensus.cc:2368] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5.
I20260709 13:07:09.821309 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:09.823345 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:09.824995 24993 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:09.825681 24993 raft_consensus.cc:697] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:09.827174 24993 consensus_queue.cc:237] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.830356 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:09.832352 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:09.833245 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:09.833372 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:09.834304 22425 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:09.834614 23110 raft_consensus.cc:2410] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:09.818262 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:09.807240 25204 consensus_queue.cc:1059] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:07:09.842170 22502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1324) took 2487 ms (client timeout 2217 ms). Trace:
W20260709 13:07:09.842622 22502 rpcz_store.cc:269] 0709 13:07:07.354752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.378104 (+ 23352us) service_pool.cc:224] Handling call
0709 13:07:09.841713 (+2463609us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b54001847d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:09.841987 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4636507520}
I20260709 13:07:09.844928 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1395) took 2156 ms. Trace:
I20260709 13:07:09.845363 22500 rpcz_store.cc:276] 0709 13:07:07.688556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.284674 (+596118us) service_pool.cc:224] Handling call
0709 13:07:09.844550 (+1559876us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540021bbd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:09.844755 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3405281152}
I20260709 13:07:09.846640 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:09.847983 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:09.849277 22504 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:09.850131 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 47659.1us
I20260709 13:07:09.853161 25195 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.853773 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:09.855881 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.856251 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:09.856904 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:09.857854 23113 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.856238 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1391) took 2180 ms. Trace:
I20260709 13:07:09.807189 25149 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:09.861346 25149 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:09.841140 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:09.841979 22432 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:09.893997 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.869220 25204 raft_consensus.cc:3055] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:12.255625 24933 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.255939 25067 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:12.256304 24933 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.256695 25067 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:09.995136 25154 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:09.839872 25235 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:11.880681 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 2179) took 2051 ms. Trace:
W20260709 13:07:12.003494 23113 consensus_meta.cc:287] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 2.145s	user 0.010s	sys 0.047s
I20260709 13:07:12.019085 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.387044 23113 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:12.031999 25285 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:12.035246 25012 raft_consensus.cc:3055] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.048684 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2172) took 2286 ms. Trace:
W20260709 13:07:12.387650 23113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59008 (request call id 652) took 2532 ms (client timeout 1635 ms). Trace:
I20260709 13:07:12.050002 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1385) took 4405 ms. Trace:
W20260709 13:07:12.008755 22474 connection.cc:256] RPC call timeout handler was delayed by -1.8638136060000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:07:12.051048 22426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.279s	user 0.047s	sys 0.070s
W20260709 13:07:12.388266 23113 rpcz_store.cc:269] 0709 13:07:09.855616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.856389 (+   773us) service_pool.cc:224] Handling call
0709 13:07:12.387583 (+2531194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:12.072160 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 2.21981e+06us
W20260709 13:07:12.093268 25246 log.cc:927] Time spent T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 3.063s	user 0.000s	sys 0.026s
W20260709 13:07:12.388532 22474 connection.cc:256] RPC call timeout handler was delayed by -1.8566136059999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 13:07:12.394068 22474 connection.cc:256] RPC call timeout handler was delayed by -1.8519760589999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2764s for a response
I20260709 13:07:12.097410 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 334) took 4744 ms. Trace:
W20260709 13:07:12.105577 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.108596 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:12.395606 23111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59008 (request call id 642) took 3261 ms (client timeout 2193 ms). Trace:
I20260709 13:07:12.112720 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:12.396711 25235 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.397369 25235 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.397549 25056 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.398160 25056 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.398027 25235 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.399869 25056 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.400259 25056 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.130944 25089 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.404954 25089 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:12.406940 22472 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.528s (SENT) [suppressed 38 similar messages]
I20260709 13:07:12.407292 25089 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:12.137794 22431 consensus_meta.cc:287] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 2.367s	user 0.020s	sys 0.021s
I20260709 13:07:12.151558 25017 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:12.407997 22431 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:07:12.408700 22431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 2174) took 2644 ms (client timeout 2839 ms). Trace:
I20260709 13:07:12.408345 25017 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:12.409096 22431 rpcz_store.cc:269] 0709 13:07:09.764095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.764304 (+   209us) service_pool.cc:224] Handling call
0709 13:07:12.408607 (+2644303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.158665 25146 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.411047 25056 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.167071 25217 raft_consensus.cc:3055] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:12.175127 24425 raft_consensus.cc:3055] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:12.187865 25024 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.191689 25060 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:12.417502 24425 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:12.196233 25153 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:12.198382 22473 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:12.199678 25196 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:12.423588 25024 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.416831 25217 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:12.220798 22398 connection.cc:256] RPC call timeout handler was delayed by -1.606543767000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260709 13:07:12.426609 25146 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:12.222934 25040 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.425547 25217 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.427357 25145 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.223523 25213 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.430694 25213 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:12.245362 22362 debug-util.cc:398] Leaking SignalData structure 0x7b0800091a40 after lost signal to thread 21315
I20260709 13:07:12.249598 25032 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.254086 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.258334 25023 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.437640 25023 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.438076 25032 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.439949 25023 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.255630 25204 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:12.424347 24425 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.441186 25204 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.441922 24425 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.442409 25182 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.265318 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1328) took 4636 ms. Trace:
W20260709 13:07:12.442986 22317 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4d35c45e33c4336b33461cdbe7f7b6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:12.267333 25210 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:12.444819 25210 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.446406 23112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 353) took 4618 ms. Trace:
I20260709 13:07:12.446566 25217 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.446846 23112 rpcz_store.cc:276] 0709 13:07:07.828069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.829069 (+  1000us) service_pool.cc:224] Handling call
0709 13:07:07.829345 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.975376 (+1146031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.445920 (+3470544us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54006644d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:12.446227 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2634282368}
I20260709 13:07:12.447414 25210 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.268904 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2176) took 2475 ms. Trace:
I20260709 13:07:06.228971 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:12.269753 25051 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.448556 25032 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.281939 25198 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:12.284638 25143 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.461771 25143 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.443562 22504 rpcz_store.cc:276] 0709 13:07:07.628420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.305575 (+677155us) service_pool.cc:224] Handling call
0709 13:07:09.848864 (+1543289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.849866 (+  1002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.265061 (+2415195us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540021bbd0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:12.265250 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3548224384}
I20260709 13:07:12.464385 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:12.465714 25028 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:12.466368 25028 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.467181 25092 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.467777 25092 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.470701 25092 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.476235 25028 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.481202 22504 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:12.482278 25056 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.483994 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:12.485253 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:12.487195 22504 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:12.285203 23077 connection.cc:256] RPC call timeout handler was delayed by -1.800848348000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 13:07:12.488835 23077 connection.cc:256] RPC call timeout handler was delayed by -1.59639095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 13:07:12.489462 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:12.491240 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:12.286674 25067 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.288614 22501 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
W20260709 13:07:12.503008 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 76994.2us
I20260709 13:07:12.291074 25193 raft_consensus.cc:3055] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.859668 22505 rpcz_store.cc:276] 0709 13:07:07.675714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.854970 (+2179256us) service_pool.cc:224] Handling call
0709 13:07:09.855464 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.855841 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.855872 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.855928 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:09.855957 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.856013 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.856139 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:12.301549 22508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1407) took 4451 ms (client timeout 2420 ms). Trace:
I20260709 13:07:12.307870 25075 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.308713 23079 connection.cc:256] RPC call timeout handler was delayed by -2.6357171380000182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 13:07:12.316951 25173 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:12.504956 22508 rpcz_store.cc:269] 0709 13:07:07.850196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.301127 (+4450931us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:12.301357 (+   230us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:12.330756 25155 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.348799 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.362828 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:12.513770 22427 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:07:12.514333 22427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 2178) took 2685 ms (client timeout 1739 ms). Trace:
W20260709 13:07:12.514693 22427 rpcz_store.cc:269] 0709 13:07:09.828955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.839357 (+ 10402us) service_pool.cc:224] Handling call
0709 13:07:12.514264 (+2674907us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:12.364215 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.364948 25018 raft_consensus.cc:3055] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:12.387110 22500 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.386790 22430 rpcz_store.cc:276] 0709 13:07:09.829381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.838754 (+  9373us) service_pool.cc:224] Handling call
0709 13:07:11.880569 (+2041815us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:12.062345 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.070919 25149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.090s	user 0.001s	sys 0.027s
W20260709 13:07:12.389984 22426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.619s	user 0.048s	sys 0.071s
I20260709 13:07:12.390471 25285 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.387884 25012 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:12.388080 22428 rpcz_store.cc:276] 0709 13:07:09.762983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.796123 (+ 33140us) service_pool.cc:224] Handling call
0709 13:07:09.811267 (+ 15144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.048085 (+2236818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.048129 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.048209 (+    80us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:12.048284 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.048376 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.048584 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26513,"raft.queue_time_us":2235924,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":226,"spinlock_wait_cycles":558976}
I20260709 13:07:12.388917 22507 rpcz_store.cc:276] 0709 13:07:07.644339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.496212 (+851873us) service_pool.cc:224] Handling call
0709 13:07:08.496508 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.784903 (+1288395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.028338 (+2243435us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400175cd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:12.049895 (+ 21557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2942076160}
W20260709 13:07:12.387434 23108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59008 (request call id 647) took 3059 ms (client timeout 3068 ms). Trace:
I20260709 13:07:12.394596 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:12.395998 23111 rpcz_store.cc:269] 0709 13:07:09.134152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.200530 (+ 66378us) service_pool.cc:224] Handling call
0709 13:07:12.108220 (+2907690us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:07:12.395522 (+287302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67506944}
I20260709 13:07:12.119029 24961 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.394907 22474 connection.cc:256] RPC call timeout handler was delayed by -1.7926110339999468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2677s for a response
I20260709 13:07:12.394843 22499 rpcz_store.cc:276] 0709 13:07:07.352617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.488635 (+136018us) service_pool.cc:224] Handling call
0709 13:07:07.489047 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.165499 (+1676452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.096838 (+2931339us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003eb054. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:12.097217 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3753833856}
I20260709 13:07:12.193001 22503 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:12.400370 25235 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.424232 25196 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.522876 25075 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.427627 25040 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.524210 25285 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:12.516160 25018 raft_consensus.cc:740] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:12.525422 25075 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.526049 25040 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.428902 25017 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.236944 25171 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.427407 25060 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:12.424669 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 226466us
I20260709 13:07:12.433255 25213 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:12.433907 22362 debug-util.cc:398] Leaking SignalData structure 0x7b08001b26e0 after lost signal to thread 22365
I20260709 13:07:12.530284 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:12.530517 22362 debug-util.cc:398] Leaking SignalData structure 0x7b0800354e80 after lost signal to thread 22457
I20260709 13:07:12.448241 22432 rpcz_store.cc:276] 0709 13:07:09.793644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.796047 (+  2403us) service_pool.cc:224] Handling call
0709 13:07:09.838876 (+ 42829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.268585 (+2429709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.268835 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.448997 25051 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.457187 25204 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:12.458597 22396 connection.cc:256] RPC call timeout handler was delayed by -2.1042181019998907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2998s for a response
I20260709 13:07:12.459203 25054 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:12.459976 25055 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:12.534348 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:12.534117 25055 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.534551 25012 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.535290 25060 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.535691 25012 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.460669 25198 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.536691 25156 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.538115 25198 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.286271 24933 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.426470 25024 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:12.465611 22399 connection.cc:256] RPC call timeout handler was delayed by -2.3153426090000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 13:07:12.539124 22399 connection.cc:256] RPC call timeout handler was delayed by -2.1416426089999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 13:07:12.539480 22399 connection.cc:256] RPC call timeout handler was delayed by -2.1112530720000677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:07:12.539773 22399 connection.cc:256] RPC call timeout handler was delayed by -2.0203530720000344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 13:07:12.540040 22399 connection.cc:256] RPC call timeout handler was delayed by -1.8214530720000539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 13:07:12.540314 22399 connection.cc:256] RPC call timeout handler was delayed by -1.7079154969999308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260709 13:07:12.534003 22473 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:12.540633 22399 connection.cc:256] RPC call timeout handler was delayed by -1.4565642579999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20260709 13:07:12.540928 22399 connection.cc:256] RPC call timeout handler was delayed by -1.2038749580000285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.242s for a response
W20260709 13:07:12.494733 25244 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 3.497s	user 0.015s	sys 0.013s
I20260709 13:07:12.495443 25143 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.542403 25051 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.543062 25173 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.544201 22500 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
W20260709 13:07:12.500414 22330 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43642 (request call id 132) took 12182 ms (client timeout 15000 ms). Trace:
W20260709 13:07:12.506371 23079 connection.cc:256] RPC call timeout handler was delayed by -2.4350482880000754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 13:07:12.545256 23079 connection.cc:256] RPC call timeout handler was delayed by -2.1542482880000762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
W20260709 13:07:12.545615 23079 connection.cc:256] RPC call timeout handler was delayed by -1.9352756499999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:07:12.545904 23079 connection.cc:256] RPC call timeout handler was delayed by -1.2983482880000565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31190000000000007s for a response
W20260709 13:07:12.546208 23079 connection.cc:256] RPC call timeout handler was delayed by -1.1552482880000525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32780000000000004s for a response
I20260709 13:07:12.329485 25154 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:12.517386 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.517416 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:12.504438 25193 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:12.525606 25018 consensus_queue.cc:260] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:12.551529 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 157158us
I20260709 13:07:12.432225 25153 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.517781 22328 catalog_manager.cc:5697] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 4 to 7, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 7 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:12.526989 25171 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:12.524461 25196 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:12.527529 25074 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:12.527356 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.522877 25026 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.520327 23108 rpcz_store.cc:269] 0709 13:07:09.327582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.327721 (+   139us) service_pool.cc:224] Handling call
0709 13:07:12.018665 (+2690944us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b5800063c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:07:12.387338 (+368673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11977984}
W20260709 13:07:12.531678 22362 debug-util.cc:398] Leaking SignalData structure 0x7b08002b93e0 after lost signal to thread 22532
I20260709 13:07:12.526394 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1330) took 4897 ms. Trace:
W20260709 13:07:12.531581 22396 connection.cc:256] RPC call timeout handler was delayed by -1.9887928839999631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
I20260709 13:07:12.535140 22507 raft_consensus.cc:2393] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:12.496026 22506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1389) took 4827 ms (client timeout 2189 ms). Trace:
W20260709 13:07:12.558625 22362 debug-util.cc:398] Leaking SignalData structure 0x7b080005d1a0 after lost signal to thread 22533
I20260709 13:07:12.547919 22505 raft_consensus.cc:2410] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:12.544133 22473 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:12.521994 25056 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.550276 25154 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.550408 25193 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.570797 25193 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.561729 25156 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:07:12.571769 25026 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.551690 25018 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:12.518647 25149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.538s	user 0.002s	sys 0.028s
I20260709 13:07:12.552836 22502 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:12.577304 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 91166.4us
W20260709 13:07:12.526808 22474 connection.cc:256] RPC call timeout handler was delayed by -1.5622242169999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3068s for a response
W20260709 13:07:12.580848 22474 connection.cc:256] RPC call timeout handler was delayed by -1.544313605999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
I20260709 13:07:12.553912 25171 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.554325 25285 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:12.553762 22328 catalog_manager.cc:5697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 4, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 4 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:12.550423 25173 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:12.554981 25089 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.540712 25054 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:12.558307 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.503207 22501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1343) took 3301 ms (client timeout 2046 ms). Trace:
W20260709 13:07:12.558668 22396 connection.cc:256] RPC call timeout handler was delayed by -1.95405494299996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:07:12.603820 22396 connection.cc:256] RPC call timeout handler was delayed by -1.9221928839999691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 13:07:12.604161 22396 connection.cc:256] RPC call timeout handler was delayed by -1.7484928839999156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 13:07:12.559814 22362 debug-util.cc:398] Leaking SignalData structure 0x7b080034f280 after lost signal to thread 22606
I20260709 13:07:12.517858 25155 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.526079 24961 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.558251 22503 rpcz_store.cc:276] 0709 13:07:07.628960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.310148 (+681188us) service_pool.cc:224] Handling call
0709 13:07:08.310481 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.524915 (+4214434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.526101 (+  1186us) spinlock_profiling.cc:243] Waited 3.88 s on lock 0x7b5400218ed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:12.526341 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8927530752}
W20260709 13:07:12.558941 22506 rpcz_store.cc:269] 0709 13:07:07.668460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.954385 (+285925us) service_pool.cc:224] Handling call
0709 13:07:12.460220 (+4505835us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b5400183dd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:12.460457 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124498688}
I20260709 13:07:12.597596 25171 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:12.561153 22500 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1345) took 3358 ms (client timeout 2069 ms). Trace:
I20260709 13:07:12.569734 22504 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:12.605963 22506 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:12.569128 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:12.606648 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1401) took 4861 ms. Trace:
I20260709 13:07:12.565282 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:12.606987 22506 rpcz_store.cc:276] 0709 13:07:07.744913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.605392 (+4860479us) service_pool.cc:224] Handling call
0709 13:07:12.605753 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.606424 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.606598 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.607692 22499 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.547436 25055 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:12.593237 22545 connection.cc:256] RPC call timeout handler was delayed by -1.7694079880000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:07:12.609431 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 65359.5us
I20260709 13:07:12.609660 23112 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:12.603175 22501 rpcz_store.cc:269] 0709 13:07:09.201679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.817815 (+616136us) service_pool.cc:224] Handling call
0709 13:07:12.503132 (+2685317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.593562 23111 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:12.594033 25196 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.594512 24993 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.594750 25156 consensus_queue.cc:1243] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:07:12.595744 22474 leader_election.cc:336] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.523s (SENT)
I20260709 13:07:12.595861 25153 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.596769 25145 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:12.597203 23110 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:12.597586 25154 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.598207 25074 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.594430 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.604652 22362 debug-util.cc:398] Leaking SignalData structure 0x7b08003f20c0 after lost signal to thread 22607
W20260709 13:07:12.605510 22500 rpcz_store.cc:269] 0709 13:07:09.202584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.846259 (+643675us) service_pool.cc:224] Handling call
0709 13:07:12.560958 (+2714699us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b54001833d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:12.561086 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5841178880}
W20260709 13:07:12.609634 22545 connection.cc:256] RPC call timeout handler was delayed by -1.7208079879999332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:07:12.620853 22545 connection.cc:256] RPC call timeout handler was delayed by -1.6398079880000296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 13:07:12.621207 22545 connection.cc:256] RPC call timeout handler was delayed by -1.5921079879999525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 13:07:12.613080 22472 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:12.621531 22545 connection.cc:256] RPC call timeout handler was delayed by -1.571407987999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 13:07:12.614238 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1402) took 4862 ms. Trace:
I20260709 13:07:12.562376 25161 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:12.621335 22362 debug-util.cc:398] Leaking SignalData structure 0x7b08003466e0 after lost signal to thread 23137
I20260709 13:07:12.618170 25056 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.623217 25156 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.623080 25285 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.623715 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:12.644579 25150 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.645339 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49644us
I20260709 13:07:12.645150 25150 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.646802 25285 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:12.647487 22474 leader_election.cc:336] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.746s (SENT)
I20260709 13:07:12.648015 22474 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:12.649969 25053 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.624310 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:12.651011 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.624528 25196 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.652429 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.653328 23112 raft_consensus.cc:2410] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:12.625734 25074 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.654928 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.620137 24993 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.656034 25074 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.656643 25149 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:12.657202 25149 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:12.657522 24993 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:12.658136 25149 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.660095 25026 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.626104 24961 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.622989 22473 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:12.662431 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:12.663874 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:12.664604 25153 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.665431 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:12.665705 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.665934 25171 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:12.666340 23104 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:12.666507 25171 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.667305 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.667430 25195 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:12.654280 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.623852 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.668500 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.669293 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.669643 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.654219 25196 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.670442 23104 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:12.670994 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.637208 25089 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:12.673336 23112 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:12.668004 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.667973 25195 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:12.670866 25171 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.676488 25195 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:12.677675 22474 leader_election.cc:336] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.756s (SENT)
I20260709 13:07:12.665361 25153 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:12.666057 22504 raft_consensus.cc:2376] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5. Re-sending same reply.
I20260709 13:07:12.679314 22473 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:12.679705 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:12.680053 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:12.680441 22473 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:12.672343 25056 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:12.680400 22504 raft_consensus.cc:2368] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8.
I20260709 13:07:12.680910 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:12.678558 22578 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:12.678596 23108 raft_consensus.cc:2393] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:12.682848 23113 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:12.636643 25155 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.639796 25132 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:12.669709 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.690178 23110 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:12.678203 22474 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:12.622378 22506 rpcz_store.cc:276] 0709 13:07:07.747377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.607744 (+4860367us) service_pool.cc:224] Handling call
0709 13:07:12.608071 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.608264 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.608289 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.608330 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.608358 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.608409 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.610077 (+  1668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.681906 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:12.635862 22362 debug-util.cc:398] Leaking SignalData structure 0x7b0800346700 after lost signal to thread 23138
W20260709 13:07:12.691934 22362 debug-util.cc:398] Leaking SignalData structure 0x7b080022aa40 after lost signal to thread 24663
I20260709 13:07:12.644150 22502 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:12.692607 23106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 649) took 3267 ms. Trace:
I20260709 13:07:12.691934 22504 raft_consensus.cc:2376] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5. Re-sending same reply.
I20260709 13:07:12.696700 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.684595 22582 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:12.685851 22499 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:12.678758 25153 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.687178 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:12.680706 22577 raft_consensus.cc:2376] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7. Re-sending same reply.
I20260709 13:07:12.687362 22328 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 6, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 6 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:12.757460 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2173) took 2994 ms. Trace:
W20260709 13:07:12.682464 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 66474.2us
I20260709 13:07:12.666287 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:12.759730 22573 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.687533 25026 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.617283 25210 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:12.692667 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1399) took 4951 ms. Trace:
I20260709 13:07:12.667521 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:12.693101 25056 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.693131 22503 raft_consensus.cc:1240] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:12.693711 22362 debug-util.cc:398] Leaking SignalData structure 0x7b080015c8a0 after lost signal to thread 25016
I20260709 13:07:12.674662 25089 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.692848 25074 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:12.677953 25195 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.693897 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:12.694932 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:12.695732 22578 raft_consensus.cc:1240] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:12.694380 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:12.699666 22576 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:12.732928 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:12.665834 25054 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:12.692793 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:12.545133 22330 rpcz_store.cc:269] 0709 13:07:00.318457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.321520 (+  3063us) service_pool.cc:224] Handling call
0709 13:07:12.500150 (+12178630us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:04.272883 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:04.273617 (+   734us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:04.273655 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:04.273676 (+    21us) tablet.cc:662] Decoding operations
0709 13:07:04.420679 (+147003us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:04.430859 (+ 10180us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:04.434312 (+  3453us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:07:04.792672 (+358360us) tablet.cc:701] Row locks acquired
0709 13:07:04.797332 (+  4660us) write_op.cc:260] PREPARE: finished
0709 13:07:04.810114 (+ 12782us) write_op.cc:270] Start()
0709 13:07:04.826631 (+ 16517us) write_op.cc:276] Timestamp: P: 1783602424806652 usec, L: 0
0709 13:07:04.829569 (+  2938us) op_driver.cc:348] REPLICATION: starting
0709 13:07:04.849047 (+ 19478us) log.cc:844] Serialized 6420 byte log entry
0709 13:07:05.554765 (+705718us) op_driver.cc:464] REPLICATION: finished
0709 13:07:06.131381 (+576616us) write_op.cc:301] APPLY: starting
0709 13:07:06.131477 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:06.131831 (+   354us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:06.131974 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:06.133940 (+  1966us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:06.134247 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:07:06.134296 (+    49us) write_op.cc:312] APPLY: finished
0709 13:07:06.134675 (+   379us) log.cc:844] Serialized 113 byte log entry
0709 13:07:06.174526 (+ 39851us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:06.187518 (+ 12992us) write_op.cc:454] Released schema lock
0709 13:07:06.192371 (+  4853us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:06.216195 (+ 23824us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:06.216221 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1904034,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":570912,"apply.run_cpu_time_us":4486,"apply.run_wall_time_us":84846,"num_ops":16,"prepare.queue_time_us":602269,"prepare.run_cpu_time_us":17161,"prepare.run_wall_time_us":716895,"raft.queue_time_us":193126,"raft.run_cpu_time_us":39515,"raft.run_wall_time_us":354008,"replication_time_us":701661,"thread_start_us":594934,"threads_started":4,"wal-append.queue_time_us":251424,"wal-append.run_cpu_time_us":16516,"wal-append.run_wall_time_us":2043417}]]}
I20260709 13:07:12.697340 23106 rpcz_store.cc:276] 0709 13:07:09.425157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.425289 (+   132us) service_pool.cc:224] Handling call
0709 13:07:09.669837 (+244548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.648899 (+2979062us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:12.648953 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.649009 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:12.649049 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.690300 (+ 41251us) spinlock_profiling.cc:243] Waited 2.98 s on lock 0x7b54005069d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:12.690341 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.692393 (+  2052us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":480,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":6850249472}
I20260709 13:07:12.699838 23111 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:12.717445 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.017802 22504 raft_consensus.cc:2376] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5. Re-sending same reply.
W20260709 13:07:12.751814 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 44690us
I20260709 13:07:12.762809 22507 rpcz_store.cc:276] 0709 13:07:07.741046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.600847 (+4859801us) service_pool.cc:224] Handling call
0709 13:07:12.633216 (+ 32369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.692319 (+ 59103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.692347 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.692387 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:12.692417 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.692492 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.692598 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.764451 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:12.766316 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 69126.2us
W20260709 13:07:12.875799 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.973380 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.807611 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 255218us
I20260709 13:07:12.797487 25217 consensus_queue.cc:1059] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:07:12.767613 25056 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.795220 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:12.773280 22581 raft_consensus.cc:2376] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5. Re-sending same reply.
I20260709 13:07:12.793255 25210 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:12.767936 23109 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:12.766446 25132 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:12.757974 22426 rpcz_store.cc:276] 0709 13:07:09.763568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.768973 (+  5405us) service_pool.cc:224] Handling call
0709 13:07:09.769549 (+   576us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.770457 (+   908us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:09.770958 (+   501us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.516940 (+2745982us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:12.517585 (+   645us) log.cc:844] Serialized 52 byte log entry
0709 13:07:12.616079 (+ 98494us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:12.616357 (+   278us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.617133 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.617483 (+   350us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.757210 (+139727us) raft_consensus.cc:1685] finished
0709 13:07:12.757228 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.757398 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":962,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":108,"raft.queue_time_us":44817,"raft.run_cpu_time_us":567,"raft.run_wall_time_us":17526,"thread_start_us":2843512,"threads_started":2,"wal-append.queue_time_us":333557,"wal-append.run_cpu_time_us":1985,"wal-append.run_wall_time_us":1010977}
I20260709 13:07:12.758519 22328 catalog_manager.cc:5697] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:12.777002 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1403) took 5008 ms. Trace:
W20260709 13:07:12.981510 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.982100 25060 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.045547 22328 catalog_manager.cc:5697] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 3, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:13.046808 22577 raft_consensus.cc:2410] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:12.986946 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:12.988271 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:12.983479 25074 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:13.014143 22579 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:13.014474 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 353) took 1007 ms. Trace:
I20260709 13:07:12.988804 22580 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:07:13.016438 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.989199 22506 raft_consensus.cc:2393] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:13.021308 22473 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:13.021435 22582 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.052706 22501 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
W20260709 13:07:13.022270 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 45512.8us
W20260709 13:07:13.023545 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 51152.2us
I20260709 13:07:13.024827 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:13.017467 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 339839us
W20260709 13:07:13.028442 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.028951 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.055128 22507 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:13.034013 22499 raft_consensus.cc:2393] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 4: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:13.028182 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 276356us
I20260709 13:07:13.026612 25067 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:07:13.041112 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 343) took 5321 ms. Trace:
I20260709 13:07:13.037683 22503 rpcz_store.cc:276] 0709 13:07:07.759257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.618750 (+4859493us) service_pool.cc:224] Handling call
0709 13:07:12.692959 (+ 74209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.767869 (+ 74910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.768048 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:13.033821 25056 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.042203 25132 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.059890 22576 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:13.056785 22505 rpcz_store.cc:276] 0709 13:07:07.713644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.570724 (+4857080us) service_pool.cc:224] Handling call
0709 13:07:12.574108 (+  3384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.574563 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.574597 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.575122 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.619788 (+ 44666us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:12.619825 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.619891 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.034873 (+414982us) raft_consensus.cc:1685] finished
0709 13:07:13.034893 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.035025 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6565,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":13064,"thread_start_us":44242,"threads_started":1,"wal-append.queue_time_us":213015}
I20260709 13:07:13.050645 22502 rpcz_store.cc:276] 0709 13:07:12.007195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.112375 (+105180us) service_pool.cc:224] Handling call
0709 13:07:13.013836 (+901461us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54004268d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:13.014368 (+   532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358798720}
I20260709 13:07:13.054378 22504 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
W20260709 13:07:13.064642 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.065857 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:13.060561 22474 leader_election.cc:336] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.772s (SENT)
I20260709 13:07:13.053416 25054 consensus_queue.cc:1059] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:07:13.053031 22328 catalog_manager.cc:5697] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 3, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:13.052627 25074 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:13.083825 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.085515 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:13.087718 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:13.088353 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:13.090504 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.088450 22501 raft_consensus.cc:2376] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5. Re-sending same reply.
I20260709 13:07:13.091985 22502 raft_consensus.cc:2376] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7. Re-sending same reply.
I20260709 13:07:13.096603 22505 raft_consensus.cc:2410] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:13.097677 22396 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.100165 22576 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:13.102159 22545 leader_election.cc:400] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5.
I20260709 13:07:13.102607 22545 leader_election.cc:403] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:13.103905 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49348.5us
I20260709 13:07:13.104847 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.108144 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.109212 25153 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:13.090161 25067 raft_consensus.cc:3055] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:13.104907 22328 catalog_manager.cc:5697] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 3, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:13.119128 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:13.119894 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.129941 23106 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:13.129634 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:13.129156 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 70891.7us
I20260709 13:07:13.132900 25060 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.133637 23107 raft_consensus.cc:1240] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:13.134093 25150 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:13.134794 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.136195 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.126785 25301 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:13.156020 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 342) took 5442 ms. Trace:
I20260709 13:07:13.174427 22504 raft_consensus.cc:2410] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:13.122871 25072 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.177714 22328 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 6, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 6 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:13.185397 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:13.165725 25067 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:13.186622 22504 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:07:13.186784 25067 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.187359 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1335) took 4002 ms. Trace:
I20260709 13:07:13.187728 22504 rpcz_store.cc:276] 0709 13:07:09.184560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.185977 (+4001417us) service_pool.cc:224] Handling call
0709 13:07:13.186379 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:13.187062 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.187303 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:13.188129 25067 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.185676 22499 raft_consensus.cc:1240] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:07:13.190408 22504 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.168700 25060 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:13.174945 22508 rpcz_store.cc:276] 0709 13:07:07.711610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.526144 (+4814534us) service_pool.cc:224] Handling call
0709 13:07:12.526595 (+   451us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:12.527068 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.527094 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:12.527768 (+   674us) log.cc:844] Serialized 52 byte log entry
0709 13:07:12.901334 (+373566us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.980960 (+ 79626us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.981679 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.981825 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.153224 (+171399us) raft_consensus.cc:1685] finished
0709 13:07:13.153250 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.153483 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40,"prepare.queue_time_us":79012,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":319,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":222,"thread_start_us":373092,"threads_started":1,"wal-append.queue_time_us":517157}
I20260709 13:07:13.195120 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:13.194216 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 151264us
I20260709 13:07:13.211717 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1338) took 4011 ms. Trace:
W20260709 13:07:13.174644 25156 consensus_meta.cc:287] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.008s
I20260709 13:07:13.215358 22499 rpcz_store.cc:276] 0709 13:07:09.185361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.184983 (+3999622us) service_pool.cc:224] Handling call
0709 13:07:13.185430 (+   447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:13.196009 (+ 10579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.196263 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:13.171932 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 89419us
I20260709 13:07:13.220142 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1339) took 4026 ms. Trace:
I20260709 13:07:13.180724 25089 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5.
I20260709 13:07:13.176323 25026 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.178658 25301 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.222600 22504 rpcz_store.cc:276] 0709 13:07:09.185618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.189796 (+4004178us) service_pool.cc:224] Handling call
0709 13:07:13.190212 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.196581 (+  6369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.211590 (+ 15009us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:13.220640 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 201583us
I20260709 13:07:13.224761 22502 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:13.227190 22328 catalog_manager.cc:5697] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 5, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 5 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:13.230150 22499 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:13.230926 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1347) took 4024 ms. Trace:
I20260709 13:07:13.231277 22499 rpcz_store.cc:276] 0709 13:07:09.206709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.222811 (+4016102us) service_pool.cc:224] Handling call
0709 13:07:13.229900 (+  7089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.230630 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.230851 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:13.233582 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1342) took 4047 ms. Trace:
I20260709 13:07:13.217594 25060 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.234154 22503 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:13.234908 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 351) took 3370 ms. Trace:
I20260709 13:07:13.235191 22503 rpcz_store.cc:276] 0709 13:07:12.006314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.233546 (+1227232us) service_pool.cc:224] Handling call
0709 13:07:13.233824 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.234675 (+   851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.234855 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:13.236418 22503 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:13.240262 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:13.241009 22582 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:13.247684 25210 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:13.249104 22546 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.250463 25210 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.250969 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:13.253039 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.252959 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:13.255002 22499 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:13.255678 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 350) took 3847 ms. Trace:
I20260709 13:07:13.255995 22499 rpcz_store.cc:276] 0709 13:07:09.408147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.232033 (+3823886us) service_pool.cc:224] Handling call
0709 13:07:13.232410 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.255417 (+ 23007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.255622 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:13.256378 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.257467 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 345) took 5077 ms. Trace:
I20260709 13:07:13.257870 22502 rpcz_store.cc:276] 0709 13:07:08.147913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.171632 (+5023719us) service_pool.cc:224] Handling call
0709 13:07:13.224558 (+ 52926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.225255 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.225469 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:13.253782 23109 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
W20260709 13:07:13.257112 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.233950 22507 rpcz_store.cc:276] 0709 13:07:09.186348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.212128 (+4025780us) service_pool.cc:224] Handling call
0709 13:07:13.232905 (+ 20777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.233233 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.233260 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.233322 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:13.233353 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.233413 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.233527 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92}
W20260709 13:07:13.259832 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.250614 22546 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.263708 22505 raft_consensus.cc:2410] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:13.221143 25156 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.266871 22506 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.196187 25056 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.276207 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1344) took 4074 ms. Trace:
I20260709 13:07:13.281984 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:13.282280 22506 rpcz_store.cc:276] 0709 13:07:09.202178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.220978 (+4018800us) service_pool.cc:224] Handling call
0709 13:07:13.266672 (+ 45694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.275924 (+  9252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.276139 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:13.253019 25301 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.259238 25089 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.278879 22328 catalog_manager.cc:5697] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 3, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 3 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:13.287451 22579 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:13.284435 25306 log.cc:927] Time spent T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:07:13.291057 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.292042 22427 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:13.292693 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:13.293309 22580 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:13.296429 22398 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:13.292312 22506 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 8. Ops: []
I20260709 13:07:13.299212 22507 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.299031 22328 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 5, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 5 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:13.266484 25195 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.298938 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.304890 22508 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.285452 25055 raft_consensus.cc:3055] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.313274 22398 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:13.316457 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:13.317945 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.316542 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.318713 22426 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:13.322006 22328 catalog_manager.cc:5697] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:13.323375 22328 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 6, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 6 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:13.324958 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.310029 25055 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:13.330608 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1346) took 4127 ms. Trace:
I20260709 13:07:13.331043 22508 rpcz_store.cc:276] 0709 13:07:09.202948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.221457 (+4018509us) service_pool.cc:224] Handling call
0709 13:07:13.278112 (+ 56655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.305342 (+ 27230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.330375 (+ 25033us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b54001842d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:13.330546 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61163776}
I20260709 13:07:13.332059 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:13.332930 22582 raft_consensus.cc:2410] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:13.327169 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:13.322566 22580 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:07:13.335326 22577 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
W20260709 13:07:13.341991 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 91480us
I20260709 13:07:13.344941 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:13.321614 25067 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.348057 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:13.346006 23106 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:13.352178 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:13.352382 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:13.355942 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.356845 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:13.357525 23107 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:13.358479 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.358920 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:13.359098 22431 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:13.361493 22508 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:07:13.362118 25309 log.cc:927] Time spent T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
I20260709 13:07:13.364571 25057 raft_consensus.cc:3055] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:13.365003 25057 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:13.365864 25057 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:13.367157 25057 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.366927 25301 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.368412 22576 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:13.371068 22508 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:13.373446 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:13.374119 25301 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:13.373919 25055 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.374080 23113 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:13.375294 25055 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.376861 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:13.377578 23108 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
W20260709 13:07:13.378525 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 297705us
I20260709 13:07:13.379387 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.384241 25311 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.386040 25074 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.387297 22504 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.319815 25308 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:07:13.350788 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.418483 22506 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:13.433238 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 260334us
I20260709 13:07:13.433619 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:13.435124 23110 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.436306 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1420) took 1100 ms. Trace:
I20260709 13:07:13.436810 22506 rpcz_store.cc:276] 0709 13:07:12.336306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.340758 (+1004452us) service_pool.cc:224] Handling call
0709 13:07:13.418281 (+ 77523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.435985 (+ 17704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.436236 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:13.432917 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:13.388623 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1348) took 4155 ms. Trace:
I20260709 13:07:13.438977 22504 rpcz_store.cc:276] 0709 13:07:09.233333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.229789 (+3996456us) service_pool.cc:224] Handling call
0709 13:07:13.230110 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.387745 (+157635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.388319 (+   574us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001770d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:13.388548 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360890624}
I20260709 13:07:13.411091 22328 catalog_manager.cc:5697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 6, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 6 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:13.438989 23111 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.345067 25054 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.451526 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.453346 22547 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.452335 22427 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:07:13.455956 25089 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:13.457029 25089 consensus_queue.cc:1243] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:13.457536 25156 raft_consensus.cc:3055] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:13.457968 25156 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:13.458882 25156 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.460217 25156 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.460423 22545 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:13.461511 22545 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:13.462311 25089 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.462759 25089 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:13.463135 25089 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:13.464600 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.466077 25060 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.457566 22546 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:13.469334 22503 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:13.484150 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.478884 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.349910 25067 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:13.388360 25074 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:13.378554 25056 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:13.488263 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:13.501364 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1413) took 1167 ms. Trace:
I20260709 13:07:13.501797 23106 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:13.508615 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.501768 22503 rpcz_store.cc:276] 0709 13:07:12.334048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.237362 (+903314us) service_pool.cc:224] Handling call
0709 13:07:13.237650 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.484058 (+246408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.501106 (+ 17048us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54000ff0d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:13.501301 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532321664}
I20260709 13:07:13.516899 23108 pending_rounds.cc:85] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 8
W20260709 13:07:13.517513 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 62695.5us
I20260709 13:07:13.502976 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1340) took 4317 ms. Trace:
I20260709 13:07:13.521327 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1414) took 1187 ms. Trace:
W20260709 13:07:13.525228 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 71991.7us
I20260709 13:07:13.521765 22499 rpcz_store.cc:276] 0709 13:07:12.334388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.262968 (+928580us) service_pool.cc:224] Handling call
0709 13:07:13.284983 (+ 22015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.319965 (+ 34982us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:13.337957 (+ 17992us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.520963 (+183006us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.521018 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:13.521060 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.521127 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.521254 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13085,"prepare.queue_time_us":13632,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2295,"spinlock_wait_cycles":1408,"thread_start_us":117245,"threads_started":1}
I20260709 13:07:13.518985 22501 rpcz_store.cc:276] 0709 13:07:09.185865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.194747 (+4008882us) service_pool.cc:224] Handling call
0709 13:07:13.220681 (+ 25934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.254057 (+ 33376us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:13.279274 (+ 25217us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.502572 (+223298us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.502638 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:13.502693 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.502769 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.502911 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16227,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":179277,"threads_started":1}
I20260709 13:07:13.453408 25054 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:13.468462 25060 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:13.517309 23108 pending_rounds.cc:107] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:07:13.531633 23108 raft_consensus.cc:2889] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.532155 22396 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.500996 25067 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:13.545053 22573 consensus_meta.cc:287] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.001s
I20260709 13:07:13.545821 22573 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:13.531788 25054 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.530433 25161 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.530849 25301 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.516780 25195 consensus_queue.cc:1059] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:07:13.548826 25156 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:13.567201 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 65823.1us
I20260709 13:07:13.567226 22328 catalog_manager.cc:5697] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
W20260709 13:07:13.569481 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 112046us
I20260709 13:07:13.552428 25313 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.573148 23111 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:13.579134 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 344) took 5767 ms. Trace:
I20260709 13:07:13.560928 25161 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.582211 22328 catalog_manager.cc:5697] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 4, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 4 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:13.570261 25156 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.591701 22328 catalog_manager.cc:5697] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 1 to 5, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 5 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:13.592779 25156 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.584020 22500 rpcz_store.cc:276] 0709 13:07:07.811417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.638607 (+4827190us) service_pool.cc:224] Handling call
0709 13:07:12.682080 (+ 43473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:12.766918 (+ 84838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.766950 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:13.182114 (+415164us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b2c0000e678. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:13.214294 (+ 32180us) log.cc:844] Serialized 52 byte log entry
0709 13:07:13.479410 (+265116us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:13.479455 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.479532 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.578805 (+ 99273us) raft_consensus.cc:1685] finished
0709 13:07:13.578831 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.579069 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65168,"raft.queue_time_us":76673,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":27767,"spinlock_wait_cycles":11392256,"thread_start_us":217292,"threads_started":1,"wal-append.queue_time_us":353131}
W20260709 13:07:13.584637 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.588430 25161 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.590029 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:13.604606 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.608743 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.609275 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.613929 23076 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:13.616127 22473 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:13.619091 22432 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:13.622643 25143 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:13.623337 25143 raft_consensus.cc:697] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:13.624336 25143 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:13.630952 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 43615.4us
I20260709 13:07:13.581427 25301 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:07:13.631723 25325 consensus_queue.cc:1059] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:13.642874 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1351) took 1216 ms. Trace:
I20260709 13:07:13.644589 22432 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.624984 25060 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:13.648885 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.652979 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 65844.7us
I20260709 13:07:13.653916 22546 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.643406 22507 rpcz_store.cc:276] 0709 13:07:12.426819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.337178 (+910359us) service_pool.cc:224] Handling call
0709 13:07:13.350456 (+ 13278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.418028 (+ 67572us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:13.466951 (+ 48923us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.642542 (+175591us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.642594 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:13.642642 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.642705 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.642816 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40079,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1335,"thread_start_us":175163,"threads_started":1}
I20260709 13:07:13.656864 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:13.658309 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 134512us
I20260709 13:07:13.660455 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.667044 22499 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:13.676313 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.677457 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1418) took 1341 ms. Trace:
I20260709 13:07:13.695417 23110 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:13.692983 22505 rpcz_store.cc:276] 0709 13:07:12.335678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.308869 (+973191us) service_pool.cc:224] Handling call
0709 13:07:13.320298 (+ 11429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.376712 (+ 56414us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:13.377045 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.677061 (+300016us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.677127 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:13.677185 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.677255 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.677390 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7404,"prepare.queue_time_us":22808,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":39,"raft.queue_time_us":9055,"thread_start_us":289624,"threads_started":1,"wal-append.queue_time_us":311445}
I20260709 13:07:13.668027 25060 raft_consensus.cc:697] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:13.699435 22473 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:13.701200 22431 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:13.705058 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.705709 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.708781 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1415) took 1374 ms. Trace:
W20260709 13:07:13.712525 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 148986us
I20260709 13:07:13.716049 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.716970 22500 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:13.720429 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.713557 22547 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:13.724119 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:13.728863 22547 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:13.725590 23106 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:13.700754 25132 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.733229 22473 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:13.687938 25089 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:13.725538 22503 raft_consensus.cc:2376] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6. Re-sending same reply.
I20260709 13:07:13.735291 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.688984 25326 consensus_queue.cc:1059] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:13.737668 22431 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:13.710064 22502 rpcz_store.cc:276] 0709 13:07:12.334682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.263367 (+928685us) service_pool.cc:224] Handling call
0709 13:07:13.326416 (+ 63049us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:07:13.326606 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.337892 (+ 11286us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:13.533818 (+195926us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.708402 (+174584us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.708458 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:13.708520 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.708583 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.708709 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26914,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":2280,"spinlock_wait_cycles":3754880,"thread_start_us":315028,"threads_started":2}
W20260709 13:07:13.743381 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48829.3us
I20260709 13:07:13.752743 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.753906 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:13.764509 25332 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:13.744557 25074 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:13.768314 23106 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:13.768801 25310 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.769537 25310 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:13.740976 25132 raft_consensus.cc:697] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:13.768054 22547 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:13.770673 25026 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:07:13.773742 22547 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:13.775621 22396 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.770686 25089 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:13.765450 25060 consensus_queue.cc:237] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:13.784062 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 127596us
W20260709 13:07:13.788267 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.790771 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.791350 25156 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.793046 25301 raft_consensus.cc:3055] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:13.793512 25301 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:13.794272 25156 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:13.794520 25301 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:13.796073 25301 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:13.800760 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.801374 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.739547 25054 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.782186 25074 raft_consensus.cc:697] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:13.830899 22546 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:13.831377 25322 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:13.832494 25089 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.833032 25089 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:13.833469 25089 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.835424 25195 raft_consensus.cc:3055] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:13.835943 25195 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:13.836784 25325 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.836853 25339 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.838024 25339 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.838387 25339 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.838883 25054 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:13.838588 25132 consensus_queue.cc:237] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.839526 22546 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.841744 25338 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:13.843354 25336 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.771431 25326 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.843884 25336 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.791484 22432 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:13.846058 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:13.832283 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 50830.4us
I20260709 13:07:13.837378 25325 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.784137 25313 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:13.854557 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 156262us
I20260709 13:07:13.856729 22546 leader_election.cc:400] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5.
I20260709 13:07:13.860689 22396 leader_election.cc:400] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8.
I20260709 13:07:13.861124 22396 leader_election.cc:403] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.862162 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.862859 22432 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:13.863811 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.865013 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.865458 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.865693 22433 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:13.866664 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.867476 22582 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:13.860107 25156 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.868147 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:13.868544 25156 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.868971 25156 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.869493 25156 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.869779 22580 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.866568 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.864950 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.871922 22425 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:13.804895 25337 consensus_queue.cc:1059] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:07:13.868889 22576 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.873209 25337 consensus_queue.cc:1243] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer e47a624c3ddb48c5a8947ac0b3e71f84 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:13.871230 22579 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:13.831561 25074 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:13.844278 25336 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.879815 22424 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:13.864428 22430 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:13.859236 25325 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:13.925933 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 152265us
W20260709 13:07:13.932464 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 84660.2us
I20260709 13:07:13.932623 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.933640 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.934405 22432 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
W20260709 13:07:13.936602 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.936408 22396 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:13.937425 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:13.879144 25161 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:13.941428 22581 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:13.873840 25337 consensus_queue.cc:1059] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:07:13.941970 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:13.936808 25217 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8.
I20260709 13:07:13.943575 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:13.944150 23107 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:13.945211 25313 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.836968 25195 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:13.955160 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 180354us
I20260709 13:07:13.961463 22431 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:13.962934 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:13.942824 25332 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:13.979668 25195 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.982107 23076 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:13.984028 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.987159 22426 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:13.988884 22425 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:13.983711 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:13.992414 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:13.992792 22581 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:13.996248 22396 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:14.015493 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:14.017136 22579 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:13.999989 23076 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:14.016346 22431 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:13.974797 25145 consensus_queue.cc:1059] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:07:14.029731 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.032801 22581 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:14.032903 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:14.028812 25337 consensus_queue.cc:1059] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:07:14.034461 25337 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.034910 25337 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:14.036777 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.031962 25310 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:14.038098 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:14.038360 25337 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:14.039073 25337 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:14.040709 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:14.042946 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.023562 25054 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:14.076939 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.069496 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:14.070261 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 93439.1us
W20260709 13:07:14.071846 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 75695.7us
I20260709 13:07:14.018414 25341 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:14.081375 22582 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 13:07:14.079702 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.079759 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53800.7us
I20260709 13:07:14.084713 22431 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:14.085877 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.081863 22582 pending_rounds.cc:85] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:07:14.086984 22582 pending_rounds.cc:107] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:14.088058 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:14.025703 25347 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:14.085462 23077 leader_election.cc:336] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.505s (SENT)
I20260709 13:07:14.093101 22580 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:14.085402 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:14.094889 22582 raft_consensus.cc:2889] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.077502 25344 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:14.103531 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:14.107919 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.092183 25355 raft_consensus.cc:3055] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:14.112268 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:14.112709 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:14.113358 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.114116 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.091437 25057 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.069953 25326 consensus_queue.cc:1059] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:07:14.113065 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:14.117858 22575 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.112986 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.114377 22573 raft_consensus.cc:3055] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:14.091976 25054 raft_consensus.cc:697] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:14.121157 22431 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:14.118561 22581 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:14.119107 22573 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:14.118005 22427 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.120792 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:14.141733 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.101871 25060 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.083709 25341 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.196357 22573 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:14.214121 22580 raft_consensus.cc:2368] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7.
W20260709 13:07:14.196332 22472 leader_election.cc:336] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.528s (SENT)
I20260709 13:07:14.215850 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:14.221472 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 142626us
I20260709 13:07:14.113664 25355 raft_consensus.cc:740] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:14.250891 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.250756 22573 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:14.229193 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.234467 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 141883us
I20260709 13:07:14.253734 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:14.199399 22474 leader_election.cc:336] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.048s (SENT)
I20260709 13:07:14.255261 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:14.294528 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.307353 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.105157 25347 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:14.309083 25054 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:14.404275 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:14.311090 25161 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:14.198664 25310 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.250064 25341 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:14.410518 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.102289 25332 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:14.250533 25060 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:14.413791 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 191477us
W20260709 13:07:14.414002 22472 leader_election.cc:336] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.585s (SENT)
I20260709 13:07:14.433034 22574 raft_consensus.cc:2410] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:14.433133 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:14.434643 22581 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:14.435592 22578 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:14.435859 22573 raft_consensus.cc:2410] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:07:14.434824 22472 leader_election.cc:336] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.635s (SENT)
I20260709 13:07:14.438761 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:14.436528 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:14.444746 22472 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.739s (SENT)
W20260709 13:07:14.449088 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.426721 25067 consensus_meta.cc:287] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.009s
I20260709 13:07:14.452852 22427 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
W20260709 13:07:14.443755 25350 log.cc:927] Time spent T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.237s	user 0.003s	sys 0.004s
I20260709 13:07:14.483400 22426 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:14.485323 22431 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:14.486070 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.437796 25344 raft_consensus.cc:697] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:14.487365 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:14.473507 25356 log.cc:927] Time spent T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.252s	user 0.002s	sys 0.006s
W20260709 13:07:14.494376 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.461357 25361 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.200s	user 0.003s	sys 0.005s
I20260709 13:07:14.497529 25367 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.497777 25352 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
I20260709 13:07:14.498204 25355 consensus_queue.cc:260] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:14.452052 25161 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.417903 25349 consensus_queue.cc:1059] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:07:14.437160 25310 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:14.505683 25089 consensus_meta.cc:287] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.004s
I20260709 13:07:14.501030 25312 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.522563 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.581498 25347 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:14.563265 25367 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:14.530887 25301 consensus_meta.cc:287] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.000s
I20260709 13:07:14.520296 25057 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:14.584141 25057 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.584595 25057 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.586499 25367 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:14.588934 22576 raft_consensus.cc:2410] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:07:14.533599 25156 consensus_meta.cc:287] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.001s
I20260709 13:07:14.534550 25374 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.516081 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:14.491535 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 292158us
I20260709 13:07:14.552032 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.576601 25344 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:14.569192 25161 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:14.589869 25156 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:14.586385 23111 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:14.520267 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:14.473995 25067 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:14.581832 22578 raft_consensus.cc:2393] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:14.596095 22573 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:14.586347 25338 raft_consensus.cc:3055] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:14.578047 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 171723us
W20260709 13:07:14.608000 23077 leader_election.cc:336] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.838s (SENT)
I20260709 13:07:14.608436 23077 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:14.611090 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.616832 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:14.622205 25161 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:14.623380 22578 raft_consensus.cc:3055] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:14.623834 22578 raft_consensus.cc:740] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:14.624632 22578 consensus_queue.cc:260] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:14.625595 22578 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:14.629304 23079 leader_election.cc:336] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.505s (SENT)
I20260709 13:07:14.629844 23079 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:14.630234 23077 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:14.631745 25362 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.631973 25143 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:14.632524 25143 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.632927 25143 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.631916 23077 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:14.632714 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 116709us
I20260709 13:07:14.635671 22396 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:14.640834 22577 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:07:14.642947 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.643532 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.644815 23079 leader_election.cc:336] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.526s (SENT)
I20260709 13:07:14.645421 23079 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:14.608070 22399 leader_election.cc:336] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.687s (SENT)
I20260709 13:07:14.656265 22580 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:14.634570 25341 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:14.611984 25338 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:14.593263 25089 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:14.614702 25313 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.614835 23107 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:14.660878 22505 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:14.655344 25217 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:14.662658 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.638877 25371 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.672416 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.663487 22396 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:14.681380 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.667397 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:14.662107 25345 log.cc:927] Time spent T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.635s	user 0.007s	sys 0.004s
I20260709 13:07:14.598258 25374 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:14.676857 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.682492 22579 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:14.768141 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:14.697041 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:14.822221 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.710644 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:14.745661 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.767712 22547 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:14.890163 25310 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:14.658612 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 50848.5us
I20260709 13:07:14.815176 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:14.719569 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.673333 25301 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.002233 25301 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:14.876358 22501 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:14.674997 25150 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.680217 25217 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:15.005600 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:15.006069 25217 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:15.007194 25336 consensus_meta.cc:287] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 1.074s	user 0.007s	sys 0.003s
W20260709 13:07:15.007947 25195 consensus_meta.cc:287] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 1.028s	user 0.010s	sys 0.000s
I20260709 13:07:15.007666 25336 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:14.841821 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.008638 25334 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.009065 25334 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.009469 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.679337 25367 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:14.761667 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:14.709425 25311 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.701229 25074 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.029078 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:14.944679 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.741628 25373 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.952015 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2182) took 1081 ms. Trace:
I20260709 13:07:14.794926 25132 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.805843 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.784039 22578 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:14.768584 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:14.754359 22575 consensus_meta.cc:287] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.005s
W20260709 13:07:14.990490 25380 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:07:14.991464 25379 log.cc:927] Time spent T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 13:07:15.006309 22499 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:15.015537 22505 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
W20260709 13:07:14.769601 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 126401us
I20260709 13:07:15.009467 25334 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.057016 22396 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:14.988385 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 220758us
W20260709 13:07:15.057634 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.058194 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.058323 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.058805 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.059173 22507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 357) took 1366 ms (client timeout 1625 ms). Trace:
W20260709 13:07:15.059427 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.016101 22508 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:15.060863 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:15.062342 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:15.063498 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:15.056241 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:15.064432 25057 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:15.065634 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:15.066900 25057 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:15.067094 22505 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:07:15.067440 22505 pending_rounds.cc:85] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 3
I20260709 13:07:15.067659 22505 pending_rounds.cc:107] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:15.067873 22505 raft_consensus.cc:2889] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.068873 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:15.069171 25374 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:15.069833 25387 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:15.070441 22505 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:15.060787 25360 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.626s	user 0.005s	sys 0.000s
I20260709 13:07:15.071671 22505 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:15.069586 22508 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
W20260709 13:07:15.073385 25346 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:15.065531 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:15.074980 22499 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
W20260709 13:07:15.074980 22507 rpcz_store.cc:269] 0709 13:07:13.693295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.694265 (+   970us) service_pool.cc:224] Handling call
0709 13:07:15.059001 (+1364736us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001842d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:15.059115 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468885248}
W20260709 13:07:15.018847 23079 leader_election.cc:336] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.856s (SENT)
W20260709 13:07:15.031420 25385 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.141s	user 0.000s	sys 0.004s
I20260709 13:07:14.887782 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:15.097430 22500 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:15.019560 22574 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
W20260709 13:07:15.024004 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 183789us
W20260709 13:07:15.099594 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.071339 25339 consensus_meta.cc:287] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 1.203s	user 0.008s	sys 0.001s
W20260709 13:07:15.106384 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49453.1us
I20260709 13:07:14.845037 25067 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:14.951719 25326 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.015s	sys 0.026s
I20260709 13:07:15.029238 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.121579 22579 raft_consensus.cc:2410] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:07:14.939987 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 261537us
I20260709 13:07:14.838795 25026 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.031697 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:15.032030 22577 rpcz_store.cc:276] 0709 13:07:13.866858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.876707 (+  9849us) service_pool.cc:224] Handling call
0709 13:07:13.877115 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.650058 (+772943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.947577 (+297519us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400375854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:14.947840 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755774848}
I20260709 13:07:14.958338 25156 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:15.036886 22575 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:15.036059 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:14.842521 23111 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:14.735996 25060 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:15.023514 25367 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.077404 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:15.021148 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.893532 25341 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:15.062414 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.085970 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.023650 25301 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:15.023958 25145 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:07:15.098081 25325 consensus_meta.cc:287] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 1.156s	user 0.012s	sys 0.000s
I20260709 13:07:15.030602 22504 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.123029 22502 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.075044 25089 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:15.129801 22578 raft_consensus.cc:2410] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:14.830897 25338 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.138317 22581 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:15.139500 22396 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:15.164285 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2209) took 1048 ms. Trace:
I20260709 13:07:15.105880 25313 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.140661 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2194) took 1095 ms. Trace:
I20260709 13:07:15.145685 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:15.204504 23110 raft_consensus.cc:2410] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:07:15.166642 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44107.5us
I20260709 13:07:15.204582 22425 rpcz_store.cc:276] 0709 13:07:14.115564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.115707 (+   143us) service_pool.cc:224] Handling call
0709 13:07:14.195543 (+ 79836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.195803 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.195827 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.264576 (+ 68749us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.604946 (+340370us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.605219 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.606159 (+   940us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.074741 (+468582us) raft_consensus.cc:1685] finished
0709 13:07:15.074760 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.164195 (+ 89435us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":158105,"threads_started":1,"wal-append.queue_time_us":239172}
I20260709 13:07:15.204034 22575 rpcz_store.cc:276] 0709 13:07:14.033167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.068935 (+ 35768us) service_pool.cc:224] Handling call
0709 13:07:15.128527 (+1059592us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:15.177816 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.124089 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:15.209527 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:15.184223 25367 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.091806 25132 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:15.208386 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.208927 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 362) took 1119 ms. Trace:
I20260709 13:07:15.140509 25390 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.218922 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:15.126335 25217 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:15.122092 25326 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.015s	sys 0.030s
I20260709 13:07:15.228883 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.229799 22575 raft_consensus.cc:2393] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:15.230469 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.230680 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.231635 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:15.232159 22581 raft_consensus.cc:2376] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6. Re-sending same reply.
I20260709 13:07:15.053445 25373 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:15.233139 25336 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:15.234054 25373 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:15.183893 25067 consensus_queue.cc:1059] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:15.235103 25347 raft_consensus.cc:3055] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.235538 25347 raft_consensus.cc:740] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:15.236342 25347 consensus_queue.cc:260] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.237643 25390 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:15.211071 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 71646.6us
I20260709 13:07:15.119043 25339 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.223876 25391 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:15.225581 25394 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.236765 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.260669 22578 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:15.216696 25057 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:15.222818 22472 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:15.139235 25026 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:15.216504 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:15.247224 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.214620 22503 rpcz_store.cc:276] 0709 13:07:14.083919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.087661 (+  3742us) service_pool.cc:224] Handling call
0709 13:07:14.098278 (+ 10617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.126334 (+ 28056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.197025 (+ 70691us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.250922 (+ 53897us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.697520 (+446598us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.697560 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.697632 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.202515 (+504883us) raft_consensus.cc:1685] finished
0709 13:07:15.202534 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.202751 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12239,"raft.run_cpu_time_us":9116,"raft.run_wall_time_us":92579,"thread_start_us":268921,"threads_started":1,"wal-append.queue_time_us":599357}
I20260709 13:07:15.250602 22502 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:15.202500 25325 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.216197 25310 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:07:15.433060 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:15.274946 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.240427 25390 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:15.442423 22578 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
W20260709 13:07:15.632530 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.803225 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:15.489444 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 321966us
W20260709 13:07:15.804724 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 785864us
W20260709 13:07:15.806469 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.807578 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:15.808073 22501 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:15.808243 22508 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.809101 25195 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:15.810123 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 593682us
W20260709 13:07:15.813133 22474 leader_election.cc:336] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.585s (SENT)
I20260709 13:07:15.813619 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:15.476737 25311 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:15.379746 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.815547 25026 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:15.599923 22399 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.017s	sys 0.022s
I20260709 13:07:15.816291 22508 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:15.477774 25217 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:15.816874 22399 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.025s	sys 0.027s
W20260709 13:07:15.818573 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 808969us
I20260709 13:07:15.374223 22504 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:15.819859 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1364) took 1002 ms. Trace:
I20260709 13:07:15.820236 22504 rpcz_store.cc:276] 0709 13:07:14.817696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.028792 (+211096us) service_pool.cc:224] Handling call
0709 13:07:15.819802 (+791010us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:15.443321 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.821621 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.822091 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.822512 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.394251 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:15.581660 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.581066 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.625385 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.826258 22576 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:15.761431 22573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.008s
W20260709 13:07:15.827283 22573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.001s	sys 0.008s
W20260709 13:07:15.816576 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 611545us
W20260709 13:07:15.812743 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 569257us
I20260709 13:07:15.458597 22582 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:15.831983 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.831996 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.834705 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1534) took 1164 ms. Trace:
W20260709 13:07:15.835602 23108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.008s	sys 0.026s
W20260709 13:07:15.836781 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.839520 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.840324 22574 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
W20260709 13:07:15.840420 23108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.008s	sys 0.026s
I20260709 13:07:15.841373 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.841974 22574 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:15.842799 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:15.428788 25143 consensus_meta.cc:287] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.001s
I20260709 13:07:15.245637 25382 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:15.843986 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 621176us
I20260709 13:07:15.844641 25391 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.845995 25310 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:15.581888 25398 log.cc:927] Time spent T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:07:15.260535 25326 consensus_queue.cc:1243] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer e47a624c3ddb48c5a8947ac0b3e71f84 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:15.847898 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:15.848876 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.872859 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.843521 22574 raft_consensus.cc:2410] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:15.437626 25313 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:15.851745 22399 leader_election.cc:336] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.009s (SENT)
I20260709 13:07:15.877388 22399 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:15.626237 25395 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:07:15.489043 25056 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.000s	sys 0.033s
I20260709 13:07:15.835160 22573 rpcz_store.cc:276] 0709 13:07:14.670231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.674873 (+  4642us) service_pool.cc:224] Handling call
0709 13:07:14.678344 (+  3471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.681218 (+  2874us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:15.139524 (+458306us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.834380 (+694856us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.834434 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:15.834477 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.834538 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.834645 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6614,"prepare.queue_time_us":674371,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":973973,"threads_started":2}
I20260709 13:07:15.426019 25339 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:15.880155 25056 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.008s	sys 0.045s
I20260709 13:07:15.895656 25374 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:15.629616 25340 raft_consensus.cc:3055] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.288369 25336 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.860821 25391 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:15.650480 25367 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.817847 25338 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.936820 25391 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.553050 25132 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:15.862612 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.863282 22396 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:15.863945 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.939131 25367 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:15.246305 25387 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.601s
I20260709 13:07:15.831248 25067 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.941047 25067 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:15.942241 25339 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:15.943051 25339 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.869201 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2202) took 1833 ms. Trace:
I20260709 13:07:15.939003 22577 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:15.944046 22582 rpcz_store.cc:276] 0709 13:07:14.035707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.112374 (+ 76667us) service_pool.cc:224] Handling call
0709 13:07:15.868729 (+1756355us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54001ce154. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:15.869071 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3091669376}
I20260709 13:07:15.865206 25364 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:15.945387 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.945503 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.864686 25143 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.831118 25383 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.946323 22577 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:15.871891 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.947436 22581 raft_consensus.cc:2393] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:15.947608 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.947890 25143 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:15.949509 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2221) took 1140 ms. Trace:
I20260709 13:07:15.873000 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:15.860872 22474 leader_election.cc:336] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.698s (SENT)
I20260709 13:07:15.950481 25325 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:15.951126 25195 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:15.958465 22576 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:15.959197 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2232) took 1079 ms. Trace:
I20260709 13:07:15.846736 25311 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.890381 22472 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:15.894008 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.801463 25355 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.858664 25332 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.479058 25334 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.898643 23076 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:15.986821 22575 raft_consensus.cc:2368] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8.
W20260709 13:07:15.986770 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 88214.6us
I20260709 13:07:15.902137 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:15.858454 25346 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:15.857673 25057 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:15.801671 25347 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.903590 25340 raft_consensus.cc:740] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:15.910959 25336 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.912609 25359 raft_consensus.cc:3055] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:15.876092 25310 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.936067 25313 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:15.945134 25364 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.844655 25377 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.846948 25217 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.946276 22582 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:15.950870 22474 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:15.953198 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 100023us
I20260709 13:07:15.986773 25311 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:15.953852 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 146824us
I20260709 13:07:15.959515 22576 rpcz_store.cc:276] 0709 13:07:14.880066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.952643 (+1072577us) service_pool.cc:224] Handling call
0709 13:07:15.958097 (+  5454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.958944 (+   847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.959138 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.962810 22579 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
W20260709 13:07:15.962641 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 72358.6us
I20260709 13:07:15.965427 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2228) took 1086 ms. Trace:
I20260709 13:07:15.950016 22581 rpcz_store.cc:276] 0709 13:07:14.809344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.948104 (+1138760us) service_pool.cc:224] Handling call
0709 13:07:15.948554 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.949017 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:07:15.949054 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.949115 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:15.949155 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.949233 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.949428 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2369,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108}
I20260709 13:07:15.983670 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1369) took 1030 ms. Trace:
I20260709 13:07:15.984611 25195 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:15.985503 25332 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:15.990212 22574 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:15.943567 25067 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:16.002449 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2229) took 1123 ms. Trace:
I20260709 13:07:15.961297 25326 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.229936 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.191547 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 209586us
W20260709 13:07:16.239679 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.174216 22578 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:15.987208 25374 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.198910 23107 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:16.092648 22580 raft_consensus.cc:2410] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:16.237180 22575 rpcz_store.cc:276] 0709 13:07:14.879284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.230429 (+351145us) service_pool.cc:224] Handling call
0709 13:07:16.002127 (+771698us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b5400047c54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:16.002365 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737236864}
I20260709 13:07:16.264396 22396 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:16.237394 22579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2225) took 1359 ms (client timeout 1706 ms). Trace:
W20260709 13:07:16.235351 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 383661us
W20260709 13:07:16.180538 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.239033 22505 rpcz_store.cc:276] 0709 13:07:14.953450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.072411 (+118961us) service_pool.cc:224] Handling call
0709 13:07:15.074832 (+  2421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:15.097620 (+ 22788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.097646 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:15.140436 (+ 42790us) log.cc:844] Serialized 52 byte log entry
0709 13:07:15.581261 (+440825us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:15.581306 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.581387 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.983424 (+402037us) raft_consensus.cc:1685] finished
0709 13:07:15.983444 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.983603 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2328,"raft.queue_time_us":8464,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3464,"thread_start_us":368781,"threads_started":1,"wal-append.queue_time_us":662450}
I20260709 13:07:16.262717 22573 rpcz_store.cc:276] 0709 13:07:14.879011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.893702 (+1014691us) service_pool.cc:224] Handling call
0709 13:07:15.965367 (+ 71665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.268447 22581 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:16.269634 22581 pending_rounds.cc:85] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 4
W20260709 13:07:16.265085 22579 rpcz_store.cc:269] 0709 13:07:14.878285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.239931 (+361646us) service_pool.cc:224] Handling call
0709 13:07:16.237333 (+997402us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:16.280215 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.289011 22581 pending_rounds.cc:107] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:16.242223 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:16.289958 22581 raft_consensus.cc:2889] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.290087 23106 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.003492 25143 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.298628 23107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59008 (request call id 675) took 1167 ms. Trace:
W20260709 13:07:16.291601 22399 leader_election.cc:336] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.037s (SENT)
I20260709 13:07:16.293198 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:16.293939 22545 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:16.297014 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:16.297600 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.300303 23113 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:16.300488 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.301934 25311 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:16.302265 25364 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:16.302915 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:16.300509 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2235) took 1274 ms. Trace:
I20260709 13:07:16.303714 23108 raft_consensus.cc:2393] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:16.304584 25402 consensus_queue.cc:1059] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:16.305397 25347 raft_consensus.cc:2764] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:16.291345 25387 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:07:16.304574 25026 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.307227 22574 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:16.307853 23104 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:07:16.308229 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2217) took 1628 ms (client timeout 1812 ms). Trace:
W20260709 13:07:16.307468 23077 leader_election.cc:336] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.699s (SENT)
I20260709 13:07:16.308569 22545 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:16.299103 23107 rpcz_store.cc:276] 0709 13:07:15.123127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.123762 (+   635us) service_pool.cc:224] Handling call
0709 13:07:16.290125 (+1166363us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54002062d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:16.290242 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274856704}
I20260709 13:07:16.303596 22581 rpcz_store.cc:276] 0709 13:07:15.026502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.266049 (+1239547us) service_pool.cc:224] Handling call
0709 13:07:16.268065 (+  2016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.300249 (+ 32184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.300434 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.299706 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:16.313623 23110 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:16.091785 25417 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.045610 25334 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:16.243248 25339 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:16.017357 25359 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:16.234187 25336 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:16.308838 22580 rpcz_store.cc:269] 0709 13:07:14.681649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.761322 (+ 79673us) service_pool.cc:224] Handling call
0709 13:07:16.298433 (+1537111us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003d36d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:16.308173 (+  9740us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457094912}
I20260709 13:07:16.229498 25416 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.333724 25416 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.227499 25421 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.289621 25067 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.291074 25390 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.319636 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:16.365691 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.367244 23113 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
W20260709 13:07:16.367857 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 519121us
I20260709 13:07:16.369822 25332 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:16.368405 22474 leader_election.cc:336] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.706s (SENT)
I20260709 13:07:16.370586 25067 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:16.371330 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.371927 22474 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.739s (SENT)
I20260709 13:07:16.372570 22474 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:16.372951 25390 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:16.373858 23077 leader_election.cc:336] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.744s (SENT)
I20260709 13:07:16.374680 25416 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:16.375032 25132 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.302543 25311 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:16.325661 25364 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:07:16.380815 23076 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:16.323014 23106 raft_consensus.cc:2410] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:16.323359 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:16.381649 25338 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:16.382213 25338 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:16.270260 25374 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:16.383106 25338 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.383641 25374 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.325040 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:16.298394 25143 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.385332 25143 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.323151 22473 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:16.387010 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 63950us
W20260709 13:07:16.387965 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.325203 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.325935 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.388823 22578 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:07:16.389148 25359 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.389907 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.390549 22578 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
W20260709 13:07:16.390969 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.391404 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.392103 22578 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.323207 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:16.392824 23108 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.389153 22573 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.330925 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:16.390612 23110 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:16.397186 22580 raft_consensus.cc:2368] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8.
I20260709 13:07:16.398010 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.398795 22580 raft_consensus.cc:2393] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.399511 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.316663 25391 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.400070 22580 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:07:16.331826 25382 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:16.400725 25382 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.401095 25026 raft_consensus.cc:3055] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.401537 25026 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:16.332233 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.402711 22575 raft_consensus.cc:2410] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:16.402387 25026 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.403577 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.403752 25026 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.404274 22575 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.235219 25420 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:16.274520 25217 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.413111 22581 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:16.414259 25364 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.414820 25217 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:16.415002 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.414772 25364 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.390278 25359 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.417404 22575 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.417680 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:16.413158 25420 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.418900 22581 raft_consensus.cc:2410] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:16.412413 25143 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.420908 25420 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:16.422297 22582 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:16.317920 25347 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.291886 25313 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.001245 25346 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.396126 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.326915 22545 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:16.435806 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 108957us
I20260709 13:07:16.332556 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:16.404584 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.405442 25387 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:16.044880 25057 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.067869 25340 consensus_queue.cc:260] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.397943 25402 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:16.270625 25377 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.274834 25383 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:07:16.423821 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:16.430663 23108 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
W20260709 13:07:16.330897 22399 leader_election.cc:336] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.204s (SENT)
W20260709 13:07:16.446622 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 115752us
I20260709 13:07:16.269788 25326 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.435456 22573 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.447774 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:16.434811 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 110727us
I20260709 13:07:16.439867 23109 raft_consensus.cc:2368] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7.
I20260709 13:07:16.440446 22547 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:16.436546 22545 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:16.372975 25067 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:16.360714 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:16.417439 25364 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:16.450285 22545 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:16.450892 22574 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:16.448444 22582 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:16.470440 22545 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:16.453060 22399 leader_election.cc:336] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.420s (SENT)
I20260709 13:07:16.433524 25424 consensus_queue.cc:1059] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:07:16.454131 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.472692 22579 raft_consensus.cc:2410] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:16.455403 25195 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:16.457057 25310 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:16.457702 25143 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:16.443553 25402 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.460564 25332 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.465437 25346 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:16.475580 25313 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:16.476543 25390 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:16.477097 25347 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.481336 25336 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.478376 25377 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:16.476277 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.441607 25355 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.505733 25217 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.485245 25332 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:16.469623 25339 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:16.476162 25326 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:16.471524 25067 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.510251 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 57225.1us
I20260709 13:07:16.477416 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:16.516695 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.524683 25355 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:16.517791 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:16.516186 25311 consensus_queue.cc:1059] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:07:16.525102 25347 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:16.536626 25332 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.530947 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.563031 22573 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:07:16.482179 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.564710 22579 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
W20260709 13:07:16.546747 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.485618 25402 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.551867 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:16.566186 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 126754us
I20260709 13:07:16.524858 25340 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.553587 22582 raft_consensus.cc:2368] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8.
W20260709 13:07:16.520247 25418 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:16.520782 25377 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.531709 25336 raft_consensus.cc:697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:16.538460 25217 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.561223 25311 raft_consensus.cc:3055] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:16.599634 25311 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:16.599360 23107 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.600660 25311 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.602044 25311 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.569453 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:16.570628 22474 leader_election.cc:336] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.053s (SENT)
I20260709 13:07:16.606112 22574 raft_consensus.cc:2410] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:16.552822 25339 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:16.552553 25424 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 13:07:16.577303 23079 leader_election.cc:336] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.168s (SENT)
I20260709 13:07:16.582197 22425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:16.596890 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.609596 22425 raft_consensus.cc:606] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:16.609728 22582 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:16.610023 22425 raft_consensus.cc:614] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:16.597123 25416 consensus_queue.cc:1059] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:16.599126 25217 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:16.555166 25355 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.553699 25067 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.617228 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:16.617703 22502 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.617918 22504 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.583345 25057 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.620893 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.621553 22508 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:16.624361 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.625273 22508 raft_consensus.cc:2410] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:16.625936 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.626760 22582 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.625126 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:16.636559 22501 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:16.643849 22504 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:16.647039 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.648166 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.649452 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.657176 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:16.657593 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:16.658004 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:16.658324 23106 raft_consensus.cc:2368] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7.
W20260709 13:07:16.661901 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 91288.5us
W20260709 13:07:16.663197 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.582556 25377 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.664316 22547 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:16.672252 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.673270 22578 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.674096 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:16.674817 22581 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.654012 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:16.668021 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 55160.1us
I20260709 13:07:16.677534 22502 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:16.681196 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:16.681834 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.682657 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.683571 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.684415 22579 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.686879 22398 leader_election.cc:400] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7.
I20260709 13:07:16.687270 22398 leader_election.cc:403] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:16.686781 22576 raft_consensus.cc:2410] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:16.687968 22582 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:16.690378 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.682014 23112 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:16.692639 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.693365 22579 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:16.695173 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:16.699569 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:16.700522 22574 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.701135 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:16.701977 22575 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.688392 22582 pending_rounds.cc:85] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 7
I20260709 13:07:16.702826 22582 pending_rounds.cc:107] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:16.703112 22582 raft_consensus.cc:2889] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.709518 22500 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:16.689800 25346 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:16.641978 25057 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.717592 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:16.727069 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.727703 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.722384 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.722043 22581 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:16.732369 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.733117 22503 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:16.709233 25056 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:16.741365 22501 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 13:07:16.748273 23079 leader_election.cc:336] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 3.119s (SENT)
I20260709 13:07:16.750609 25067 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:16.941919 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:16.882351 25434 log.cc:927] Time spent T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.079s	user 0.001s	sys 0.001s
I20260709 13:07:16.754956 25439 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:16.947181 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 198942us
I20260709 13:07:16.948812 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.837757 25057 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:16.849584 25420 raft_consensus.cc:3055] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:16.952951 25420 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:16.953810 25420 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.954818 25420 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.956835 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.957823 22582 raft_consensus.cc:2410] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 9 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:16.958180 25377 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:16.958729 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.959508 22582 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:16.960747 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.961418 22575 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:16.962620 22575 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:07:16.962898 22575 pending_rounds.cc:85] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:07:16.963104 22575 pending_rounds.cc:107] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:07:16.963323 22575 raft_consensus.cc:2889] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:16.891445 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.960268 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:16.864681 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.832011 25374 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:16.818946 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.839673 25391 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:16.887920 25417 raft_consensus.cc:3055] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.832991 25436 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:07:16.925695 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:16.969851 22500 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.970445 25374 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:16.973878 25402 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.714355 25336 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:16.896319 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.939677 25195 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:16.980211 25195 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.783726 22505 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:16.983518 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:16.983443 22425 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:16.947033 25382 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:16.985970 22432 raft_consensus.cc:1217] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 13:07:16.986470 22432 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:16.742039 25346 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:16.988010 25346 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.802156 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.989214 22502 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:16.845593 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:16.990566 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 145052us
W20260709 13:07:16.991962 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.668730 25347 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.787997 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:16.888360 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.996053 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.018489 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.019260 22425 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:16.976305 25402 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:17.021313 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.023793 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.024797 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.026122 22504 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:17.000591 25325 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:16.880443 25443 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:07:16.719978 25339 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.882294 22577 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:16.805816 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 109718us
W20260709 13:07:16.775761 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.868183 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:16.823174 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.785048 22508 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:16.858049 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.896495 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.925171 25334 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.943840 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.945138 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.945794 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.948851 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:17.110381 22581 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:17.110797 22574 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
W20260709 13:07:16.950378 23079 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 3.278s (SENT)
W20260709 13:07:17.111440 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.111611 23079 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:16.892338 25332 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:16.937155 25390 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.951223 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:16.951180 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.937736 25364 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.952409 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:16.789211 25056 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:16.965716 22582 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:16.966064 22575 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.968972 25417 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:16.969129 22506 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.979020 25355 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.117067 25417 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:16.886215 22472 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.548s (SENT)
I20260709 13:07:16.984082 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.118122 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:16.945264 25359 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:16.993022 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:16.984155 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:17.027197 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.027835 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:17.028949 22500 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:17.057415 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:16.914038 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 98324.7us
I20260709 13:07:17.042274 22499 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:17.041599 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2233) took 2161 ms. Trace:
I20260709 13:07:17.120580 22506 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:17.067893 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.121654 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.120419 22428 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:17.111850 22581 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:17.124302 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:16.936012 25326 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:17.126710 22502 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:17.031020 25325 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:17.112888 22580 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
W20260709 13:07:17.057123 22328 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43174 (request call id 253) took 12146 ms (client timeout 15000 ms). Trace:
I20260709 13:07:17.110422 22501 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
W20260709 13:07:17.116000 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 120006us
I20260709 13:07:17.118247 22472 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:16.983201 22424 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:07:17.134958 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 248791us
I20260709 13:07:17.121655 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.122355 22577 rpcz_store.cc:276] 0709 13:07:14.880353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.965222 (+1084869us) service_pool.cc:224] Handling call
0709 13:07:15.983051 (+ 17829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.030408 (+1047357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.041305 (+ 10897us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b540016a3d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:17.041521 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066250496}
I20260709 13:07:17.125607 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:17.137152 23110 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:17.137313 22472 leader_election.cc:336] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.678s (SENT)
I20260709 13:07:17.137943 22472 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:17.060608 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.112608 22425 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:17.138852 25382 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.139335 22327 catalog_manager.cc:5697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.141733 22327 catalog_manager.cc:5697] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:17.126080 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.145627 22547 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:17.147413 22426 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:17.120114 25431 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:17.153602 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.154572 22472 leader_election.cc:336] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.679s (SENT)
I20260709 13:07:17.162858 23110 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:17.165091 25026 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:17.172998 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 222615us
I20260709 13:07:17.174238 25449 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.174882 25449 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.175279 25449 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.176257 22500 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:17.149099 25326 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:17.178529 23077 leader_election.cc:336] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.942s (SENT)
I20260709 13:07:17.179056 23077 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.179180 25326 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.114012 25334 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.134670 25325 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.184665 22508 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:07:17.185267 22500 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.200026 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.191603 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.214048 22327 catalog_manager.cc:5697] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:17.180197 22573 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:17.190335 22399 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.192902 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.191820 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.130924 25336 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.189779 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.224087 22424 raft_consensus.cc:2393] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:17.224972 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.216735 22429 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:17.196125 22430 raft_consensus.cc:2410] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:17.181107 22506 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:17.192080 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.191704 22426 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:17.118260 25390 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.190987 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:17.193173 25447 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:17.223292 22433 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:17.236989 22473 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.237558 22399 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:17.228080 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 49590.4us
I20260709 13:07:17.119921 25364 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.214915 22508 pending_rounds.cc:85] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 3
I20260709 13:07:17.239126 22508 pending_rounds.cc:107] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:17.239451 22508 raft_consensus.cc:2889] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:17.132517 22328 rpcz_store.cc:269] 0709 13:07:04.911003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.911163 (+   160us) service_pool.cc:224] Handling call
0709 13:07:17.040969 (+12129806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:13.923182 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:13.923915 (+   733us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:13.923969 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:07:13.923988 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:14.032588 (+108600us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:14.032687 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:14.032715 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:07:14.034089 (+  1374us) tablet.cc:701] Row locks acquired
0709 13:07:14.034142 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:07:14.034337 (+   195us) write_op.cc:270] Start()
0709 13:07:14.034506 (+   169us) write_op.cc:276] Timestamp: P: 1783602434034266 usec, L: 0
0709 13:07:14.034528 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:07:14.035370 (+   842us) log.cc:844] Serialized 6669 byte log entry
0709 13:07:15.059060 (+1023690us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:15.895196 (+836136us) op_driver.cc:464] REPLICATION: finished
0709 13:07:16.361652 (+466456us) write_op.cc:301] APPLY: starting
0709 13:07:16.368755 (+  7103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:16.369085 (+   330us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:16.369121 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:16.371191 (+  2070us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:16.371580 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:07:16.371630 (+    50us) write_op.cc:312] APPLY: finished
0709 13:07:16.372066 (+   436us) log.cc:844] Serialized 119 byte log entry
0709 13:07:16.376827 (+  4761us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:16.376997 (+   170us) write_op.cc:454] Released schema lock
0709 13:07:16.377067 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:16.382834 (+  5767us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:16.382869 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37669,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":429418,"apply.run_cpu_time_us":4451,"apply.run_wall_time_us":21173,"num_ops":17,"prepare.queue_time_us":161184,"prepare.run_cpu_time_us":39886,"prepare.run_wall_time_us":170338,"raft.queue_time_us":822388,"raft.run_cpu_time_us":19850,"raft.run_wall_time_us":104235,"replication_time_us":1860501,"spinlock_wait_cycles":41490688,"thread_start_us":638614,"threads_started":4,"wal-append.queue_time_us":186889}]]}
W20260709 13:07:17.229192 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 112720us
I20260709 13:07:17.127300 25359 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.241883 25359 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.187767 25417 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.245254 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.199342 25355 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.200536 25332 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.248278 22425 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:17.248872 22431 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:17.248742 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.253167 22429 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.228752 25431 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.188674 25067 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:07:17.254510 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.268915 22426 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.255290 22424 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:17.250525 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.270064 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.250298 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.252703 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.250578 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:17.271385 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 54315.3us
I20260709 13:07:17.266031 22578 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:17.235699 25057 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.272395 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.272852 22428 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.271536 25313 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.245993 25026 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:17.253518 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.273984 22433 raft_consensus.cc:2410] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:17.275123 22327 catalog_manager.cc:5697] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.223485 25382 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:17.228266 25150 consensus_queue.cc:1059] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:17.249409 25420 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.279079 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.246665 25340 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:17.273713 22399 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.243888 25387 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:07:17.305131 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 60138us
I20260709 13:07:17.298200 22432 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:17.280258 22425 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.249339 25310 consensus_queue.cc:1059] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:07:17.306807 22474 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:17.307502 25310 raft_consensus.cc:3055] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:17.307874 25310 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:17.308290 25436 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:17.308869 25436 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:17.309403 25436 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.305022 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.312727 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.313719 25424 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.314615 25424 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.308740 25310 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.316576 25310 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.301595 23079 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:17.321480 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.278590 25057 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:17.276782 25313 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.336730 22429 raft_consensus.cc:2410] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:17.337000 25313 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.326373 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.267894 25402 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:07:17.328650 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.344964 22428 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:17.313210 22474 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:17.344223 22433 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:17.297513 25420 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.342762 22425 raft_consensus.cc:2410] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:07:17.347477 23077 leader_election.cc:336] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.076s (SENT)
W20260709 13:07:17.347947 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 196486us
I20260709 13:07:17.348249 23077 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.348928 22545 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.299072 25195 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.302122 25150 consensus_queue.cc:1243] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer 10c2f471167442c0b75d8cd50ed8c40c log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:17.296568 25026 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:17.356123 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.361006 22433 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.364729 22426 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:17.366179 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:17.364616 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.343664 25444 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.341962 25057 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:17.357316 25448 log.cc:927] Time spent T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:17.344200 25416 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.381603 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.354197 25420 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.363288 25394 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.415491 25026 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.421211 25056 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:17.357191 25346 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.367962 25387 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.422389 25387 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:17.422437 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:17.422925 25387 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.357223 25445 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.357548 25458 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.426838 25325 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.428282 25364 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.430289 25334 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.433851 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.434571 22430 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
W20260709 13:07:17.389091 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 76073.3us
I20260709 13:07:17.436568 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:17.437541 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 87223.8us
I20260709 13:07:17.438877 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.440066 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.393189 25436 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.399791 22433 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:17.446616 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.447417 22430 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:17.391356 25431 raft_consensus.cc:3055] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:17.383610 25057 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.444672 25364 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:17.444947 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 115669us
I20260709 13:07:17.446091 22545 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.357092 25426 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.197s
W20260709 13:07:17.441664 22546 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.932s (SENT) [suppressed 81 similar messages]
I20260709 13:07:17.443423 25334 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.458585 22474 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:17.459340 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.464058 22430 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:17.461763 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.380121 25444 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:17.424365 25313 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.465265 22433 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:17.466708 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:17.470999 22578 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.467633 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.468251 25444 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.469477 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:17.449066 25431 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:17.473516 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:17.472016 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.473536 22573 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
W20260709 13:07:17.463296 25439 consensus_meta.cc:287] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:07:17.472059 22430 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:17.459862 25364 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:17.479254 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.481143 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.479890 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.476308 22581 raft_consensus.cc:2376] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4. Re-sending same reply.
I20260709 13:07:17.484432 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.487020 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:17.460216 25453 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.463354 25374 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:17.505544 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 47037.5us
I20260709 13:07:17.505978 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:17.506819 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 205304us
I20260709 13:07:17.510263 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.514544 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.521808 22474 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:17.522254 22507 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:17.515146 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:17.517485 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.512149 22578 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:17.521592 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:17.513823 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.524055 22506 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:17.518603 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:17.525094 22577 raft_consensus.cc:2376] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8. Re-sending same reply.
I20260709 13:07:17.516197 22508 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:17.522087 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:17.527165 25461 log.cc:927] Time spent T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:07:17.527714 25458 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.528131 25458 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:17.528493 25458 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.515307 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:17.521546 22580 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:17.527098 23079 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:17.531641 22576 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:17.532881 23079 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.533381 25390 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.534045 25435 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.534163 22545 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.534565 25394 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.484193 25347 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:07:17.535077 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.535394 25390 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.538033 25390 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:17.538429 25390 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.508049 25377 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.540760 25377 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:17.541143 25377 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.542153 25436 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:17.542908 25394 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:17.472944 25383 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:07:17.536837 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.484405 25439 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7.
I20260709 13:07:17.542961 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:17.476284 25460 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:07:17.544965 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:17.545377 22575 raft_consensus.cc:2410] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:17.545790 25394 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:17.535719 25347 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:17.546772 25347 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:17.547309 23079 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.535574 25325 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:17.546329 25394 raft_consensus.cc:697] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:17.548517 22507 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:17.549162 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.549425 25339 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.549937 25339 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:17.549551 25394 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.550370 25339 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.551848 22426 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:17.552404 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.552868 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.553496 22432 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:17.553608 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.480751 25326 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:17.554286 22424 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:17.554414 25326 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.554735 25449 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.547616 25347 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.556068 25347 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:17.557093 25459 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:17.504601 25364 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.552000 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.558480 22433 raft_consensus.cc:2376] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8. Re-sending same reply.
I20260709 13:07:17.484066 25355 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:07:17.542032 25458 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.559448 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:17.560608 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.562116 25435 raft_consensus.cc:2764] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:17.564400 22545 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.574137 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:17.575079 22504 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:17.582247 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:17.582787 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:17.583210 22581 raft_consensus.cc:2410] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:17.584900 22580 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:17.585227 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:17.589319 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:17.589514 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 67954.6us
I20260709 13:07:17.585429 25346 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.590216 22577 raft_consensus.cc:2393] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:17.590622 22474 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:17.590489 25346 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.592692 25346 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.593156 25424 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.593665 25424 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.594219 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.520084 25453 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.600904 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.606891 22432 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:17.602244 22578 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:17.607529 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:17.589821 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.483870 25332 consensus_queue.cc:1059] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:07:17.603163 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.605248 22546 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.608968 22430 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 4: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:17.611073 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 48687.7us
I20260709 13:07:17.612437 22474 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:17.608181 22575 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:07:17.548339 25420 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.611691 25346 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.614889 25346 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.617053 25346 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.617326 25374 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.617834 25313 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:17.618202 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.620913 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.621659 22424 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:17.622292 22433 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:17.622553 22427 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:17.622888 22396 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.624583 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.625530 22432 raft_consensus.cc:2410] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:17.581281 25325 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:17.636755 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.623498 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.641433 22429 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:17.639679 22546 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.644016 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:17.646371 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.640388 22426 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:17.647022 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.620689 25336 raft_consensus.cc:2764] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:17.610626 25453 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.660681 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.643093 25439 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.663005 22396 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.623646 25402 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.637460 25359 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.664712 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.648317 25460 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:17.666164 22429 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:17.665534 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.669402 22396 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.670835 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.671792 22432 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.645375 25325 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.657006 25417 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:17.654255 25313 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.674925 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.606392 25431 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.658114 25449 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:17.677495 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.667721 25310 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:07:17.694005 25313 raft_consensus.cc:697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:17.667753 25326 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.678826 25439 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.695276 25439 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.694967 25313 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.695607 22474 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.694893 25326 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.660492 25426 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.697306 25417 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:17.698225 25417 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.680850 25424 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:17.637466 25464 consensus_queue.cc:1059] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:07:17.699824 25435 raft_consensus.cc:3055] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:17.700194 25435 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:17.701102 25435 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.688696 25420 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:17.682608 25444 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.702911 22429 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:17.703176 22428 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:17.688967 25359 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.676791 25458 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:17.692821 25026 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.698274 25390 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.676121 25465 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.704877 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.705358 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.705816 25390 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:17.706518 22577 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:17.707053 25402 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.707482 25402 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.695793 25310 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:17.679397 25462 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:07:17.657073 25391 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:07:17.695637 25439 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.706349 25436 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:07:17.707841 25402 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.709705 25310 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.710108 25310 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.711414 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.705956 22429 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:17.706075 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.714524 22428 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:17.715376 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.692162 25057 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.717571 22425 raft_consensus.cc:2393] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:17.718595 25402 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.719020 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.719856 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.720634 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.720897 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.721529 22431 raft_consensus.cc:2376] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7. Re-sending same reply.
I20260709 13:07:17.721837 25057 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:17.720196 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.721903 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.722414 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.726440 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.690295 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.724753 25387 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.712069 22430 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:17.729341 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.729774 22399 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.698148 22474 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.731308 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:17.732328 22428 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:17.724220 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.738181 22429 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:17.740796 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.728251 22431 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.744248 22499 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.743455 22429 raft_consensus.cc:2376] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7. Re-sending same reply.
I20260709 13:07:17.745091 22474 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:17.746939 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.746762 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.747654 22425 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.748167 22430 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:17.748970 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.753758 22430 raft_consensus.cc:2410] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:17.675276 25325 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.767586 25217 consensus_queue.cc:1059] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:17.768816 25217 raft_consensus.cc:3055] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:17.769196 25217 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:17.770396 22430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:17.770725 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.771055 22430 raft_consensus.cc:606] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:17.771148 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.771502 22430 raft_consensus.cc:614] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:17.772822 22399 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.773972 22426 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:17.774451 22399 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.770213 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:17.775985 22428 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.778086 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:17.778733 22576 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.710130 25444 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:17.771849 22433 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:17.746104 25057 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.783147 22431 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:17.743939 25026 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.684262 25377 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.789485 22433 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:17.764230 25383 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.771179 25311 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.789817 22581 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:17.747661 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:17.746866 25420 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:07:17.808640 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 169033us
I20260709 13:07:17.800292 22425 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:17.796190 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.745719 25346 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:07:17.803390 22428 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:17.804033 22426 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:17.794620 22575 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.789588 25026 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.786201 25387 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:17.817642 22506 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.794682 25445 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:17.813293 22399 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.784214 25067 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.758447 25436 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:17.786798 25057 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:17.677794 25382 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:07:17.806022 25383 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.823104 22426 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:17.825057 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 270106us
I20260709 13:07:17.808763 25311 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:17.825906 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.829231 22399 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.784114 25217 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:17.829164 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:17.807606 25458 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:17.821926 25026 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.837764 22472 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:17.837508 22426 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:17.840245 22399 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.841388 22426 raft_consensus.cc:1240] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:17.845566 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.847718 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.849601 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.851946 22508 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:17.827068 25057 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.853720 25217 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.872691 23110 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:17.854372 25377 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:17.857468 22499 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:17.836364 25387 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:17.838101 25439 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:17.875674 25377 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:17.836581 25445 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:17.839082 25311 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.877728 25445 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:17.861002 25474 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.886005 25439 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:17.862670 22399 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.887883 22399 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.819447 25359 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:07:17.834462 25383 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.869975 25458 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:17.898109 22576 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:17.876682 25377 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:17.901446 22432 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:07:17.902060 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 139803us
I20260709 13:07:17.870553 25339 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:17.900995 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 55921.6us
I20260709 13:07:17.941308 22546 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:17.942682 22546 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.876736 22424 raft_consensus.cc:2368] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7.
I20260709 13:07:17.905021 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:17.852734 25336 raft_consensus.cc:2764] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:17.924057 22432 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:17.892782 25426 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:17.929165 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 140370us
I20260709 13:07:17.897571 25340 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:17.900162 25067 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.967293 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:17.968216 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:17.970311 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.901779 25377 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:17.978482 22578 raft_consensus.cc:1240] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:17.979789 22546 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.981412 22507 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:17.981581 22546 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.986816 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:17.987537 22505 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.952909 25444 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.991043 22546 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:17.963883 25334 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:17.953861 25426 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:17.995250 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:17.998404 22506 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.998339 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:17.999190 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.005944 22507 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:17.903848 25465 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
W20260709 13:07:18.021011 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.929680 25420 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:07:17.983466 25332 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.028960 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:18.027124 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:18.040968 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:18.041867 23110 raft_consensus.cc:2393] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:17.994349 25347 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.008782 25326 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.006726 25426 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.007416 25464 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:18.054281 23106 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:18.054359 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:18.056131 23111 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:18.056843 23113 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:18.057674 23108 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:18.056975 23107 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:17.992383 25449 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:18.068578 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:18.005702 25313 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:07:18.068899 25481 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:07:18.069595 25477 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.070014 25486 consensus_queue.cc:1059] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:07:18.112938 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:18.160990 25477 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:18.113040 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:18.161437 25477 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.161837 25481 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:07:18.117342 25495 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:07:18.117678 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1466) took 1226 ms. Trace:
I20260709 13:07:18.163757 22501 rpcz_store.cc:276] 0709 13:07:16.890918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.180986 (+290068us) service_pool.cc:224] Handling call
0709 13:07:17.181342 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.228610 (+ 47268us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:17.253482 (+ 24872us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.479428 (+225946us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.491355 (+ 11927us) log.cc:844] Serialized 52 byte log entry
0709 13:07:17.507426 (+ 16071us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:17.507467 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.508257 (+   790us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.109414 (+601157us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b1800352b40. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:07:18.117327 (+  7913us) raft_consensus.cc:1685] finished
0709 13:07:18.117431 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.117606 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65042,"prepare.queue_time_us":14904,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":58954,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":38596,"spinlock_wait_cycles":10104704,"thread_start_us":175992,"threads_started":1,"wal-append.queue_time_us":235698}
I20260709 13:07:18.117911 25346 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.123056 22505 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:18.006418 25310 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.048146 25347 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:18.168218 25347 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.055593 25332 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.169970 25332 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.170392 25310 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:18.172286 25332 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:18.158366 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 268721us
I20260709 13:07:18.184384 22399 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:18.158924 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 174122us
I20260709 13:07:18.045249 25340 raft_consensus.cc:697] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:18.187901 25340 consensus_queue.cc:237] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:18.085419 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.196581 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:18.197286 23112 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEARNER]: Advancing to term 9
W20260709 13:07:18.246876 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 216277us
I20260709 13:07:18.249444 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:18.157548 25465 consensus_queue.cc:1243] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer 10c2f471167442c0b75d8cd50ed8c40c log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:07:18.260919 22472 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.961s (SENT)
I20260709 13:07:18.054493 25377 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.271520 23112 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEARNER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
W20260709 13:07:18.293200 22472 leader_election.cc:336] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.991s (SENT)
I20260709 13:07:18.233467 25347 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.246745 25424 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:18.294322 22472 leader_election.cc:336] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.999s (SENT)
I20260709 13:07:18.305042 25491 consensus_queue.cc:1059] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:18.306102 25491 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:18.306473 25491 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:18.307307 25491 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.311923 25491 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.298781 22547 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:18.318326 25332 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:18.320185 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:18.321190 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 399956us
I20260709 13:07:18.322095 22547 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:18.320942 22499 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:18.284373 25334 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:18.260985 25326 consensus_queue.cc:1059] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:07:18.076697 25464 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.354887 25444 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:18.355484 25444 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.359002 25336 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:18.359823 25336 consensus_queue.cc:1243] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:18.361636 25067 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:18.362135 25067 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:18.362500 25067 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.341507 25377 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.338090 25332 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.404511 23112 pending_rounds.cc:85] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 7
I20260709 13:07:18.404901 23112 pending_rounds.cc:107] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:07:18.405215 23112 raft_consensus.cc:2889] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:18.406589 22398 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:18.413892 25417 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:18.380000 25325 consensus_meta.cc:287] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.003s
W20260709 13:07:18.415237 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 228282us
I20260709 13:07:18.339164 25057 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.424624 22396 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:18.344887 25026 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.427498 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:18.417182 25453 consensus_meta.cc:287] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.751s	user 0.004s	sys 0.006s
I20260709 13:07:18.428943 25453 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:18.430586 25311 consensus_meta.cc:287] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.002s
I20260709 13:07:18.431069 25453 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:18.432587 25506 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.433310 25506 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:18.433760 25506 raft_consensus.cc:697] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:18.434940 25488 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.192s	user 0.001s	sys 0.001s
I20260709 13:07:18.435747 25518 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:18.436726 25518 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.434573 25506 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:18.417698 25467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.007s
I20260709 13:07:18.415385 25313 raft_consensus.cc:3055] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:18.421823 25364 consensus_meta.cc:287] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.864s	user 0.011s	sys 0.000s
I20260709 13:07:18.431072 25311 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.444749 22499 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:18.445962 25217 consensus_meta.cc:287] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
I20260709 13:07:18.446000 22505 raft_consensus.cc:1240] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:18.460832 22426 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:18.443331 25467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.009s	sys 0.007s
I20260709 13:07:18.469100 22429 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:18.456202 25483 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.398s	user 0.001s	sys 0.000s
I20260709 13:07:18.470220 22507 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:18.450168 25313 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:18.481981 22425 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:18.484848 25464 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:18.426503 25325 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:18.486588 25500 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:18.487120 25325 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:18.488953 25311 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:18.492801 25490 log.cc:927] Time spent T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:07:18.493501 25492 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 13:07:18.495620 25057 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:18.500543 25494 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:18.502737 25217 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:18.503875 25402 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:18.449425 25334 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.504982 25511 consensus_queue.cc:1059] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:18.506852 25511 raft_consensus.cc:3055] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:18.507207 25511 raft_consensus.cc:740] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:18.513018 25313 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.514286 25313 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.476883 25477 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.517143 22508 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:07:18.517326 25477 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:18.518079 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:18.520792 25402 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:18.521198 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:18.523850 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:18.535862 25435 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.461939 25364 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.550531 22507 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:18.552922 22499 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:18.536883 25474 consensus_meta.cc:287] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.004s
I20260709 13:07:18.536280 25340 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:18.592159 25026 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:18.594990 25383 consensus_meta.cc:287] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.001s
I20260709 13:07:18.596122 25383 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.598613 25383 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:18.599134 25340 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.601421 25340 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:18.603771 25487 log.cc:927] Time spent T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.460s	user 0.000s	sys 0.002s
I20260709 13:07:18.605216 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2230) took 1004 ms. Trace:
I20260709 13:07:18.605587 22431 rpcz_store.cc:276] 0709 13:07:17.601008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.787557 (+186549us) service_pool.cc:224] Handling call
0709 13:07:17.787867 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.790134 (+  2267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.790163 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.790838 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.929839 (+139001us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:17.929895 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.930060 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.603209 (+673149us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:18.604918 (+  1709us) raft_consensus.cc:1685] finished
0709 13:07:18.604937 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.605156 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6337,"raft.queue_time_us":17693,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5919,"spinlock_wait_cycles":141116800,"thread_start_us":98153,"threads_started":1,"wal-append.queue_time_us":203966}
I20260709 13:07:18.536384 25444 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.608676 25067 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.573427 25347 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:18.611049 25067 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:18.587461 25458 consensus_queue.cc:1059] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:18.611829 25458 raft_consensus.cc:3055] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:18.612198 25458 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:18.613040 25458 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.614182 25458 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:18.617558 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.508023 25511 consensus_queue.cc:260] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.621328 22506 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:18.537966 25402 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.577384 25481 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.579941 25474 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.624048 23104 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:18.631798 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 447588us
W20260709 13:07:18.652034 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 293065us
W20260709 13:07:18.644536 25426 consensus_meta.cc:287] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.000s
W20260709 13:07:18.654291 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.656801 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.657662 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 71307.4us
I20260709 13:07:18.658854 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:18.644059 25439 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:18.661403 25493 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:18.658952 22546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.005s	sys 0.009s
W20260709 13:07:18.683002 22546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.006s	sys 0.009s
I20260709 13:07:18.632458 25481 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:18.683923 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 685614us
I20260709 13:07:18.692170 22432 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:18.692646 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:18.692896 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:18.693240 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:18.693578 22578 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.693785 22576 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.694391 22472 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:18.697688 25473 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.698158 25444 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:18.699545 25402 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:18.681555 25311 consensus_queue.cc:1059] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:18.658408 25426 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.702965 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2234) took 1101 ms. Trace:
I20260709 13:07:18.703805 22433 rpcz_store.cc:276] 0709 13:07:17.601962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.796135 (+194173us) service_pool.cc:224] Handling call
0709 13:07:17.796461 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.905380 (+108919us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:18.242110 (+336730us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.623191 (+381081us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:18.642587 (+ 19396us) log.cc:844] Serialized 52 byte log entry
0709 13:07:18.642778 (+   191us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:18.643059 (+   281us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.643257 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.643346 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.702651 (+ 59305us) raft_consensus.cc:1685] finished
0709 13:07:18.702684 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.702885 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15986,"prepare.queue_time_us":393151,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":4210,"raft.queue_time_us":30989,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":11826,"thread_start_us":653883,"threads_started":3,"wal-append.queue_time_us":391159}
I20260709 13:07:18.709406 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:18.716419 22578 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:18.655153 25417 consensus_queue.cc:1059] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:18.684394 25150 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:07:18.719089 25510 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.719678 25510 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.722071 25481 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:18.723974 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:18.724639 25510 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:18.726058 25355 raft_consensus.cc:3055] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:18.726487 25355 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:18.727416 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.730263 22472 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:18.731246 22472 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:18.733021 25339 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:18.736160 25195 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.736815 25195 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:18.738969 25195 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:18.739228 25311 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:18.739643 25311 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:18.740168 22545 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:18.740428 25311 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.741611 25311 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.741712 25394 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:18.742439 25521 log.cc:927] Time spent T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:18.742254 25464 consensus_queue.cc:1059] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:18.743408 25464 raft_consensus.cc:3055] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:18.743739 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2225) took 1144 ms. Trace:
I20260709 13:07:18.744400 25431 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.745105 25150 consensus_queue.cc:1059] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:18.746227 25150 raft_consensus.cc:3055] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:18.746579 25150 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:18.747421 25150 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.684652 25474 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:18.748610 25474 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.749109 25150 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.744117 22427 rpcz_store.cc:276] 0709 13:07:17.599695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.786273 (+186578us) service_pool.cc:224] Handling call
0709 13:07:17.810543 (+ 24270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.989369 (+178826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.989417 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.995392 (+  5975us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.536825 (+541433us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:18.536868 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.536947 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.743509 (+206562us) raft_consensus.cc:1685] finished
0709 13:07:18.743531 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.743685 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2189,"raft.queue_time_us":12430,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6100,"thread_start_us":668409,"threads_started":2,"wal-append.queue_time_us":619135}
I20260709 13:07:18.717653 25493 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:18.724936 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:18.644822 25340 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:18.760988 23113 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 3.
I20260709 13:07:18.727320 25355 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.762317 25460 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.769455 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:18.763139 25493 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:18.764055 25377 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:18.685973 25364 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:18.767684 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 76615.3us
I20260709 13:07:18.774499 22546 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:18.769026 22580 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:18.770277 22581 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:18.768748 22472 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:18.771766 22578 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:18.753940 25402 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.767632 22576 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:18.776110 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:18.775944 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:18.789332 22431 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:18.787837 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:18.775597 22427 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:18.776600 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:18.790881 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:18.791146 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:18.775521 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:18.766142 25339 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:18.787217 22425 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:18.743772 25464 raft_consensus.cc:740] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:18.788015 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:18.790478 22577 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.788725 22424 raft_consensus.cc:2376] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7. Re-sending same reply.
I20260709 13:07:18.794368 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:18.794968 22576 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.795822 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:18.796983 23077 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:18.798488 22399 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:18.799870 22399 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:18.801375 22573 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:18.791563 22430 raft_consensus.cc:2376] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5. Re-sending same reply.
I20260709 13:07:18.796535 22581 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:18.717181 25420 consensus_queue.cc:1059] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:07:18.802269 22546 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:18.773123 25334 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.809633 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:18.773445 25377 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.776695 25460 raft_consensus.cc:697] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:18.793223 25355 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.821192 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:18.822082 25477 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:18.823818 22577 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:18.769438 25310 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:07:18.815834 25424 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:18.810659 25489 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.813091 25486 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:07:18.869730 22579 raft_consensus.cc:1240] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:18.868845 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 60853.4us
I20260709 13:07:18.817317 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 345) took 1132 ms. Trace:
I20260709 13:07:18.872804 22426 rpcz_store.cc:276] 0709 13:07:17.685175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.422238 (+737063us) service_pool.cc:224] Handling call
0709 13:07:18.423305 (+  1067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.467901 (+ 44596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.817052 (+349151us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b54002986d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:18.817240 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85820288}
I20260709 13:07:18.812752 25453 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.810369 25377 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.818236 25513 consensus_queue.cc:1059] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:18.819540 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:18.876622 22574 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:18.877101 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 57637.7us
I20260709 13:07:18.878763 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:18.820196 25332 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:18.793052 25364 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.823967 25477 consensus_queue.cc:1059] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:18.790676 25475 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:18.793408 25339 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.773260 25347 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:07:18.829360 22576 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:18.801280 25340 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:18.843106 25481 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:18.846151 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:18.866165 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.808635 25325 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:18.805971 25491 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:18.874796 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:18.870786 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:18.885671 25445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.008s	sys 0.035s
I20260709 13:07:18.886862 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:18.904182 22574 raft_consensus.cc:2393] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:18.888744 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:18.869516 25424 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.895291 22582 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.885926 25067 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:18.887985 25339 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.890091 25394 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:18.918813 25067 raft_consensus.cc:697] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:18.906273 25445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.008s	sys 0.035s
I20260709 13:07:18.881111 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:18.881138 25474 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:18.905771 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:18.923539 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:18.919731 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:18.921025 22426 raft_consensus.cc:2393] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 4: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:18.897179 25325 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.814337 25334 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.924546 22574 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.928615 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:18.929527 22426 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:18.930756 25067 consensus_queue.cc:237] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.885694 25484 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:07:18.906507 25426 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:18.938318 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.943184 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:18.943985 22427 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:18.944994 22582 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:18.946038 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:18.935230 25325 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.957634 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:18.954525 25517 raft_consensus.cc:3055] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:18.960129 25517 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:18.891112 25489 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:07:18.961412 25435 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:18.961855 25435 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:18.962738 25435 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.963253 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:18.964105 22581 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:18.965155 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:18.915205 25491 raft_consensus.cc:697] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:18.966023 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.956061 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:18.968920 22425 raft_consensus.cc:2410] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:18.966646 22582 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.967342 22399 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:18.972646 22579 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:18.974637 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:18.975086 22399 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:18.922783 25332 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.902730 25481 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.009711 22426 raft_consensus.cc:2410] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:19.013042 22399 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:18.936573 25394 raft_consensus.cc:697] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:19.014536 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.032167 22427 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.888836 25464 consensus_queue.cc:260] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:18.953785 25465 raft_consensus.cc:3055] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:19.017706 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 137467us
W20260709 13:07:19.007184 25488 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:19.037384 22582 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:19.039428 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.007808 25486 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.016577 25340 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.019052 25513 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:19.058682 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:19.059594 22582 raft_consensus.cc:2368] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8.
W20260709 13:07:19.060065 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.061031 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:19.033471 25313 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:19.067199 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.014020 25445 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:19.040091 25465 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:19.031572 25332 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.078534 22581 raft_consensus.cc:2410] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:19.053030 25486 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.936003 25460 consensus_queue.cc:237] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.057693 25475 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:19.091361 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.092123 22425 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.084187 25486 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.098325 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:19.099376 22582 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:19.073251 25513 raft_consensus.cc:697] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:19.104571 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:19.106318 25475 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:19.105690 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 71368.9us
W20260709 13:07:19.118321 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.081313 25313 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:19.061340 25340 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.121899 22474 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:19.129724 22427 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:19.119314 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:19.119323 23079 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:19.149307 22425 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:19.163043 22576 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:19.048764 25517 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.174463 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.207139 22425 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:19.119949 25387 raft_consensus.cc:3055] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:19.207831 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.208654 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.210094 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:19.210744 22499 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.179917 22429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2235) took 1577 ms. Trace:
I20260709 13:07:19.184311 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:19.185770 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:19.100735 25484 consensus_queue.cc:1059] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:07:19.141222 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:19.092947 25491 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.199553 22430 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:19.201191 25431 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:19.201596 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:19.172899 25465 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.202739 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:19.235788 22500 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:19.205269 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:19.214663 22505 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.216055 22574 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:19.213764 22429 rpcz_store.cc:276] 0709 13:07:17.602179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.812453 (+210274us) service_pool.cc:224] Handling call
0709 13:07:17.812757 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.469688 (+656931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.179643 (+709955us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54000d6e54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:19.179846 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508961152}
I20260709 13:07:19.236409 22504 raft_consensus.cc:2368] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9.
I20260709 13:07:19.209228 25387 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:19.181492 25542 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.242929 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.183264 25026 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.228828 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 106988us
I20260709 13:07:19.256431 22474 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:19.230223 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:19.256749 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.257129 22503 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.255915 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.258968 25026 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.259585 25499 raft_consensus.cc:3055] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:19.260124 25551 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.261726 25551 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.103346 25394 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.262284 25551 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.263285 25340 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:19.237989 25543 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.208045 25532 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.264567 25532 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.237294 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:19.221417 22507 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:19.254123 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.245343 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:19.270213 22474 leader_election.cc:400] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8.
I20260709 13:07:19.269521 22430 raft_consensus.cc:2410] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:07:19.259725 25546 log.cc:927] Time spent T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:07:19.237668 25517 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.270529 22474 leader_election.cc:403] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:19.237097 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.270350 22582 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.281950 22499 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:19.268884 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.272779 22505 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
W20260709 13:07:19.229331 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 110088us
I20260709 13:07:19.284606 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:19.292574 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:19.293237 22574 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.294919 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.299151 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.260136 25499 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:19.316363 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.323668 22582 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:19.325222 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:19.327950 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:19.328210 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.330560 22582 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.332655 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2247) took 1721 ms. Trace:
I20260709 13:07:19.233943 25313 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:19.335651 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 65551.4us
I20260709 13:07:19.276126 25545 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:19.337507 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:19.306413 25481 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:19.333333 25402 consensus_meta.cc:287] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.003s
I20260709 13:07:19.333118 22428 rpcz_store.cc:276] 0709 13:07:17.611263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.815897 (+204634us) service_pool.cc:224] Handling call
0709 13:07:17.816217 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.823510 (+  7293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.823544 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.824908 (+  1364us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.977605 (+152697us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:19.107170 (+1129565us) spinlock_profiling.cc:243] Waited 985 us on lock 0x7b1800391240. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f007081a3c7 00007f006ce2c9a7 00007f006ce3c0bf 00007f006ce3c038
0709 13:07:19.220695 (+113525us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.332181 (+111486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.332258 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.332309 (+    51us) raft_consensus.cc:1685] finished
0709 13:07:19.332387 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.332597 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45627,"prepare.queue_time_us":363650,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":23143,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":13686,"spinlock_wait_cycles":2266496,"thread_start_us":300807,"threads_started":3,"wal-append.queue_time_us":162904,"wal-append.run_cpu_time_us":2654,"wal-append.run_wall_time_us":1155612}
I20260709 13:07:19.341667 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.300153 25532 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:19.227281 25513 consensus_queue.cc:237] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.308745 25334 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:19.316707 25332 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:19.347291 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 62807.6us
W20260709 13:07:19.350432 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.352010 22574 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:19.353077 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:19.353842 22574 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:19.354705 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:19.355482 22574 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:19.356637 22574 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:19.361320 25550 log.cc:927] Time spent T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:19.362807 22581 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:19.363305 22576 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:19.364234 22582 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:19.364869 25549 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:19.365301 25549 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:19.364630 22576 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:19.366825 22579 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:19.333456 25551 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:19.348281 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.338800 25473 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:19.364570 25561 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:19.344689 25402 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.371563 22428 raft_consensus.cc:2376] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7. Re-sending same reply.
I20260709 13:07:19.373975 23107 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEARNER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:19.379235 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.368613 22576 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:19.345665 25493 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:19.380276 25493 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.382418 25493 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:19.383857 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.384776 22427 raft_consensus.cc:2410] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:19.274416 25542 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.385542 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.386101 22427 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.374632 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.375849 25310 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.384758 25545 raft_consensus.cc:697] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:19.389709 25545 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:19.391345 25311 consensus_meta.cc:287] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.003s
I20260709 13:07:19.392697 25499 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.393800 25499 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.377806 25473 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.399175 25473 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:19.400260 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.405448 22425 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:19.400578 25557 consensus_queue.cc:1059] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:07:19.406198 22472 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:19.402799 25511 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.388762 25542 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:19.356660 25540 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.399775 25339 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.416805 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:19.421540 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.385160 25559 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.422161 25524 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:19.422824 25493 consensus_queue.cc:1059] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:19.424196 22427 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:19.424644 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:19.424819 22499 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.427067 22503 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:19.367760 25150 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.430051 22431 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:19.431936 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.450964 22425 raft_consensus.cc:2410] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:19.420945 25549 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:19.440989 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 473905us
I20260709 13:07:19.453959 22472 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:19.456887 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.342983 25387 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.456435 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:19.464331 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:19.458348 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.457558 22426 raft_consensus.cc:2376] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7. Re-sending same reply.
I20260709 13:07:19.466125 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:19.458841 22580 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:19.423851 25561 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:19.473220 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:19.446908 25543 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.477208 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.478248 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:19.452334 25474 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:19.485293 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.492368 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.493077 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:19.493374 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 388895us
I20260709 13:07:19.472551 25460 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:19.500310 22546 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:19.502246 22503 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:19.505412 22545 leader_election.cc:400] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9.
I20260709 13:07:19.505857 22545 leader_election.cc:403] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.510632 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.452204 25310 consensus_queue.cc:1059] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:07:19.456815 25150 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.500321 25359 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:19.492128 25493 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.513895 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.515515 22426 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:19.501226 25549 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.520092 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.520748 22425 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.501564 25474 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:19.524273 25508 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:19.525450 25566 log.cc:927] Time spent T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:07:19.510769 25026 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:19.525924 25458 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:19.526250 25565 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:19.452155 25559 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.510761 25387 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.440536 25540 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.452769 25524 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.529891 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:19.524137 25561 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.540843 25478 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.524050 25509 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:07:19.546458 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:19.548233 22546 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:19.530691 22472 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:19.555243 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.522976 25424 consensus_meta.cc:287] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.001s
I20260709 13:07:19.513296 25460 raft_consensus.cc:697] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:19.590380 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.591200 22430 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:19.591536 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.535537 25474 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.600050 23104 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:19.526285 25535 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8.
I20260709 13:07:19.598444 22425 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
W20260709 13:07:19.605183 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 57023.8us
I20260709 13:07:19.607801 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:19.545521 25458 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:19.538232 25481 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9.
I20260709 13:07:19.591153 25310 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:19.614696 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51834.8us
I20260709 13:07:19.560988 25355 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.562085 25551 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.608319 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44528.1us
I20260709 13:07:19.589533 25359 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:19.613059 23077 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:19.565184 25325 consensus_meta.cc:287] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.002s
W20260709 13:07:19.600459 25377 consensus_meta.cc:287] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.004s
I20260709 13:07:19.523281 25493 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.631846 22546 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:19.594827 25394 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:19.632436 22472 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:19.646765 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.635164 25481 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.640730 25325 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.653007 25359 raft_consensus.cc:697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:19.654386 25325 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:19.654038 25359 consensus_queue.cc:237] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.655349 22576 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:19.658015 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:19.659763 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:19.660337 22502 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.660982 25499 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.661526 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:19.643278 25570 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.652822 25523 raft_consensus.cc:3055] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:19.668041 25523 raft_consensus.cc:740] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:19.589740 25424 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.617887 25310 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.543790 25508 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.648109 25394 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.642046 25377 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.643491 25150 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:19.648432 25545 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:19.649436 22426 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
W20260709 13:07:19.650060 25476 log.cc:927] Time spent T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 1.235s	user 0.004s	sys 0.000s
I20260709 13:07:19.648562 25458 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.651801 25435 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.662842 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:19.662138 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:19.731760 22576 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:19.667326 25493 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:19.640990 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:19.734041 22430 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.669399 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:19.671685 25523 consensus_queue.cc:260] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.673009 22500 raft_consensus.cc:1240] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.748850 22503 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:19.609987 25509 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:19.682884 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 63603.3us
I20260709 13:07:19.645032 25561 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.553565 25486 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.644687 25339 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:19.750929 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:19.620230 25326 consensus_queue.cc:1059] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:07:19.756947 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.799552 25573 log.cc:927] Time spent T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:07:19.799899 25355 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:19.799382 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:19.637648 25551 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.677224 25460 consensus_queue.cc:237] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.698916 25310 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.725147 25346 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.817075 25517 consensus_meta.cc:287] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.003s
I20260709 13:07:19.816769 22427 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:19.812083 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:19.835592 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 385) took 1171 ms. Trace:
W20260709 13:07:19.846127 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.896592 22501 rpcz_store.cc:276] 0709 13:07:18.664047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.664229 (+   182us) service_pool.cc:224] Handling call
0709 13:07:18.686977 (+ 22748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.754060 (+ 67083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.754090 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.754133 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:18.754161 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.835170 (+1081009us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b54001851d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:19.835229 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.835474 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153794304}
I20260709 13:07:19.828830 22430 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:19.898938 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:19.855894 22576 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:19.813020 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:19.809860 25571 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:07:19.815852 22433 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
W20260709 13:07:19.900081 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 87154.9us
I20260709 13:07:19.902945 22430 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
W20260709 13:07:19.861992 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.903911 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.781718 25545 raft_consensus.cc:697] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:19.898156 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:19.804629 25458 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.781503 25561 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.800148 25394 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:19.801442 25464 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.806411 25377 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:19.808408 25559 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:19.934580 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.813952 25444 raft_consensus.cc:3055] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:19.937589 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:19.800608 25523 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.869851 25524 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:19.934036 22501 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:19.966214 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:19.837503 25509 raft_consensus.cc:697] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:19.937877 22474 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:19.948344 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:19.950129 22547 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:19.939601 25561 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.858592 25472 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:19.953287 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.981125 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.978413 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:19.982093 22501 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:19.954073 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:19.901373 25501 raft_consensus.cc:3055] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:19.944828 25532 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:19.958899 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:19.960105 25545 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.003054 25538 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:19.963276 25540 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:19.964644 25552 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:19.901784 25346 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:19.900815 25355 raft_consensus.cc:697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:19.937608 25484 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.968796 25486 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:19.970327 25551 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:19.942917 25431 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:19.936081 25511 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.944756 25444 raft_consensus.cc:740] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:19.990044 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:19.993233 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:20.051708 23112 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 3.
I20260709 13:07:19.978219 25570 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.003914 25538 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.984125 25542 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.982191 25377 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.985150 25501 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:20.035141 25557 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.991040 25472 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.017194 25435 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:20.050611 25431 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.088893 25542 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.089900 25377 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:20.053484 25549 consensus_meta.cc:287] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:07:20.048281 25511 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.048954 25551 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.015425 25532 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.083354 25355 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.109611 25542 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.024329 25552 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.030766 25484 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.114578 25511 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.083875 25509 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.118701 25551 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.148638 25552 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.152125 25538 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.155164 25484 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:20.124039 25501 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.165016 25551 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.165313 25501 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.169350 25532 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:20.170629 25474 consensus_meta.cc:287] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
W20260709 13:07:19.931612 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.966753 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:20.346598 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.347179 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:20.349141 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:20.350113 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1446) took 1248 ms. Trace:
I20260709 13:07:20.350529 22430 rpcz_store.cc:276] 0709 13:07:19.101369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.348632 (+1247263us) service_pool.cc:224] Handling call
0709 13:07:20.350056 (+  1424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.965189 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34614 (request call id 349) took 1190 ms. Trace:
W20260709 13:07:20.262357 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.982632 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44864.7us
I20260709 13:07:20.280392 22500 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:19.983084 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:20.282090 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:20.285205 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.985862 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 343) took 1138 ms. Trace:
I20260709 13:07:20.363031 25377 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.361997 22574 rpcz_store.cc:276] 0709 13:07:18.847729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.357502 (+509773us) service_pool.cc:224] Handling call
0709 13:07:19.357824 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.469226 (+111402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.469258 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.469753 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.512781 (+ 43028us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:19.512821 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.512895 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.985568 (+472673us) raft_consensus.cc:1685] finished
0709 13:07:19.985592 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.985789 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127700,"raft.queue_time_us":114823,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":15726,"thread_start_us":42647,"threads_started":1,"wal-append.queue_time_us":135137}
I20260709 13:07:19.998543 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:20.365273 22573 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.366600 25474 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:19.974293 22576 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:07:20.368871 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.369254 22433 rpcz_store.cc:276] 0709 13:07:18.775181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.775294 (+   113us) service_pool.cc:224] Handling call
0709 13:07:19.965005 (+1189711us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540038efd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:19.965122 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2354295680}
I20260709 13:07:20.370648 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:20.370977 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:20.371740 25501 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.288997 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.372575 25501 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.050879 23107 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:20.024284 23106 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:20.038013 23111 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.301774 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2275) took 1431 ms. Trace:
I20260709 13:07:20.306197 25310 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.307673 25326 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.307870 25195 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.396823 25195 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.308840 25334 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:20.309305 25325 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.122042 25346 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.405467 25325 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.314528 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:20.183811 25511 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.412214 25195 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:20.399813 25310 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.413748 25325 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.416739 25195 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:20.417256 25325 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:20.333120 25551 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:20.419374 25551 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.335080 25532 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.329551 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 357203us
I20260709 13:07:20.365353 22501 raft_consensus.cc:2393] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:20.023698 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:20.426453 23108 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:20.426663 25474 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.375399 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:20.428994 22574 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:20.430151 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:20.430748 22505 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.430939 22574 raft_consensus.cc:2393] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:20.433588 22425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:20.434587 22425 raft_consensus.cc:606] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:20.435096 22425 raft_consensus.cc:614] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:20.435210 22501 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:20.435846 22502 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:20.436908 22505 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:20.368992 25570 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.376574 25481 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:20.437729 25570 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.438077 25481 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.368839 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:20.441344 23109 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.444077 25570 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.444819 25570 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.445746 25481 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.372210 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:20.446877 22576 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:20.447425 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:20.447904 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1567) took 1651 ms. Trace:
W20260709 13:07:20.383117 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.448637 25195 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.449009 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:20.388872 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:20.179436 25561 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.395332 22582 rpcz_store.cc:276] 0709 13:07:18.870239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.364974 (+494735us) service_pool.cc:224] Handling call
0709 13:07:19.365263 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.505301 (+140038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.505323 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.505714 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.015028 (+509314us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:20.286676 (+271648us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.300971 (+ 14295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.301141 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.301187 (+    46us) raft_consensus.cc:1685] finished
0709 13:07:20.301199 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.301505 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155983,"prepare.queue_time_us":309321,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":162492,"raft.run_cpu_time_us":502,"raft.run_wall_time_us":7417,"thread_start_us":492454,"threads_started":1,"wal-append.queue_time_us":574764}
I20260709 13:07:20.415575 25326 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.418216 25325 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.447932 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:20.458115 22501 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.461556 23113 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.462387 25325 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:20.463311 25561 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:20.414517 25511 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.424213 25532 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.466681 25431 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:20.469408 25532 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.470113 25311 raft_consensus.cc:3055] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:20.470590 22576 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:20.471941 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:20.454177 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 337) took 1610 ms. Trace:
I20260709 13:07:20.470625 25311 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:20.466487 22433 raft_consensus.cc:2410] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:20.445497 25570 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.123983 25444 consensus_queue.cc:260] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.408115 22474 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:20.375830 25501 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:20.432060 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:20.451694 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:20.460366 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:20.457656 23079 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:20.482923 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:20.483109 25444 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.483865 22433 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.486277 22573 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:20.485574 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33944 (request call id 22) took 1676 ms. Trace:
I20260709 13:07:20.455919 25551 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:20.489061 22425 rpcz_store.cc:276] 0709 13:07:18.798140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.408191 (+1610051us) service_pool.cc:224] Handling call
0709 13:07:20.474885 (+ 66694us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.492930 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:20.493631 22582 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.493216 25311 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:20.494165 25326 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:20.483814 25530 log.cc:927] Time spent T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.731s	user 0.006s	sys 0.010s
I20260709 13:07:20.495961 25453 raft_consensus.cc:3055] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:20.495019 25311 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.472853 22577 rpcz_store.cc:276] 0709 13:07:18.843489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.843652 (+   163us) service_pool.cc:224] Handling call
0709 13:07:18.844030 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.054016 (+209986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.054045 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.061208 (+  7163us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.179168 (+117960us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.235853 (+ 56685us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.465226 (+229373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.453401 (+988175us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54001ccad4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:20.453463 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.453582 (+   119us) raft_consensus.cc:1685] finished
0709 13:07:20.453690 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.453992 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":229095,"prepare.queue_time_us":40162,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":232804,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":482289024,"thread_start_us":96262,"threads_started":1,"wal-append.queue_time_us":273786,"wal-append.run_cpu_time_us":2237,"wal-append.run_wall_time_us":1020362}
I20260709 13:07:20.501547 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:20.503139 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:20.504030 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1575) took 1029 ms. Trace:
I20260709 13:07:20.505484 25535 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:20.506151 25535 raft_consensus.cc:697] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:20.507258 25575 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.700s	user 0.024s	sys 0.046s
I20260709 13:07:20.507421 25535 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.508975 25402 raft_consensus.cc:3055] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:20.509450 25402 raft_consensus.cc:740] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:20.509984 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 102256us
I20260709 13:07:20.510449 25402 consensus_queue.cc:260] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.511830 25402 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.516566 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:20.517202 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 65861.4us
I20260709 13:07:20.518205 22546 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:20.519888 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:20.516635 25424 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.497308 25195 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.521586 25334 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:20.523022 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 2267) took 1088 ms. Trace:
I20260709 13:07:20.523512 22427 rpcz_store.cc:276] 0709 13:07:19.434310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.454481 (+ 20171us) service_pool.cc:224] Handling call
0709 13:07:20.522533 (+1068052us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400275e54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:20.522827 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741236992}
I20260709 13:07:20.525756 22427 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:20.526219 22427 pending_rounds.cc:85] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 7
I20260709 13:07:20.526549 22427 pending_rounds.cc:107] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:20.526914 22427 raft_consensus.cc:2889] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.527953 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1425) took 1699 ms. Trace:
I20260709 13:07:20.528772 25510 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.529521 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34614 (request call id 355) took 1094 ms. Trace:
I20260709 13:07:20.497211 25453 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:20.529917 22426 rpcz_store.cc:276] 0709 13:07:19.435323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.539899 (+104576us) service_pool.cc:224] Handling call
0709 13:07:20.529133 (+989234us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b540043c454. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:20.529302 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126762752}
I20260709 13:07:20.530761 22574 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:20.531288 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:20.537256 22426 raft_consensus.cc:2410] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:20.538350 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1568) took 1741 ms. Trace:
W20260709 13:07:20.520326 22431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 2250) took 1732 ms (client timeout 1712 ms). Trace:
W20260709 13:07:20.539570 22431 rpcz_store.cc:269] 0709 13:07:18.787333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.789999 (+  2666us) service_pool.cc:224] Handling call
0709 13:07:20.519939 (+1729940us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b540038a9d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:20.520110 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379674368}
I20260709 13:07:20.541895 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1430) took 1665 ms. Trace:
I20260709 13:07:20.542347 22431 rpcz_store.cc:276] 0709 13:07:18.881607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.540524 (+1658917us) service_pool.cc:224] Handling call
0709 13:07:20.541024 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.541403 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.541446 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.541514 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:20.541569 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.541643 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.541803 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.543104 25416 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:20.529531 25510 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.543879 25416 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.544770 25501 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:20.545459 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.546294 25416 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.518115 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:20.546697 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 47167.5us
W20260709 13:07:20.547665 25574 log.cc:927] Time spent T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.898s	user 0.000s	sys 0.014s
I20260709 13:07:20.549431 22473 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:20.549911 25510 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.533290 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2281) took 1661 ms. Trace:
I20260709 13:07:20.550681 22575 rpcz_store.cc:276] 0709 13:07:18.871818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.452112 (+580294us) service_pool.cc:224] Handling call
0709 13:07:19.469206 (+ 17094us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.469593 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.469641 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.470103 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.609616 (+139513us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:19.609654 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.609734 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.506317 (+896583us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:20.514611 (+  8294us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b48002601d8. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0071d4baa1 00007f0071d42b37 00007f0071d429ca 00007f0071e3a26f 00007f0071e39f37 00007f0071e4e55c 00007f0071e4e508 00007f0071e4e488 00007f0071e4e443 00007f0071e4d6ec 00007f0070d77a96
0709 13:07:20.532872 (+ 18261us) raft_consensus.cc:1685] finished
0709 13:07:20.532892 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.533109 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4507,"raft.run_cpu_time_us":14139,"raft.run_wall_time_us":1037036,"spinlock_wait_cycles":56325248,"thread_start_us":139147,"threads_started":1,"wal-append.queue_time_us":227145}
W20260709 13:07:20.552661 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 95320.8us
I20260709 13:07:20.554708 25561 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.555234 25561 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.555626 25561 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.560709 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:20.562094 22430 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:20.535274 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 389) took 1161 ms. Trace:
I20260709 13:07:20.562816 22499 rpcz_store.cc:276] 0709 13:07:19.373397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.373515 (+   118us) service_pool.cc:224] Handling call
0709 13:07:19.380365 (+  6850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.449323 (+ 68958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.534652 (+1085329us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b540021b1d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:20.535026 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101748608}
I20260709 13:07:20.448345 22578 rpcz_store.cc:276] 0709 13:07:18.796193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.799405 (+  3212us) service_pool.cc:224] Handling call
0709 13:07:18.813585 (+ 14180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.898116 (+ 84531us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:18.913724 (+ 15608us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.918555 (+  4831us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.404894 (+486339us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18004859e0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069cafc0a 00007f00733ef219 00007f0069d37a40 00007f0069d324e4 00007f0069d32455 00007f006ce1a060 00007f006ce2c716 00007f006ce3d287 00007f006ce3d208
0709 13:07:19.499846 (+ 94952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.499906 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:19.499949 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.447420 (+947471us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b540016add4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:20.447486 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.447695 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":535463,"prepare.queue_time_us":69151,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":94,"raft.queue_time_us":486737,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":14358,"spinlock_wait_cycles":226987264,"thread_start_us":94691,"threads_started":1}
I20260709 13:07:20.565955 22430 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:20.528388 22427 rpcz_store.cc:276] 0709 13:07:18.828606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.524613 (+1696007us) service_pool.cc:224] Handling call
0709 13:07:20.525211 (+   598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.527582 (+  2371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.527844 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.568913 25543 raft_consensus.cc:3055] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:20.569509 25543 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:20.569664 22576 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:20.570783 25543 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:20.562235 25563 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.165s	user 0.005s	sys 0.033s
I20260709 13:07:20.574801 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:20.538838 22580 rpcz_store.cc:276] 0709 13:07:18.796561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.796675 (+   114us) service_pool.cc:224] Handling call
0709 13:07:18.796926 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.466915 (+669989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.537883 (+1070968us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b5400087854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:20.538182 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521721600}
W20260709 13:07:20.567028 25564 log.cc:927] Time spent T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 1.179s	user 0.008s	sys 0.036s
I20260709 13:07:20.577637 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:20.579656 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:20.580880 23108 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:20.581950 23110 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:20.583067 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:20.512214 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:20.534482 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:20.566862 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1449) took 1464 ms. Trace:
I20260709 13:07:20.584618 22431 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:20.588879 22430 rpcz_store.cc:276] 0709 13:07:19.102108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.564945 (+1462837us) service_pool.cc:224] Handling call
0709 13:07:20.565474 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.566518 (+  1044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.566783 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.504380 22577 rpcz_store.cc:276] 0709 13:07:19.474502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.502721 (+1028219us) service_pool.cc:224] Handling call
0709 13:07:20.503969 (+  1248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.538976 22426 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:20.568987 22427 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.593515 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1447) took 1488 ms. Trace:
I20260709 13:07:20.594594 22431 rpcz_store.cc:276] 0709 13:07:19.101607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.543552 (+1441945us) service_pool.cc:224] Handling call
0709 13:07:20.544039 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.589308 (+ 45269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.589624 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.572326 25543 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.596441 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1426) took 1762 ms. Trace:
I20260709 13:07:20.600415 22426 rpcz_store.cc:276] 0709 13:07:18.829276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.538150 (+1708874us) service_pool.cc:224] Handling call
0709 13:07:20.538610 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.590983 (+ 52373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.591352 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.597684 22433 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:20.582324 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:20.608832 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2262) took 1404 ms. Trace:
I20260709 13:07:20.609334 22427 rpcz_store.cc:276] 0709 13:07:19.204749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.568176 (+1363427us) service_pool.cc:224] Handling call
0709 13:07:20.568714 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.601630 (+ 32916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.608754 (+  7124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.523080 25195 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.612100 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:20.622884 23104 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:20.623111 22425 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.642671 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:20.643428 25557 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.643955 25557 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:20.644374 25557 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.645284 22575 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:20.646077 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2283) took 1773 ms. Trace:
I20260709 13:07:20.646400 22575 rpcz_store.cc:276] 0709 13:07:18.872303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.599654 (+1727351us) service_pool.cc:224] Handling call
0709 13:07:20.644846 (+ 45192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.645724 (+   878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.645973 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.646873 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:20.650624 25472 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.665764 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:20.675696 25540 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:20.676514 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1417) took 1455 ms. Trace:
I20260709 13:07:20.677914 23111 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:20.677023 22506 rpcz_store.cc:276] 0709 13:07:19.183568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.184536 (+   968us) service_pool.cc:224] Handling call
0709 13:07:19.184932 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.264739 (+ 79807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.264770 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.265277 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.345057 (+ 79780us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:19.345121 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.345189 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.565962 (+1220773us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:20.583830 (+ 17868us) raft_consensus.cc:1685] finished
0709 13:07:20.583851 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.639139 (+ 55288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79354,"raft.queue_time_us":81282,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":84065536,"thread_start_us":79391,"threads_started":1,"wal-append.queue_time_us":121871}
I20260709 13:07:20.530983 25453 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.679399 23106 raft_consensus.cc:2410] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:20.680233 22574 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:20.679339 25453 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.835851 23109 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:20.724449 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:20.765508 22574 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.654609 25334 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:20.777616 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 78805.3us
W20260709 13:07:20.845683 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.843909 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 331858us
W20260709 13:07:20.846271 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.851025 22505 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.850842 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:20.729379 25513 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.244s	user 0.015s	sys 0.012s
I20260709 13:07:20.851418 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1571) took 1948 ms. Trace:
I20260709 13:07:20.851711 22506 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:20.852514 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 332705us
I20260709 13:07:20.854575 22574 rpcz_store.cc:276] 0709 13:07:18.898149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.764815 (+1866666us) service_pool.cc:224] Handling call
0709 13:07:20.765248 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.846531 (+ 81283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.846732 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.724220 25540 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:20.835261 25474 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.835435 25383 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:07:20.862285 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.864236 22576 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:07:20.866499 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 317194us
I20260709 13:07:20.776566 25508 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.731377 25311 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
W20260709 13:07:20.857218 25513 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.466s	user 0.022s	sys 0.015s
I20260709 13:07:20.872505 25444 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:20.871685 25383 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.858597 22578 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:20.844732 25326 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.877527 25326 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.879739 25326 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:20.881070 22426 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.881845 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2265) took 1675 ms. Trace:
I20260709 13:07:20.882421 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:20.884593 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2282) took 1998 ms. Trace:
I20260709 13:07:20.885113 22576 rpcz_store.cc:276] 0709 13:07:18.872055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.591591 (+1719536us) service_pool.cc:224] Handling call
0709 13:07:20.855942 (+264351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.869966 (+ 14024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.870219 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.886770 22576 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:07:20.887073 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.887492 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1574) took 1431 ms. Trace:
I20260709 13:07:20.887907 22576 rpcz_store.cc:276] 0709 13:07:19.455664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.885973 (+1430309us) service_pool.cc:224] Handling call
0709 13:07:20.886467 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.887178 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.887399 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.888444 25383 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.889571 22574 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:20.892767 25334 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.893584 25355 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.871462 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2279) took 1982 ms. Trace:
I20260709 13:07:20.893790 22474 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:20.882149 22426 rpcz_store.cc:276] 0709 13:07:19.206706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.601464 (+1394758us) service_pool.cc:224] Handling call
0709 13:07:20.853050 (+251586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.881556 (+ 28506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.881754 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11136}
W20260709 13:07:20.873023 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.903445 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1572) took 1448 ms. Trace:
I20260709 13:07:20.905694 22574 rpcz_store.cc:276] 0709 13:07:19.455149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.856090 (+1400941us) service_pool.cc:224] Handling call
0709 13:07:20.889223 (+ 33133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.903146 (+ 13923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.903384 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.899758 22577 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.906913 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1570) took 2026 ms. Trace:
I20260709 13:07:20.907245 22577 rpcz_store.cc:276] 0709 13:07:18.880512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.637457 (+1756945us) service_pool.cc:224] Handling call
0709 13:07:20.838782 (+201325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.906665 (+ 67883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.906862 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.854447 25570 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.901564 22506 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:20.896452 22575 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:20.896744 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.912678 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.918799 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2290) took 2019 ms. Trace:
I20260709 13:07:20.919606 22575 rpcz_store.cc:276] 0709 13:07:18.898156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.658087 (+1759931us) service_pool.cc:224] Handling call
0709 13:07:20.853837 (+195750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.915953 (+ 62116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.917495 (+  1542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.919668 23077 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:20.856288 25561 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:20.928573 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.926801 25535 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:20.929716 25355 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:20.932528 23077 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:20.933772 25472 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.934202 25472 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:20.930538 22574 raft_consensus.cc:1275] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:20.934427 25552 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:20.934700 22574 pending_rounds.cc:85] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 1
I20260709 13:07:20.935002 22574 pending_rounds.cc:107] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:20.935267 22574 raft_consensus.cc:2889] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.936028 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:20.936558 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.935001 25552 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:20.937122 22426 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:20.937788 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 356) took 1502 ms. Trace:
W20260709 13:07:20.938400 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.938002 25552 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:20.938913 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.939397 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.939726 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.940631 25472 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.940637 25444 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.945379 25444 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:20.936390 25535 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:20.950896 25535 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:20.951671 25387 consensus_meta.cc:287] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 1.377s	user 0.018s	sys 0.003s
I20260709 13:07:20.952056 22575 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:20.952654 23113 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:07:20.953162 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.953720 25561 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:20.948143 25444 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:20.903343 22579 rpcz_store.cc:276] 0709 13:07:18.871321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.367592 (+496271us) service_pool.cc:224] Handling call
0709 13:07:19.367872 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.477142 (+109270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.477172 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.478212 (+  1040us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.601481 (+123269us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:19.601526 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.601597 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.546707 (+945110us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:20.841458 (+294751us) raft_consensus.cc:1685] finished
0709 13:07:20.841478 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.853484 (+ 12006us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121083,"raft.queue_time_us":109289,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":19965,"spinlock_wait_cycles":60519552,"thread_start_us":90056,"threads_started":1,"wal-append.queue_time_us":147260}
I20260709 13:07:20.959504 22426 rpcz_store.cc:276] 0709 13:07:19.435552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.916383 (+1480831us) service_pool.cc:224] Handling call
0709 13:07:20.936897 (+ 20514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.937517 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.937711 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:20.934391 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.925953 25474 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:21.136672 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 126942us
W20260709 13:07:21.009215 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.994768 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.003993 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:21.033336 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.934137 25355 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:21.143216 22582 consensus_meta.cc:287] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.649s	user 0.059s	sys 0.035s
I20260709 13:07:21.131745 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1448) took 1996 ms. Trace:
I20260709 13:07:21.022358 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:21.136320 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 357) took 1624 ms. Trace:
I20260709 13:07:21.150769 22582 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
W20260709 13:07:21.134451 25596 log.cc:927] Time spent T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:21.099499 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2264) took 1893 ms. Trace:
W20260709 13:07:21.048247 25594 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:07:21.029493 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:21.157920 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.008970 25387 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.138904 25334 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.151022 22424 rpcz_store.cc:276] 0709 13:07:19.101871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.547621 (+1445750us) service_pool.cc:224] Handling call
0709 13:07:20.548150 (+   529us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:20.548738 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.548773 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:20.549520 (+   747us) log.cc:844] Serialized 52 byte log entry
0709 13:07:20.720772 (+171252us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:21.064228 (+343456us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.064535 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.064622 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.064666 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:21.064680 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.098258 (+ 33578us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10835,"raft.queue_time_us":17798,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":19583,"thread_start_us":393065,"threads_started":2,"wal-append.queue_time_us":497956}
I20260709 13:07:21.151134 22426 rpcz_store.cc:276] 0709 13:07:19.512090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.009232 (+1497142us) service_pool.cc:224] Handling call
0709 13:07:21.135643 (+126411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.135937 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.135961 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.136002 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:21.136032 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.136091 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.136222 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.173007 23111 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:07:21.160533 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.156687 22431 rpcz_store.cc:276] 0709 13:07:19.206075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.595731 (+1389656us) service_pool.cc:224] Handling call
0709 13:07:20.642450 (+ 46719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.642891 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:20.847968 (+205077us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.099005 (+251037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.099082 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:21.099146 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.099234 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.099404 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":673,"raft.queue_time_us":56705,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":9320,"thread_start_us":410418,"threads_started":2}
I20260709 13:07:21.178906 25508 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:21.161772 25449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.008s
W20260709 13:07:21.181005 25449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.002s	sys 0.009s
W20260709 13:07:21.162914 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.181340 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 178469us
I20260709 13:07:21.182947 25444 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.183245 22546 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:21.183605 25311 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.184631 25402 consensus_meta.cc:287] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.004s
I20260709 13:07:21.184333 25311 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.185384 25332 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.186945 25311 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:21.188285 25576 log.cc:927] Time spent T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 1.538s	user 0.013s	sys 0.023s
I20260709 13:07:21.188522 22424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:21.179260 22431 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:21.201884 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 360) took 1232 ms. Trace:
I20260709 13:07:21.202337 22431 rpcz_store.cc:276] 0709 13:07:19.969715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.178495 (+1208780us) service_pool.cc:224] Handling call
0709 13:07:21.178917 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.201614 (+ 22697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.201818 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.099964 25561 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.177917 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.189193 25026 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:21.189601 25444 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:21.207597 25444 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:21.187650 25311 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.192055 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2273) took 2322 ms. Trace:
I20260709 13:07:21.208509 22581 rpcz_store.cc:276] 0709 13:07:18.869754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.363583 (+493829us) service_pool.cc:224] Handling call
0709 13:07:19.363891 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.470350 (+106459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.470382 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.492049 (+ 21667us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.589306 (+ 97257us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:19.607914 (+ 18608us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.618739 (+ 10825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.618814 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.314555 (+695741us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b18004063c0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d35522 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:07:21.161051 (+846496us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b48002601d8. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0071d4baa1 00007f0071d42b37 00007f0071d429ca 00007f0071e3a26f 00007f0071e39f37 00007f0071e4e55c 00007f0071e4e508 00007f0071e4e488 00007f0071e4e443 00007f0071e4d6ec 00007f0070d77a96
0709 13:07:21.187405 (+ 26354us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:21.191723 (+  4318us) raft_consensus.cc:1685] finished
0709 13:07:21.191742 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.191890 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121153,"prepare.queue_time_us":19300,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":123505,"raft.run_cpu_time_us":22045,"raft.run_wall_time_us":1684713,"spinlock_wait_cycles":112477440,"thread_start_us":71572,"threads_started":1,"wal-append.queue_time_us":115735}
I20260709 13:07:21.189322 25475 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.210611 25475 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.210206 25026 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:21.213145 25475 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:21.213867 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2256) took 2424 ms. Trace:
I20260709 13:07:21.214673 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:21.215602 22500 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:21.216322 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:21.194106 25465 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.217483 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:21.218990 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:21.219643 22503 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:21.167042 25511 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:07:21.220643 22507 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:21.221400 25511 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:21.221585 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 341) took 3537 ms. Trace:
W20260709 13:07:21.222834 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 286926us
I20260709 13:07:21.214337 22425 rpcz_store.cc:276] 0709 13:07:18.789773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.521507 (+1731734us) service_pool.cc:224] Handling call
0709 13:07:20.608423 (+ 86916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.624458 (+ 16035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.213665 (+589207us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b540003dc50. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:21.213806 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186516352}
I20260709 13:07:21.220651 22424 raft_consensus.cc:606] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:21.222280 25511 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:21.048648 25545 consensus_queue.cc:1059] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 13:07:21.215067 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:21.222105 22432 rpcz_store.cc:276] 0709 13:07:17.683839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.964212 (+280373us) service_pool.cc:224] Handling call
0709 13:07:18.519202 (+554990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.692653 (+173451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.459571 (+1766918us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540043ce54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:21.221169 (+761598us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b540043ce50. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:21.221384 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1672829952}
I20260709 13:07:21.251804 22396 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:21.253892 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.254473 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.252374 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:21.278343 22474 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:21.229877 25543 consensus_meta.cc:287] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.628s	user 0.004s	sys 0.007s
I20260709 13:07:21.285450 25513 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.286201 25513 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.287264 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2266) took 1853 ms. Trace:
I20260709 13:07:21.287716 22433 rpcz_store.cc:276] 0709 13:07:19.434022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.635276 (+1201254us) service_pool.cc:224] Handling call
0709 13:07:21.210430 (+575154us) spinlock_profiling.cc:243] Waited 896 us on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfdeee 0000000000375939 00007f0071d711e0 00007f0071e3a0c4 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:07:21.210604 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.210905 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:21.211296 (+   391us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.286888 (+ 75592us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.286942 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:21.286985 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.287046 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.287191 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061568,"thread_start_us":75141,"threads_started":1}
I20260709 13:07:21.288715 25513 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:21.301347 25513 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.302014 25513 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.304538 25513 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:21.049108 25540 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:21.208678 25311 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.328387 22429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2252) took 2412 ms. Trace:
I20260709 13:07:21.328805 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:21.329872 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:21.330112 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 146958us
I20260709 13:07:21.331938 25402 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.321540 25508 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.252862 25449 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:21.335522 25311 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:21.335294 25449 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:21.329023 25026 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:21.253695 25444 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.227610 25561 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:21.324764 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:21.277951 25326 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.346203 22433 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.347395 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:21.352027 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.351023 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:21.248713 25472 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:21.356335 23108 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:21.229264 25334 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.356998 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:21.364320 22426 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.364671 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:21.367398 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:21.368155 22507 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:21.368607 22432 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:21.338187 22429 rpcz_store.cc:276] 0709 13:07:18.789018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.426662 (+1637644us) service_pool.cc:224] Handling call
0709 13:07:20.427130 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.427761 (+   631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.427790 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.428379 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.492052 (+ 63673us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:20.959169 (+467117us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.137371 (+178202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.137446 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.201190 (+ 63744us) raft_consensus.cc:1685] finished
0709 13:07:21.201208 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.201379 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":664644,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":39131,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":20931,"thread_start_us":362890,"threads_started":2,"wal-append.queue_time_us":367064}
I20260709 13:07:21.342549 25513 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.370252 22425 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 13:07:21.371155 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.374182 22473 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:21.376183 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:21.379287 23104 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.376992 22399 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:21.373046 22425 pending_rounds.cc:85] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 3
I20260709 13:07:21.382262 22425 pending_rounds.cc:107] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:21.382519 22425 raft_consensus.cc:2889] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.382776 22574 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:21.385926 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:21.389568 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 142151us
I20260709 13:07:21.367725 25508 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.392587 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:21.391530 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:21.381018 25402 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.395496 22432 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:21.400604 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 57498.9us
I20260709 13:07:21.402328 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2263) took 2196 ms. Trace:
I20260709 13:07:21.370276 25444 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.386967 25355 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.415620 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.423663 22424 raft_consensus.cc:2393] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:21.405189 23105 raft_consensus.cc:2410] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:07:21.420711 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 355) took 1036 ms. Trace:
I20260709 13:07:21.422555 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:21.415182 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1573) took 1959 ms. Trace:
I20260709 13:07:21.400166 25402 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:21.427798 22547 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:21.424582 22577 rpcz_store.cc:276] 0709 13:07:20.384088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.907948 (+523860us) service_pool.cc:224] Handling call
0709 13:07:20.959819 (+ 51871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.042956 (+ 83137us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:21.285650 (+242694us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.420287 (+134637us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.420353 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:21.420394 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.420457 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.420651 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105662,"prepare.queue_time_us":141951,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":3179,"thread_start_us":254943,"threads_started":2}
I20260709 13:07:21.425532 22330 catalog_manager.cc:5697] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 5 to 8, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 8 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:21.428550 25506 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:21.385752 25511 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.434224 25444 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:21.435145 25334 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:21.471088 25334 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:21.471513 25334 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.471843 25334 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:21.473613 22546 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:21.474741 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 51264.8us
I20260709 13:07:21.425225 22578 rpcz_store.cc:276] 0709 13:07:19.455432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.875138 (+1419706us) service_pool.cc:224] Handling call
0709 13:07:20.875575 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:20.876127 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.876155 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:20.876819 (+   664us) log.cc:844] Serialized 52 byte log entry
0709 13:07:21.037277 (+160458us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:21.149892 (+112615us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.150182 (+   290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.150270 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.414930 (+264660us) raft_consensus.cc:1685] finished
0709 13:07:21.414949 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.415121 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126040,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":9975,"raft.queue_time_us":224,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":5208,"thread_start_us":160029,"threads_started":1,"wal-append.queue_time_us":455013}
I20260709 13:07:21.476722 25501 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.460587 25510 consensus_queue.cc:1059] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:21.477854 23079 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:21.478101 25506 raft_consensus.cc:697] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:21.478794 25453 consensus_meta.cc:287] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.000s
I20260709 13:07:21.479421 25506 consensus_queue.cc:237] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:21.464711 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 88164.2us
I20260709 13:07:21.481268 22547 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:21.465155 25355 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.465416 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:21.467795 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 353) took 2033 ms. Trace:
I20260709 13:07:21.469298 25472 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:21.478745 25551 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:21.462435 25511 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.398602 25513 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.481575 25508 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:21.534160 25611 log.cc:927] Time spent T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:21.481850 22472 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:21.580904 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:21.722015 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.546723 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.610131 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:21.681185 22428 raft_consensus.cc:2410] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:07:21.681774 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 88453.5us
W20260709 13:07:21.721937 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 240781us
W20260709 13:07:21.721138 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 297928us
I20260709 13:07:21.535449 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:21.535945 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 351) took 1230 ms. Trace:
I20260709 13:07:21.738575 23112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 400) took 1146 ms. Trace:
I20260709 13:07:21.438222 25402 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.739470 22499 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:21.742074 22507 raft_consensus.cc:2410] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:21.770022 22504 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:21.567271 25557 consensus_meta.cc:287] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.922s	user 0.006s	sys 0.006s
I20260709 13:07:21.722543 22427 rpcz_store.cc:276] 0709 13:07:19.434852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.620138 (+1185286us) service_pool.cc:224] Handling call
0709 13:07:20.870002 (+249864us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.969131 (+ 99129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.969167 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.029162 (+ 59995us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.162196 (+133034us) spinlock_profiling.cc:243] Waited 8.58 ms on lock 0x7b4800080358. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0071d4baa1 00007f0071d42b37 00007f0071d429ca 00007f0071e3a26f 00007f0071e39f37 00007f0071e4e55c 00007f0071e4e508 00007f0071e4e488 00007f0071e4e443 00007f0071e4d6ec 00007f0070d77a96
0709 13:07:21.344676 (+182480us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:21.344719 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.344802 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.467464 (+122662us) raft_consensus.cc:1685] finished
0709 13:07:21.467485 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.467725 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3610,"raft.run_cpu_time_us":1402,"raft.run_wall_time_us":202677,"spinlock_wait_cycles":19742976,"thread_start_us":264359,"threads_started":1,"wal-append.queue_time_us":381163}
I20260709 13:07:21.722015 25551 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.566968 25453 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.464955 25474 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:21.805347 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 323663us
I20260709 13:07:21.738602 25501 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:21.809557 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:21.470649 25449 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:21.766813 22576 rpcz_store.cc:276] 0709 13:07:20.305611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.895023 (+589412us) service_pool.cc:224] Handling call
0709 13:07:20.916181 (+ 21158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.931065 (+ 14884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.931092 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.136668 (+205576us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.286493 (+149825us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:21.286534 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.286607 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.475981 (+189374us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:21.483868 (+  7887us) raft_consensus.cc:1685] finished
0709 13:07:21.483890 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.535879 (+ 51989us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3506,"raft.queue_time_us":47846,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":33006,"spinlock_wait_cycles":12302208,"thread_start_us":141760,"threads_started":1,"wal-append.queue_time_us":296501}
I20260709 13:07:21.477885 25510 raft_consensus.cc:3055] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:21.804069 22503 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:21.804801 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 268329us
I20260709 13:07:21.803450 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59018 (request call id 561) took 1224 ms. Trace:
I20260709 13:07:21.767573 23112 rpcz_store.cc:276] 0709 13:07:20.577163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.577319 (+   156us) service_pool.cc:224] Handling call
0709 13:07:20.577713 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.578411 (+   698us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:20.846059 (+267648us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.375603 (+529544us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.417340 (+ 41737us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.417492 (+   152us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:21.417527 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.418117 (+   590us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.616462 (+198345us) raft_consensus.cc:1685] finished
0709 13:07:21.616510 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.723898 (+107388us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":356348,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":1202,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":243,"thread_start_us":738926,"threads_started":2,"wal-append.queue_time_us":749078}
I20260709 13:07:21.581516 25475 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.480327 25561 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:21.568164 25612 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:07:21.616575 25532 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:21.629240 25387 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.802126 25570 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.816247 25326 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.817843 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.819530 25453 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.840975 25326 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.843132 25326 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:21.843132 25453 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:21.821413 25439 consensus_queue.cc:1048] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:21.822220 25513 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:21.849623 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2287) took 2974 ms. Trace:
I20260709 13:07:21.850085 22573 rpcz_store.cc:276] 0709 13:07:18.875507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.611805 (+1736298us) service_pool.cc:224] Handling call
0709 13:07:20.675326 (+ 63521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.861897 (+186571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.861928 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.904639 (+ 42711us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.416563 (+511924us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:21.456448 (+ 39885us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.490216 (+ 33768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.490310 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.849365 (+359055us) raft_consensus.cc:1685] finished
0709 13:07:21.849385 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.849562 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":213332,"prepare.queue_time_us":40654,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":219675,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":41466,"thread_start_us":418406,"threads_started":1,"wal-append.queue_time_us":560672}
I20260709 13:07:21.823256 25355 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:21.824561 22396 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:21.808024 25551 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.831915 25508 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:21.817140 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 562124us
I20260709 13:07:21.829761 22472 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:21.717903 25334 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:21.811789 25501 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.815425 23113 rpcz_store.cc:276] 0709 13:07:20.574148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.574367 (+   219us) service_pool.cc:224] Handling call
0709 13:07:21.798403 (+1224036us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54005a0854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:21.798572 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866408192}
I20260709 13:07:21.813495 25510 raft_consensus.cc:740] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:21.848735 25472 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:21.807207 25557 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:21.836879 25540 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:21.865172 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.868113 25501 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.871181 25625 consensus_queue.cc:1059] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:21.869837 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:21.875046 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.875177 23079 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:21.873893 25540 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:21.885213 25540 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.837103 25475 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.857450 25513 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.916725 25449 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.919313 25475 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:21.919536 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2288) took 3043 ms. Trace:
W20260709 13:07:21.919641 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 47561.8us
I20260709 13:07:21.919548 25449 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:21.921152 22428 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1440) took 2836 ms (client timeout 2015 ms). Trace:
W20260709 13:07:21.922748 22428 rpcz_store.cc:269] 0709 13:07:19.085085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.378960 (+293875us) service_pool.cc:224] Handling call
0709 13:07:21.920879 (+2541919us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54000d7d54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:21.921061 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5060539648}
I20260709 13:07:21.922194 25326 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.854993 25570 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.926330 25570 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:21.924103 25326 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:21.946576 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 131204us
I20260709 13:07:21.947424 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:21.928400 25628 log.cc:927] Time spent T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:07:21.919071 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 89490.8us
I20260709 13:07:21.949859 25449 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:21.929607 25424 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:21.951500 25326 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:21.874647 25453 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.955359 25453 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.875816 25472 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:21.955962 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.951610 25424 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:21.957943 25424 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:21.920388 25510 consensus_queue.cc:260] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.959645 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:21.960234 25510 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.942836 25383 consensus_queue.cc:1059] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:21.962885 25383 raft_consensus.cc:3055] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:21.963274 25383 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:21.964301 25383 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.965621 25383 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.957868 25472 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:21.969007 25627 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:21.969157 25625 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:21.947439 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2270) took 2284 ms. Trace:
I20260709 13:07:21.970443 25625 raft_consensus.cc:3055] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:21.951251 25558 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:21.919919 22580 rpcz_store.cc:276] 0709 13:07:18.875727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.639499 (+1763772us) service_pool.cc:224] Handling call
0709 13:07:20.648244 (+  8745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.890703 (+242459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.890747 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.891479 (+   732us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.049630 (+158151us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:21.049673 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.919131 (+869458us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540016a3d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:21.919182 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.919225 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:21.919238 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.919474 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7576,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":15900,"spinlock_wait_cycles":556187904,"thread_start_us":157706,"threads_started":1,"wal-append.queue_time_us":529391}
I20260709 13:07:21.950645 25513 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:21.951058 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.973706 23107 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:21.950073 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.975001 25453 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:21.975673 25513 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.976233 25513 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:21.978484 25513 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:21.969694 25627 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:21.981720 25627 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:21.982362 25387 raft_consensus.cc:3055] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:21.982832 25387 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:21.930423 22474 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:21.403119 22430 rpcz_store.cc:276] 0709 13:07:19.205407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.590108 (+1384701us) service_pool.cc:224] Handling call
0709 13:07:20.848335 (+258227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.880775 (+ 32440us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:21.274474 (+393699us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.401750 (+127276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.401851 (+   101us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:21.401923 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.402041 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.402240 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4819,"prepare.queue_time_us":455829,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":5647,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":10861,"spinlock_wait_cycles":17280,"thread_start_us":429107,"threads_started":2}
I20260709 13:07:21.970167 22426 rpcz_store.cc:276] 0709 13:07:19.663092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.228565 (+1565473us) service_pool.cc:224] Handling call
0709 13:07:21.320656 (+ 92091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.366139 (+ 45483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.947100 (+580961us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b54000d6e54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:21.947328 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40021888}
I20260709 13:07:21.954243 25334 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:21.984066 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 53754.6us
I20260709 13:07:21.934692 25545 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.970983 25625 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:21.985009 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:21.993808 23113 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:21.995414 22473 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:22.029693 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:22.022929 25474 raft_consensus.cc:2764] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:21.983529 25557 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:22.029127 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 184952us
I20260709 13:07:22.024356 25472 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.025921 25535 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:22.037880 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 164324us
I20260709 13:07:21.866850 25532 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:22.040408 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 55499.7us
W20260709 13:07:22.045312 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 224503us
I20260709 13:07:22.034286 25475 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:22.051642 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:22.054297 23079 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:22.026124 25627 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:07:22.056339 23111 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
W20260709 13:07:22.054405 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 103117us
I20260709 13:07:22.058164 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:22.051159 25535 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:22.075096 23079 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:22.053970 25551 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.060683 25444 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:22.057094 25472 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:22.074898 22330 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 6 to 7, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 7 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:07:22.101604 23079 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:22.114146 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 57885.3us
I20260709 13:07:22.094810 25552 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:22.095439 25472 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:22.094699 25465 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.095026 25543 raft_consensus.cc:3055] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:22.133515 25552 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.136751 25535 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.096647 25560 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.150334 25543 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:22.157560 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.158309 22573 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 4.
I20260709 13:07:22.157994 25543 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.159443 25543 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.117533 25540 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.162878 25540 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:22.166290 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.168334 25624 consensus_queue.cc:1059] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:22.170710 25474 raft_consensus.cc:3055] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:22.171131 25474 raft_consensus.cc:740] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:22.171993 22327 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33162 (request call id 244) took 32519 ms (client timeout 15000 ms). Trace:
W20260709 13:07:22.153340 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 51818.7us
I20260709 13:07:22.154556 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.057329 25387 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:22.199354 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 184111us
I20260709 13:07:22.172660 22330 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:22.199519 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:22.176498 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 82830.2us
I20260709 13:07:22.051947 25625 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.155684 25561 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.186565 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:22.188760 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.189127 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.209364 22574 raft_consensus.cc:2410] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:22.189934 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.188874 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.155716 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.200438 22582 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:22.147114 25472 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:22.215451 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.208849 22578 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:22.216446 22581 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:22.118528 25444 raft_consensus.cc:697] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:22.210624 22576 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:22.168212 25634 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.214843 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 264489us
I20260709 13:07:22.098665 25501 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.221688 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.227056 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.224833 22575 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:22.200322 25439 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.192993 25560 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:22.190225 25551 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.190412 25465 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.186169 25532 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.243925 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.241262 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.208403 25561 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.220383 25632 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.242363 22427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "634877efa82d48ea9055feb74030391f"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:22.208330 25540 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:22.219352 25383 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.258116 22580 raft_consensus.cc:2393] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:22.258638 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 81012.5us
I20260709 13:07:22.249652 22578 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:22.248952 22426 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:22.253878 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.261118 22573 raft_consensus.cc:2410] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:07:22.257061 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.178514 25629 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:07:22.229832 25634 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.172041 25474 consensus_queue.cc:260] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.214293 25402 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:22.307621 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51590.1us
W20260709 13:07:22.289094 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 62608.2us
I20260709 13:07:22.292709 25475 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:22.275317 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:22.290768 25635 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:22.259867 22427 raft_consensus.cc:606] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:22.254510 25561 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.254848 25625 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.346318 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:22.277356 22546 leader_election.cc:336] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.015s (SENT)
I20260709 13:07:22.348750 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:22.349900 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 72590.3us
I20260709 13:07:22.350924 22428 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:22.353183 25570 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.354725 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.319175 22575 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:22.263044 22330 catalog_manager.cc:5697] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 3 to 4, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 4 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.234656 25560 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.325495 22427 raft_consensus.cc:614] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:22.296670 25424 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.356896 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:22.357434 25424 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.357792 22330 catalog_manager.cc:5697] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 3 to 4, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 4 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:22.359891 25424 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.270714 25383 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.359606 22330 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 6 to 7, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 7 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.361974 25383 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.251772 25465 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.281989 25501 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:22.251644 25439 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.363970 25465 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.364347 25439 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.282401 25387 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.281213 25444 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.327708 25557 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.368568 25506 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.328670 25402 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:22.324643 25510 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.369642 25510 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:07:22.371290 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 96051.5us
I20260709 13:07:22.372135 25510 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.331586 25474 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.263207 25532 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:07:22.381466 25510 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:22.382467 25501 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.383000 25501 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.385298 25501 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:22.198354 22327 rpcz_store.cc:269] 0709 13:06:49.652961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.727860 (+ 74899us) service_pool.cc:224] Handling call
0709 13:07:22.171686 (+32443826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:17.614158 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:17.614770 (+   612us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:17.614815 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:07:17.614835 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:17.615507 (+   672us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:17.615561 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:17.615590 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:07:17.615966 (+   376us) tablet.cc:701] Row locks acquired
0709 13:07:17.615981 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:07:17.616135 (+   154us) write_op.cc:270] Start()
0709 13:07:17.616243 (+   108us) write_op.cc:276] Timestamp: P: 1783602437616081 usec, L: 0
0709 13:07:17.616264 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:17.746473 (+130209us) log.cc:844] Serialized 1694 byte log entry
0709 13:07:18.302458 (+555985us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f0069d180ac 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b
0709 13:07:18.540721 (+238263us) op_driver.cc:464] REPLICATION: finished
0709 13:07:18.820065 (+279344us) write_op.cc:301] APPLY: starting
0709 13:07:18.820143 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:18.820311 (+   168us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:18.820331 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:18.920555 (+100224us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:18.968532 (+ 47977us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:07:18.974499 (+  5967us) write_op.cc:312] APPLY: finished
0709 13:07:19.044710 (+ 70211us) log.cc:844] Serialized 41 byte log entry
0709 13:07:19.062424 (+ 17714us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:19.069096 (+  6672us) write_op.cc:454] Released schema lock
0709 13:07:19.072929 (+  3833us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:19.137812 (+ 64883us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:19.142504 (+  4692us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37091,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":271898,"apply.run_cpu_time_us":4685,"apply.run_wall_time_us":282802,"num_ops":4,"prepare.queue_time_us":191243,"prepare.run_cpu_time_us":21568,"prepare.run_wall_time_us":859634,"raft.queue_time_us":102114,"raft.run_cpu_time_us":95497,"raft.run_wall_time_us":223156,"replication_time_us":924282,"spinlock_wait_cycles":7331712,"thread_start_us":1064425,"threads_started":4,"wal-append.queue_time_us":682061,"wal-append.run_cpu_time_us":59416,"wal-append.run_wall_time_us":1675631}]]}
I20260709 13:07:22.335368 25635 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.387754 25501 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:22.263374 25632 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.338217 22581 raft_consensus.cc:1240] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:22.287747 25552 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.359479 25633 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.274492 25540 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.372642 25311 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:22.407519 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 204085us
I20260709 13:07:22.408144 22574 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:22.326030 25475 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.369196 25506 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.375257 22396 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:22.391707 23111 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:22.361409 22330 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 3 to 5, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 5 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:07:22.382109 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.405479 23077 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:22.406131 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.372790 22472 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:22.411055 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.416085 22577 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:22.416106 22473 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:22.416617 22578 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:22.418228 22580 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:22.417621 22330 catalog_manager.cc:5697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 5 to 7, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 7 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.424000 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:22.424839 22582 raft_consensus.cc:2376] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8. Re-sending same reply.
I20260709 13:07:22.426401 22579 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:22.405011 25570 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:22.436465 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 61283.7us
I20260709 13:07:22.437315 22396 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:22.438385 22578 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:22.438607 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 65906.8us
I20260709 13:07:22.382095 25510 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.428936 25465 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.406916 25501 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.438174 25543 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.438340 25629 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.457707 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.452172 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.474211 22574 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:22.456302 25543 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.451265 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.475426 22578 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:22.476356 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.476859 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:22.458333 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.480800 22330 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 6 to 10, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 10 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.482882 22330 catalog_manager.cc:5697] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 2 to 6, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 6 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:07:22.484606 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.476974 22578 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 4.
I20260709 13:07:22.486227 25632 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:22.486600 22578 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:22.487901 25475 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:22.489120 22578 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:22.489711 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:22.491016 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.459934 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:22.460932 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.439126 25570 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.461762 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.462092 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.462430 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:22.464896 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.469338 22506 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:22.470122 25561 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.435097 25552 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:07:22.471095 25558 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.472664 25026 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:22.477610 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.509968 22574 raft_consensus.cc:2368] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:07:22.510907 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.442158 25635 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:22.511731 22574 raft_consensus.cc:2410] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:22.478560 22580 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:22.478679 25543 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.513931 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.515331 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.479876 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.479169 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.516129 22576 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
W20260709 13:07:22.491823 22545 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.470s (SENT) [suppressed 34 similar messages]
I20260709 13:07:22.470136 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:22.517228 22579 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.458904 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.519585 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:22.446015 25402 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.500969 22582 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:22.501791 22501 raft_consensus.cc:2410] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:22.459903 25624 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:07:22.504940 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.505457 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:22.448271 25383 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.507193 25570 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:22.508052 25561 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.509142 22581 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:22.509037 22499 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:22.514010 25634 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:22.495978 22396 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:22.448937 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 86709.5us
I20260709 13:07:22.484315 22330 catalog_manager.cc:5697] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 3 to 4, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 4 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:22.447958 25557 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:22.536698 25557 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:22.526193 22502 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:22.495290 25629 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.527592 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.531059 22545 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:22.528395 22507 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:22.534638 25558 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.535250 22330 catalog_manager.cc:5697] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 1 to 3, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 3 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.526620 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.542639 22501 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:22.542894 22579 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
W20260709 13:07:22.542284 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 88851.2us
W20260709 13:07:22.543206 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.543388 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.543159 22507 pending_rounds.cc:85] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 6
I20260709 13:07:22.544466 22507 pending_rounds.cc:107] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:22.544819 22507 raft_consensus.cc:2889] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.520619 25311 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:22.537667 25557 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.536263 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:22.538086 22504 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
W20260709 13:07:22.546502 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 111074us
I20260709 13:07:22.548964 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:22.549682 22506 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.544436 22578 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:22.551524 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.551100 22330 catalog_manager.cc:5697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 5 to 8, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 8 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.554015 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.554826 22581 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:22.520570 25632 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:07:22.546631 25629 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.559042 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.561936 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.556844 22330 catalog_manager.cc:5697] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.561873 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:22.559273 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 116250us
I20260709 13:07:22.559758 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.563882 22427 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:22.509188 25472 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.565128 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.547894 25540 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.567829 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.568292 22500 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:22.570782 22432 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:22.538146 25334 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:07:22.554656 25535 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.572973 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.573197 22399 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:22.574859 22581 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:22.574935 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.566154 22428 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:22.460526 25642 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:07:22.576308 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.575548 22399 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:22.577613 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.582693 22426 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:22.529866 25402 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.579180 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:22.559068 25634 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.582791 22399 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:22.587394 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:22.569684 25624 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.594115 25424 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.598193 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.598918 22428 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:22.546202 25311 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.597506 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.593140 22506 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:22.599165 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.600998 22500 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:22.602015 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.646091 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:22.646132 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.647724 22425 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:22.649298 22545 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:22.651185 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:22.602228 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:22.652938 22432 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.655061 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.656653 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.657401 22502 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:22.659751 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:22.653999 22505 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:22.660444 22427 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.661018 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:22.661890 22431 raft_consensus.cc:2410] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:22.654022 25560 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.664948 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:22.665776 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 65858.3us
I20260709 13:07:22.581265 25465 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.669330 22501 raft_consensus.cc:2410] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:22.670466 22432 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:22.671268 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.670449 23079 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:22.672045 22426 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:22.580353 25570 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:22.672940 23077 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:22.674561 22581 raft_consensus.cc:2393] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:22.664628 25560 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.596531 25472 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.676822 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.589114 25634 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.590193 25439 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.598513 25444 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:22.678690 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:22.694590 22428 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.674139 25465 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.688216 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.686858 22427 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:22.689849 22431 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:22.584450 25558 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:07:22.678944 23076 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:22.692031 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:22.697927 22429 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:22.584918 25535 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.716936 22432 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:22.717676 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.718392 22506 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:22.723886 22425 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:22.693413 25510 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.727334 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.731168 22500 raft_consensus.cc:2410] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:22.731348 22429 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:22.693277 25439 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.693728 25634 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.695261 25465 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.733095 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.734534 22431 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:22.653267 25624 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:22.733979 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 58374.3us
I20260709 13:07:22.677412 25649 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.750334 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.751041 22426 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:22.697705 25444 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.751883 23076 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:22.753376 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 83017.5us
I20260709 13:07:22.688078 25570 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.714805 25472 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:22.758821 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 107733us
I20260709 13:07:22.762212 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:22.758376 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 91600.8us
I20260709 13:07:22.723649 25560 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.757557 22508 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:22.759471 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.754160 23079 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:22.761116 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.736416 25551 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.749179 25439 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.765676 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.767091 23076 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:22.749452 25501 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:22.753574 25444 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.750842 25649 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:22.756979 25650 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.772426 22429 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:22.776288 22547 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:22.781400 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.782435 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:22.785141 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.785902 22506 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:22.786581 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:22.784169 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:22.787948 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:22.783114 23107 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 4.
I20260709 13:07:22.763818 25560 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:22.792500 22575 raft_consensus.cc:2368] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:07:22.794937 22426 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:22.793529 22429 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:22.797683 25311 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:22.797844 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.798454 25624 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:22.798947 25506 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.771672 25654 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.780702 25561 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.799048 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.778033 25649 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.806787 23076 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:22.780958 25632 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.809202 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.811159 23111 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 13:07:22.812075 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:22.813553 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.771723 25642 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:07:22.789820 25657 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.812351 23111 pending_rounds.cc:85] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 8
I20260709 13:07:22.795970 25560 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.821964 23111 pending_rounds.cc:107] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:07:22.823400 23111 raft_consensus.cc:2889] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.823561 23106 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:22.825152 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.830013 22474 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:22.830651 25570 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:22.831336 25624 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.831637 23104 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:22.832734 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:22.833532 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:22.835807 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.836742 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:22.837551 23112 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:22.838057 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.838657 22429 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:22.784948 25501 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:07:22.790050 25334 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:07:22.841782 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.840891 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.844555 22472 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:22.846110 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.850813 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.852257 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:22.851475 22574 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:22.855333 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.853976 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:22.855247 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:22.856509 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49817.7us
I20260709 13:07:22.856653 22433 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:22.856967 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:22.858407 22432 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:22.860242 22472 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:22.861678 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.859728 25558 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:07:22.854497 25311 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:07:22.846199 25624 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:22.877345 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:22.863834 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:22.864977 25651 log.cc:927] Time spent T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:07:22.866063 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.868000 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.868918 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.869347 22432 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
W20260709 13:07:22.869710 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.870862 22428 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:22.841228 25653 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.873618 22472 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:22.866315 23077 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:22.884898 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.883072 22580 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:22.891769 22399 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:22.854842 25513 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:07:22.888965 25540 consensus_queue.cc:1059] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 13:07:22.895388 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 47544.8us
I20260709 13:07:22.895623 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:22.896090 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:22.889413 25511 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.897228 25511 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.897588 25511 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.896719 23111 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.902355 23076 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:22.899916 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:22.904439 22399 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:22.871511 25551 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.909065 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.883682 25545 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.927814 25545 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:22.928206 25465 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.936015 25465 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:22.890031 25624 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.936766 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.937479 22428 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:22.938478 25624 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:22.939070 25624 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:22.915571 22431 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:22.911104 22429 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:22.946331 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:22.947062 22576 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.911101 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.912022 22398 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:22.882414 25383 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:22.917906 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.919083 25402 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:22.913019 25655 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:07:22.920624 25660 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:22.905987 25474 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.921582 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:22.911286 25633 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.922492 25311 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:22.990222 25633 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.990505 25311 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.990981 25311 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.896602 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:22.953104 22429 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 13:07:22.961256 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 49312.8us
I20260709 13:07:22.993335 22429 pending_rounds.cc:85] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 3
I20260709 13:07:22.993607 22429 pending_rounds.cc:107] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:22.993831 22429 raft_consensus.cc:2889] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.994560 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.995388 25513 consensus_queue.cc:1059] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:22.995800 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:22.912588 25642 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:22.996397 22575 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.971510 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:22.910651 25627 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.910884 25657 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.973385 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:22.999465 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:23.000437 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:22.916983 25026 raft_consensus.cc:3055] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:22.977718 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:22.910981 25656 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:07:22.905936 25510 consensus_queue.cc:1059] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:07:22.980787 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:22.981455 25560 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.972569 25465 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.983393 25511 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.952873 25540 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.931358 25444 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:22.928323 25545 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.997056 22577 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.003806 23079 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:23.013021 25558 raft_consensus.cc:3055] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:23.013870 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:23.016697 22433 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:23.017043 22429 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:23.031663 22582 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:22.905879 25629 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:22.981917 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:22.990694 25633 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.996289 25513 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:07:23.001967 25627 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.998411 25642 raft_consensus.cc:697] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:07:23.029085 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 127666us
I20260709 13:07:23.004930 23111 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:23.008203 25026 raft_consensus.cc:740] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:23.032763 23110 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:23.038229 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 230597us
I20260709 13:07:23.038341 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:23.025759 25465 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:23.042088 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 142248us
I20260709 13:07:23.046662 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:23.024935 25657 raft_consensus.cc:697] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:23.050949 22425 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:23.028440 25510 raft_consensus.cc:3055] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:23.031296 25558 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:23.177752 22576 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
W20260709 13:07:23.192142 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 103742us
I20260709 13:07:23.028031 25540 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.101570 23109 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:07:23.163476 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 116789us
I20260709 13:07:23.092000 22545 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:23.030449 25532 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.225834 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:23.247543 22432 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:23.225881 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:23.240866 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 148966us
I20260709 13:07:23.246140 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:23.217882 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 313509us
I20260709 13:07:23.250402 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:23.076017 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:23.044860 25439 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.045070 25627 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.096024 25444 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:23.259994 22545 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:23.273137 22427 raft_consensus.cc:2393] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:23.273770 25501 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:23.274247 25501 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.274309 25439 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:23.274708 25501 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.276516 25667 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:23.277055 25667 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.273770 22545 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:23.216673 25383 raft_consensus.cc:697] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:23.277508 25667 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.263588 25511 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:23.264739 25311 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:23.285785 25311 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:23.092897 25625 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.164s
I20260709 13:07:23.228502 25652 raft_consensus.cc:3055] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:23.270009 25634 consensus_meta.cc:287] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.510s	user 0.004s	sys 0.004s
I20260709 13:07:23.269573 25561 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.232061 25510 raft_consensus.cc:740] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:23.278069 25558 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:23.278564 25383 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:23.279340 25664 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:07:23.241508 25540 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.220007 25649 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:23.101753 25635 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.086918 25465 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.096786 25026 consensus_queue.cc:260] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:23.098315 25642 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:23.515980 22575 consensus_meta.cc:287] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
W20260709 13:07:23.357084 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.614547 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:23.663633 23107 raft_consensus.cc:1240] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:23.311460 22545 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:23.625391 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 373038us
I20260709 13:07:23.543684 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:23.413242 22577 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:23.393941 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:23.287560 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:23.671195 23113 raft_consensus.cc:1240] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:23.675092 22433 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:23.626206 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:23.645414 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 401) took 1183 ms. Trace:
I20260709 13:07:23.346029 25334 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:23.306459 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 67323.3us
I20260709 13:07:23.675727 22429 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:23.641041 22575 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:23.675992 22504 rpcz_store.cc:276] 0709 13:07:22.457956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.458090 (+   134us) service_pool.cc:224] Handling call
0709 13:07:23.641209 (+1183119us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b54004268d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:23.641361 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130290560}
I20260709 13:07:23.256011 25669 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.669937 22432 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:23.677824 22474 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:23.612761 25661 log.cc:927] Time spent T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.833s	user 0.005s	sys 0.003s
I20260709 13:07:23.704010 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 376) took 1143 ms. Trace:
I20260709 13:07:23.704465 22424 rpcz_store.cc:276] 0709 13:07:22.560743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.560904 (+   161us) service_pool.cc:224] Handling call
0709 13:07:22.570660 (+  9756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.581789 (+ 11129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.581821 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.666533 (+ 84712us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.751375 (+ 84842us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:22.751414 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.751476 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.611893 (+860417us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:23.703624 (+ 91731us) raft_consensus.cc:1685] finished
0709 13:07:23.703663 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.703896 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14035,"raft.queue_time_us":7639,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8324,"spinlock_wait_cycles":4290304,"thread_start_us":45138,"threads_started":1,"wal-append.queue_time_us":91565}
I20260709 13:07:23.706776 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:23.707221 25627 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:23.645831 25532 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.709537 22399 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:23.641729 25635 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.510778 25501 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.456250 25545 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.690672 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:23.522545 25673 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.314s
I20260709 13:07:23.674085 25558 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.640015 25652 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:23.663251 25026 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.401304 25629 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:23.401643 25633 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.642566 25634 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:23.589813 25653 consensus_meta.cc:287] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.000s
I20260709 13:07:23.713562 25625 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:23.713881 25685 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:23.686278 25510 consensus_queue.cc:260] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:23.713459 25532 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:23.714592 22399 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:23.673691 22430 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:23.716188 25540 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.727947 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:23.801034 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 86529.9us
I20260709 13:07:23.801268 22433 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:23.677285 25334 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:23.732719 22474 leader_election.cc:400] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
W20260709 13:07:23.807906 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 98033us
I20260709 13:07:23.809780 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:23.685911 25669 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.712342 25387 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.726897 25635 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.719101 25557 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 13:07:23.798496 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 487127us
I20260709 13:07:23.822306 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:23.823010 22430 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:23.787496 25653 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:23.806214 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.259616 25657 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:23.793751 25685 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.844000 23107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 572) took 1047 ms. Trace:
I20260709 13:07:23.844213 25685 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.850008 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:23.812722 25334 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.850723 22424 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:23.817921 25675 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:23.852998 25675 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:23.853423 25675 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.854033 25685 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.824565 25652 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.855520 25652 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.813993 25669 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.825898 25540 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:23.827414 25557 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:23.828436 22578 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:23.828609 25681 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.860376 25681 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.862852 25681 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:23.817221 25387 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:23.863494 25387 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.864449 23109 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:23.866549 25532 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:23.728920 25465 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:23.830401 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:23.868265 22433 raft_consensus.cc:2410] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:23.811789 25424 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.835814 25667 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.854697 25690 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.811673 25510 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.876996 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:23.869927 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.870898 23076 leader_election.cc:336] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.561s (SENT)
I20260709 13:07:23.878341 23076 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:23.878600 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.868520 23107 rpcz_store.cc:276] 0709 13:07:22.796218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.796350 (+   132us) service_pool.cc:224] Handling call
0709 13:07:22.796652 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.669139 (+872487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.843740 (+174601us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54004a4a54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:23.843942 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990545792}
I20260709 13:07:23.880434 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:23.881245 22504 raft_consensus.cc:2393] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:23.884606 22431 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:23.885648 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:23.886544 22432 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:23.884455 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1466) took 1057 ms. Trace:
I20260709 13:07:23.890601 22427 rpcz_store.cc:276] 0709 13:07:22.826696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.841502 (+ 14806us) service_pool.cc:224] Handling call
0709 13:07:23.884193 (+1042691us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54001e73d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:23.884386 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974660864}
I20260709 13:07:23.893836 22500 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:23.893568 22472 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:23.908176 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:23.908342 22429 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:23.875108 25678 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:23.911289 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:23.913813 22433 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:23.913992 25444 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.914546 25444 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:23.913865 25511 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.917114 25511 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.918874 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:23.919133 25511 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:23.917408 25444 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:23.922459 22472 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:23.898571 25532 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.921239 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:23.906486 25663 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.924499 22508 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:23.928179 22472 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:23.929355 22430 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:23.940011 23110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 410) took 1050 ms. Trace:
I20260709 13:07:23.913407 25678 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.881660 25424 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.880434 25439 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:23.925103 25402 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:23.941143 23110 rpcz_store.cc:276] 0709 13:07:22.889410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.889553 (+   143us) service_pool.cc:224] Handling call
0709 13:07:22.915269 (+ 25716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.045940 (+130671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.939736 (+893796us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400206f54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:23.939941 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269747584}
I20260709 13:07:23.936661 25649 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:23.954099 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:23.955569 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:23.956542 25625 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:23.959370 25625 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.960767 25625 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.959894 25557 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.962848 25465 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:23.964139 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:23.964705 25625 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.964833 23110 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.967167 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:23.967798 22430 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.962731 25654 consensus_queue.cc:1059] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:23.969064 25654 raft_consensus.cc:3055] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:23.969445 25654 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:23.970314 25634 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:23.970217 25654 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.971282 25654 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.979272 22430 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:23.980178 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:23.987839 22504 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.989588 22428 raft_consensus.cc:2410] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:23.990087 25424 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:23.941277 25697 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:23.992169 25697 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:23.980605 23110 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:23.993088 25697 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.994258 25402 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:23.995234 25402 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:23.982906 23107 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:23.986172 25501 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:23.986860 25625 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:23.944932 25678 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.997884 22504 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:24.000844 25334 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.003345 25667 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:24.004772 25627 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:23.944702 25683 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:07:23.982285 25685 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:24.024093 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 214377us
I20260709 13:07:24.025589 22547 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:24.028813 22545 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:24.034332 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:24.033097 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:23.941100 25663 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.044338 22499 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.015969 25545 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:24.046365 22547 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:24.049713 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2290) took 1287 ms. Trace:
I20260709 13:07:24.014372 25535 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:24.050091 22425 rpcz_store.cc:276] 0709 13:07:22.762517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.768586 (+  6069us) service_pool.cc:224] Handling call
0709 13:07:22.780424 (+ 11838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.170224 (+389800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.049418 (+879194us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540003c354. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:24.049638 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621596544}
I20260709 13:07:23.964062 25635 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.064137 25635 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:24.068671 25685 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:24.069363 25685 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.056892 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:24.066120 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:24.064141 25663 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:24.071851 22504 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:24.064851 25387 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.048617 25501 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.080632 22547 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:24.042272 25633 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:24.085498 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:24.086721 25474 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:24.027848 25681 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:07:24.087247 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.090772 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2298) took 1259 ms. Trace:
I20260709 13:07:24.047166 25693 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:24.095754 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:24.095880 22431 rpcz_store.cc:276] 0709 13:07:22.831537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.940106 (+108569us) service_pool.cc:224] Handling call
0709 13:07:23.884357 (+944251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.885112 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.090544 (+205432us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54001e73d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:24.090699 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142152576}
I20260709 13:07:24.098095 22474 leader_election.cc:400] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:07:24.099671 22426 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.096977 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:24.036001 25669 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.036223 25675 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.084276 25624 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.087327 25535 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:24.087639 25667 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.069372 25627 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 13:07:24.176164 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.179430 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:24.152689 22508 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:24.152868 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.158736 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.101406 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:24.205019 22425 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:24.149291 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 51765.4us
I20260709 13:07:24.162403 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:24.206688 22474 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:24.207665 23079 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:24.101722 22575 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:24.102187 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 733) took 1293 ms. Trace:
I20260709 13:07:24.210836 23113 rpcz_store.cc:276] 0709 13:07:22.808982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.809177 (+   195us) service_pool.cc:224] Handling call
0709 13:07:22.809512 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.675382 (+865870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.101936 (+426554us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54005573d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:24.102123 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981241600}
I20260709 13:07:24.092613 25685 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:24.217676 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 61000.2us
I20260709 13:07:24.221498 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:24.222110 22429 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.224958 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:24.225736 22430 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.100978 25642 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.228354 25642 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.220629 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:24.230674 25642 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:24.231011 22432 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:24.231870 25642 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:24.095003 25654 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:24.238178 25654 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:24.238677 25625 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:24.231933 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:24.233944 22577 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:24.241232 22474 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:24.241598 22432 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:24.242604 22430 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:24.239713 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:24.243571 22573 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.244035 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.244701 22502 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:24.245635 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:24.247812 22431 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.252548 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:24.252784 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:24.253379 22574 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.253418 22432 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:24.100402 25501 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:24.267995 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:24.214099 25535 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:24.256166 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.239181 25654 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.260777 25560 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:24.095204 25652 consensus_queue.cc:1059] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 13:07:24.265661 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.277791 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:24.290983 22575 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.278523 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.277434 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.278220 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.266450 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.255097 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:24.284106 22425 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:24.281862 22507 raft_consensus.cc:2393] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:24.272609 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.289796 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.244052 25625 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.293318 22500 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:24.232429 25642 raft_consensus.cc:697] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:24.213883 25624 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.297606 22508 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:24.311167 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.312747 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:24.314312 22581 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:24.304427 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63267.2us
I20260709 13:07:24.307024 22576 raft_consensus.cc:1240] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:24.310119 25545 consensus_queue.cc:1059] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:24.311251 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.316352 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:24.311955 22472 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:24.280270 25535 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.318975 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.319909 22507 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:24.286618 25703 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.280153 25707 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:24.321813 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.323176 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:24.321682 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 111808us
I20260709 13:07:24.331202 22500 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:24.331547 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:24.324401 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:24.333671 23113 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:24.327376 23111 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:24.333957 22575 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
W20260709 13:07:24.335604 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 80620.7us
I20260709 13:07:24.339339 22573 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:24.339970 23107 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:24.345389 25383 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.346091 25383 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:24.347174 25383 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.325491 25545 consensus_queue.cc:1243] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer e32ba8e6132b4f8e98a99066b6fffe05 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:24.348671 25545 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:24.344861 25501 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.349577 23079 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:24.321312 25667 raft_consensus.cc:3055] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:24.351025 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.350828 25545 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.366986 25545 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:24.368088 25704 log.cc:927] Time spent T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:24.376236 25472 raft_consensus.cc:2764] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:24.367018 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.327993 25387 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:24.328382 25625 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.330989 25543 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.380824 22504 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:24.398042 22574 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:24.399588 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:24.400390 22575 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:24.402343 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:24.381842 25472 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:24.352041 25718 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:24.380395 25667 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:24.407912 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 84811.1us
I20260709 13:07:24.411294 22573 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:24.413110 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.425406 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:24.426856 22429 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:24.395474 25543 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.440843 25723 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.441824 25723 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.443856 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.337352 25707 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.446579 22426 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:24.412438 25718 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.438194 22575 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:24.429276 25675 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:24.453425 25711 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:07:24.454190 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.456002 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:24.457449 22575 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.457450 22504 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:24.462016 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:24.463088 22574 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:24.463703 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:24.445130 25703 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.464602 22579 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.480995 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:24.455271 25718 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.466452 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:24.417098 25472 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.484611 22573 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:24.485385 25624 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:24.401619 25642 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.466514 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:24.490032 22576 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:24.493862 22579 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:24.482501 22431 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:24.465085 25667 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.498659 22499 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:24.499985 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:24.468273 25710 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.235s	user 0.005s	sys 0.000s
W20260709 13:07:24.502805 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 179807us
I20260709 13:07:24.578224 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:24.571517 22575 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:24.549566 22504 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
W20260709 13:07:24.550647 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 238752us
W20260709 13:07:24.548415 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 128032us
W20260709 13:07:24.588231 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.589254 22581 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:24.491616 25669 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:24.603135 22473 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:24.606388 25714 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.367s	user 0.002s	sys 0.000s
I20260709 13:07:24.609035 25543 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:24.624178 25681 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.624828 25681 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.626657 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:24.629134 25511 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:24.629640 25511 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:24.626881 25681 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:24.627207 25558 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.630560 25558 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.632555 25558 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:24.627748 23077 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:24.627873 25444 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:24.633551 23077 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:24.633347 25444 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.634951 25551 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:24.635462 25551 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:24.635699 25444 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:24.628371 25510 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:24.635968 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:24.636368 25551 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.637189 25510 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.638854 25334 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:24.639348 25510 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:24.630474 25511 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.641654 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.642380 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:24.642869 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:24.643389 22504 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.636379 25560 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:24.648036 25627 raft_consensus.cc:3055] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:24.648602 25627 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:24.649634 25627 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.650701 22504 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:24.651407 25627 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.651687 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:24.652493 22504 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:24.653827 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.655023 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:24.653944 22399 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:24.656219 25681 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:24.656932 25681 raft_consensus.cc:697] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:24.658545 25681 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.657963 22399 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:24.667172 25510 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:24.668027 22399 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:24.668696 25510 raft_consensus.cc:697] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:24.671865 25686 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.673399 25510 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:24.684408 22399 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:24.581796 25667 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.684020 22504 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:24.693801 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:24.696126 22499 raft_consensus.cc:2376] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6. Re-sending same reply.
I20260709 13:07:24.705627 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:24.587952 25540 consensus_queue.cc:1059] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
W20260709 13:07:24.709794 25532 consensus_meta.cc:287] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.779s	user 0.010s	sys 0.000s
I20260709 13:07:24.710314 25532 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.504714 25472 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:24.710894 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:24.711767 22429 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:24.713056 22433 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:24.746475 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.781805 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 148296us
W20260709 13:07:24.782075 25402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.013s
W20260709 13:07:24.782619 25402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.010s	sys 0.013s
I20260709 13:07:24.784332 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:24.784816 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 125597us
I20260709 13:07:24.785602 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:24.786315 22428 raft_consensus.cc:2368] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10.
I20260709 13:07:24.595259 25387 consensus_queue.cc:1059] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.174s
I20260709 13:07:24.602583 25656 consensus_queue.cc:1059] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.176s
I20260709 13:07:24.602202 25383 consensus_queue.cc:1059] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.186s
I20260709 13:07:24.490473 25703 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:24.700007 25444 consensus_queue.cc:1059] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 13:07:24.789547 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:24.700516 25558 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:25.228652 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.904217 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45545.1us
I20260709 13:07:25.069562 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:25.232026 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.785622 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:25.233405 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 447837us
W20260709 13:07:25.234652 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.235291 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.169973 25561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.007s	sys 0.003s
W20260709 13:07:25.062461 25724 log.cc:927] Time spent T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
W20260709 13:07:25.061717 25717 log.cc:927] Time spent T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:07:25.187098 25719 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.230221 25696 raft_consensus.cc:3055] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:25.169154 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 566071us
I20260709 13:07:25.231413 22425 raft_consensus.cc:2410] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:07:25.062188 25747 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 13:07:25.060397 25545 consensus_meta.cc:287] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.000s
W20260709 13:07:24.901491 25677 log.cc:927] Time spent T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:07:24.789152 25560 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:07:25.224714 25740 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:07:25.238510 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1474) took 1349 ms. Trace:
W20260709 13:07:24.975725 25725 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.491s	user 0.000s	sys 0.001s
I20260709 13:07:25.245884 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:25.248420 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:25.254417 22431 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:25.174439 25642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.010s	sys 0.001s
I20260709 13:07:24.787014 25475 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.993633 25686 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.262250 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:25.301844 23111 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
W20260709 13:07:25.239274 25561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.008s	sys 0.004s
I20260709 13:07:24.825613 25535 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:25.256062 25736 log.cc:927] Time spent T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:07:25.017910 25723 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:25.229419 25387 raft_consensus.cc:3055] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:25.289506 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.289885 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 47668us
I20260709 13:07:25.191416 25707 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:25.201288 25551 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:25.297991 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49641.5us
I20260709 13:07:25.236125 25652 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.903129 25474 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:25.303711 22473 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:24.826040 25472 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.470s
I20260709 13:07:25.185375 25650 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.292395 22503 rpcz_store.cc:276] 0709 13:07:23.889067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.904638 (+ 15571us) service_pool.cc:224] Handling call
0709 13:07:23.924284 (+ 19646us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:24.005817 (+ 81533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.005854 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:24.006547 (+   693us) log.cc:844] Serialized 78 byte log entry
0709 13:07:24.026870 (+ 20323us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:24.026899 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.026958 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.467271 (+440313us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:25.017777 (+550506us) raft_consensus.cc:1685] finished
0709 13:07:25.017804 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.238434 (+220630us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26740,"raft.queue_time_us":28294,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":24966400,"thread_start_us":19974,"threads_started":1,"wal-append.queue_time_us":77215}
I20260709 13:07:25.253458 25696 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:24.823916 25685 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.263579 25383 raft_consensus.cc:3055] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:24.947176 25731 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.715s
I20260709 13:07:25.261030 25719 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:25.355585 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:25.465975 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:25.296373 25402 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:25.560660 25723 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.470103 25652 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:25.562166 25731 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:25.562809 25731 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:25.297755 25510 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.564874 25510 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:25.469902 25383 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:25.568063 25510 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:25.468096 22399 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:25.347080 25744 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:25.289661 25633 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.342720 25715 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.023s	sys 0.023s
I20260709 13:07:25.259133 25558 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:25.399171 25718 consensus_meta.cc:287] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.902s	user 0.008s	sys 0.002s
W20260709 13:07:25.559072 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 93221.9us
W20260709 13:07:25.642113 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.564102 25652 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:25.390635 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1515) took 1106 ms. Trace:
W20260709 13:07:25.305241 25642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.010s	sys 0.002s
I20260709 13:07:25.585163 25624 raft_consensus.cc:3055] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:25.399461 25753 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:25.583997 22508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1479) took 1575 ms (client timeout 1545 ms). Trace:
I20260709 13:07:25.470986 25656 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.287510 25545 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:25.645226 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 1.40732e+06us
I20260709 13:07:25.467666 25560 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:25.464273 25387 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:25.417786 25737 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:25.644189 22505 rpcz_store.cc:276] 0709 13:07:24.284715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.311519 (+ 26804us) service_pool.cc:224] Handling call
0709 13:07:24.328348 (+ 16829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.336816 (+  8468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.336845 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.662895 (+326050us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b2c0000e678. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:24.663266 (+   371us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.780645 (+117379us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.780685 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.780753 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.364278 (+583525us) raft_consensus.cc:1685] finished
0709 13:07:25.364304 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.390555 (+ 26251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7751,"raft.queue_time_us":19419,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":17560448,"thread_start_us":117012,"threads_started":1,"wal-append.queue_time_us":194417}
I20260709 13:07:25.709851 22582 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:25.641397 25681 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:25.577828 25675 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:25.470538 25650 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:25.511873 25685 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:25.575611 25745 log.cc:927] Time spent T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 13:07:25.646996 25753 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:25.585371 25754 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:07:25.509830 25669 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.574875 25727 log.cc:927] Time spent T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.312s	user 0.000s	sys 0.000s
I20260709 13:07:25.468889 25474 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.587312 25719 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:25.580900 25735 log.cc:927] Time spent T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 13:07:25.470023 25551 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:25.573652 25678 consensus_meta.cc:287] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 1.533s	user 0.009s	sys 0.004s
W20260709 13:07:25.635835 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 167903us
W20260709 13:07:25.464710 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 161097us
I20260709 13:07:25.600068 23076 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:25.636912 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:25.596678 25723 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:25.565116 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:25.640429 25746 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.443s	user 0.008s	sys 0.011s
W20260709 13:07:25.647207 22508 rpcz_store.cc:269] 0709 13:07:24.008186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.008326 (+   140us) service_pool.cc:224] Handling call
0709 13:07:25.583734 (+1575408us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400182ed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:25.583896 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248942336}
W20260709 13:07:25.672868 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.678639 22575 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:25.564158 25731 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:25.645370 25728 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.643224 25558 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:25.646318 25627 consensus_meta.cc:287] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.994s	user 0.018s	sys 0.006s
I20260709 13:07:25.643286 25557 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:25.722800 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:25.708092 25697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.449s	user 0.018s	sys 0.010s
I20260709 13:07:25.571612 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 420) took 1123 ms. Trace:
I20260709 13:07:25.647879 25624 raft_consensus.cc:740] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:25.650583 25656 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.649088 25744 raft_consensus.cc:697] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:25.643430 25633 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:25.648397 25402 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:25.645234 25718 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.162988 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 423) took 1713 ms. Trace:
I20260709 13:07:25.749562 22500 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:26.165014 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:26.167657 22577 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.828384 22427 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:26.176059 22504 rpcz_store.cc:276] 0709 13:07:24.449093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.232982 (+783889us) service_pool.cc:224] Handling call
0709 13:07:25.263052 (+ 30070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.291461 (+ 28409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.291496 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.299812 (+  8316us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.650111 (+350299us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:25.650156 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.650228 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.162731 (+512503us) raft_consensus.cc:1685] finished
0709 13:07:26.162753 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.162916 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28021,"raft.queue_time_us":84295,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4262,"thread_start_us":290008,"threads_started":1,"wal-append.queue_time_us":702323}
I20260709 13:07:25.747584 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:26.178615 22573 raft_consensus.cc:2410] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 13:07:26.164633 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.163802 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 440641us
I20260709 13:07:26.163960 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:26.114553 25751 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.279467 25751 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.166718 22503 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
W20260709 13:07:26.281621 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 681577us
W20260709 13:07:25.664588 25653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.007s	sys 0.027s
I20260709 13:07:26.013283 25707 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.285490 25707 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.286082 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:25.786813 25510 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:26.286916 25510 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.287320 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:26.288051 22508 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:26.289233 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1523) took 1846 ms. Trace:
W20260709 13:07:26.284843 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 119919us
I20260709 13:07:26.293357 22399 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:26.295137 22547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.012s	sys 0.018s
I20260709 13:07:26.300436 22577 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
W20260709 13:07:26.296348 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.003s	sys 0.036s
W20260709 13:07:26.303263 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.003s	sys 0.036s
W20260709 13:07:26.303684 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 659594us
I20260709 13:07:25.858700 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.295639 22499 raft_consensus.cc:2410] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:25.804932 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:26.166155 22507 rpcz_store.cc:276] 0709 13:07:24.447884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.448034 (+   150us) service_pool.cc:224] Handling call
0709 13:07:24.458425 (+ 10391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:24.481041 (+ 22616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.481075 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:24.497740 (+ 16665us) log.cc:844] Serialized 52 byte log entry
0709 13:07:24.701691 (+203951us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.780378 (+ 78687us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.823421 (+ 43043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.823498 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.571243 (+747745us) raft_consensus.cc:1685] finished
0709 13:07:25.571272 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.571512 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86793,"prepare.queue_time_us":77516,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":97771,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":31213,"thread_start_us":122350,"threads_started":1,"wal-append.queue_time_us":328797}
W20260709 13:07:26.298723 22547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.012s	sys 0.018s
I20260709 13:07:26.318368 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:26.322705 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.289803 22501 rpcz_store.cc:276] 0709 13:07:24.443048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.445008 (+  1960us) service_pool.cc:224] Handling call
0709 13:07:24.453692 (+  8684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.454214 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:24.454673 (+   459us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.788138 (+333465us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.166512 (+1378374us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b2c0000e678. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:26.284695 (+118183us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.284863 (+   168us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:26.284895 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.284966 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.288923 (+  3957us) raft_consensus.cc:1685] finished
0709 13:07:26.289033 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.289173 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125376,"prepare.queue_time_us":3651,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":102,"raft.queue_time_us":140988,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":47255,"spinlock_wait_cycles":9201408,"thread_start_us":238511,"threads_started":1,"wal-append.queue_time_us":805093}
I20260709 13:07:25.787050 25642 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.942813 25686 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.296463 25653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.011s	sys 0.049s
W20260709 13:07:25.806455 25667 consensus_meta.cc:287] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 1.102s	user 0.011s	sys 0.004s
I20260709 13:07:26.329555 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.331229 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.288560 25723 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.331934 22575 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:26.281447 25656 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:26.305330 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.335551 23109 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:26.294837 25697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.036s	user 0.019s	sys 0.019s
I20260709 13:07:25.860031 25444 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:26.296540 25557 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.337335 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:26.337638 25760 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.323s	user 0.000s	sys 0.000s
I20260709 13:07:26.338078 25764 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.340354 25757 log.cc:927] Time spent T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.488s	user 0.001s	sys 0.000s
W20260709 13:07:26.341216 22318 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 10c2f471167442c0b75d8cd50ed8c40c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:26.282226 25753 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.342976 25703 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.346324 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.346378 25510 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:25.720402 25696 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.347843 25673 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.296660 25678 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:26.349359 22427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34614 (request call id 388) took 1657 ms (client timeout 1804 ms). Trace:
I20260709 13:07:26.350239 25707 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:26.289295 25728 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.352133 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 422) took 1903 ms. Trace:
I20260709 13:07:26.352782 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.353183 25685 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.353533 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:26.145056 25625 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:25.990473 25758 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:26.354612 25383 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.354630 25624 consensus_queue.cc:260] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.357487 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1518) took 2050 ms. Trace:
I20260709 13:07:26.362506 25545 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.299275 25719 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.363095 25387 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.364306 25650 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:26.365206 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:25.746861 25681 raft_consensus.cc:697] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:25.945142 25763 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:25.723227 25675 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.365892 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:26.540938 22507 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:26.542279 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.304260 25669 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.517400 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.332463 25731 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.380800 25642 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.544946 22574 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:26.546460 25758 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.547638 25642 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:26.540763 22500 rpcz_store.cc:276] 0709 13:07:24.448887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.664493 (+215606us) service_pool.cc:224] Handling call
0709 13:07:24.664859 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.165924 (+1501065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.351803 (+185879us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003eb054. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:26.352047 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2493957504}
I20260709 13:07:26.548918 25686 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.550869 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:26.366088 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:26.569183 22500 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:26.540560 22427 rpcz_store.cc:269] 0709 13:07:24.698411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.702653 (+  4242us) service_pool.cc:224] Handling call
0709 13:07:26.349160 (+1646507us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b540043ab54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:26.349293 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385717504}
I20260709 13:07:26.590165 22505 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:26.591013 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1536) took 1014 ms. Trace:
I20260709 13:07:26.591459 22505 rpcz_store.cc:276] 0709 13:07:25.576797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.310733 (+733936us) service_pool.cc:224] Handling call
0709 13:07:26.590934 (+280201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.601678 22499 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:26.602392 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1533) took 1178 ms. Trace:
I20260709 13:07:26.602811 22499 rpcz_store.cc:276] 0709 13:07:25.424572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.345961 (+921389us) service_pool.cc:224] Handling call
0709 13:07:26.602319 (+256358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.543313 22506 rpcz_store.cc:276] 0709 13:07:24.307366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.321189 (+ 13823us) service_pool.cc:224] Handling call
0709 13:07:24.335294 (+ 14105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.353190 (+ 17896us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:24.383655 (+ 30465us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.581441 (+1197786us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b180040b0a0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f006ce1a060 00007f006ce2c716 00007f006ce3d287 00007f006ce3d208
0709 13:07:25.924089 (+342648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.924170 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:25.924227 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.357170 (+432943us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54004259d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:26.357229 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.357416 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135699,"prepare.queue_time_us":30787,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":168363,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":15357,"spinlock_wait_cycles":148878464,"thread_start_us":559855,"threads_started":2,"wal-append.queue_time_us":329199}
W20260709 13:07:26.539119 25738 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 1.479s	user 0.004s	sys 0.007s
W20260709 13:07:26.609297 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 425373us
W20260709 13:07:26.613986 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 320729us
I20260709 13:07:26.614917 22399 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:26.612826 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.621657 22508 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:26.622197 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1544) took 1043 ms. Trace:
I20260709 13:07:26.622499 22508 rpcz_store.cc:276] 0709 13:07:25.578957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.541589 (+962632us) service_pool.cc:224] Handling call
0709 13:07:26.622130 (+ 80541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.637044 22502 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:26.638178 22504 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:26.644909 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.512979 25771 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:26.660164 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44478.7us
I20260709 13:07:26.536988 25769 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.599085 25707 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.663372 22573 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:25.723512 25737 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.668191 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.681610 22505 raft_consensus.cc:2410] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:26.686019 22508 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:26.686851 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 430) took 2236 ms. Trace:
I20260709 13:07:26.687253 22508 rpcz_store.cc:276] 0709 13:07:24.450877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.623163 (+2172286us) service_pool.cc:224] Handling call
0709 13:07:26.685629 (+ 62466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.686556 (+   927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.686786 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.671867 22500 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:26.612382 25387 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.608212 25685 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:26.675422 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.511953 25652 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
W20260709 13:07:26.600785 22318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 259704us
I20260709 13:07:26.663761 25510 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:26.618590 25772 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.724610 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 435789us
I20260709 13:07:26.702800 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 425) took 2253 ms. Trace:
I20260709 13:07:26.608426 25766 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:26.670277 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 424) took 2221 ms. Trace:
I20260709 13:07:26.726186 22506 rpcz_store.cc:276] 0709 13:07:24.449282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.614035 (+2164753us) service_pool.cc:224] Handling call
0709 13:07:26.669747 (+ 55712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.669946 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.669971 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.670014 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:26.670054 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.670105 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.670210 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.660398 25383 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.543100 25444 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.712517 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1534) took 1136 ms. Trace:
I20260709 13:07:26.730845 22505 rpcz_store.cc:276] 0709 13:07:25.576092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.613835 (+1037743us) service_pool.cc:224] Handling call
0709 13:07:26.712416 (+ 98581us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.605170 25625 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.667273 25703 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.727569 22500 rpcz_store.cc:276] 0709 13:07:24.449484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.611849 (+2162365us) service_pool.cc:224] Handling call
0709 13:07:26.671703 (+ 59854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.702507 (+ 30804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.702734 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.733398 22508 raft_consensus.cc:1275] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:26.707474 25633 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.601457 25673 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.605350 25763 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.601279 25764 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.748948 22506 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:26.705897 25707 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.730031 25766 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:26.700245 25769 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.757824 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1530) took 1419 ms. Trace:
W20260709 13:07:26.760679 22474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.033s	sys 0.042s
I20260709 13:07:26.768739 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1537) took 1191 ms. Trace:
I20260709 13:07:26.604115 25751 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.737300 25703 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.754876 25765 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.679594 25771 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.756776 25777 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.790158 22474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.033s	sys 0.042s
I20260709 13:07:26.774690 22506 rpcz_store.cc:276] 0709 13:07:25.577058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.736042 (+1158984us) service_pool.cc:224] Handling call
0709 13:07:26.746853 (+ 10811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.768397 (+ 21544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.768673 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.775089 22508 rpcz_store.cc:276] 0709 13:07:25.338463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.720196 (+1381733us) service_pool.cc:224] Handling call
0709 13:07:26.733037 (+ 12841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.757491 (+ 24454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.757763 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.595880 25642 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:26.678431 25744 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.762173 25402 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:26.794715 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:26.770758 25715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.010s	sys 0.000s
I20260709 13:07:26.806903 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:26.795836 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.809654 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.813773 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.837100 25764 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.838438 25771 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.838999 25763 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:26.839262 25728 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:26.839840 25728 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:26.840299 25728 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.844125 25737 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:26.773453 25766 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.845901 25737 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:26.846740 25737 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:26.847489 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 70959.3us
I20260709 13:07:26.773926 25775 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.849398 25775 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.850375 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:26.852087 22546 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:26.748335 25681 consensus_queue.cc:237] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:26.790760 25635 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:26.772192 25551 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:26.893671 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:26.927471 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:26.933769 23110 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:26.735217 25772 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:26.892834 25715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.010s	sys 0.000s
I20260709 13:07:26.945779 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:26.954609 22581 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.004s	sys 0.017s
W20260709 13:07:26.957652 22581 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.005s	sys 0.017s
I20260709 13:07:26.954993 22507 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:26.826069 25751 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.960602 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1484) took 1060 ms. Trace:
I20260709 13:07:26.895248 25728 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.858094 25625 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:26.965288 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 299910us
I20260709 13:07:27.008817 22507 rpcz_store.cc:276] 0709 13:07:25.900107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.329569 (+429462us) service_pool.cc:224] Handling call
0709 13:07:26.960464 (+630895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.932080 25771 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.853818 25707 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.857250 25444 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.892926 25642 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:27.020206 25758 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:27.021274 25642 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:26.859237 25673 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:27.013888 22399 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:27.013782 22473 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:27.017558 25771 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.852680 25723 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:27.021989 25535 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.798565 25777 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:27.014004 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:27.022859 23110 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:26.941627 25779 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 13:07:27.036659 22578 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:26.968035 22505 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:26.957091 25551 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:27.062330 22545 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:27.062630 22396 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.015s	sys 0.013s
I20260709 13:07:27.030721 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:27.066279 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55062 (request call id 377) took 1361 ms. Trace:
I20260709 13:07:27.066759 22578 rpcz_store.cc:276] 0709 13:07:25.676708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.713088 (+ 36380us) service_pool.cc:224] Handling call
0709 13:07:27.038249 (+1325161us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54001d29d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:27.038352 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679238912}
I20260709 13:07:27.034073 25777 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:26.853933 25402 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:27.034715 25758 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:27.039429 22507 raft_consensus.cc:2376] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10. Re-sending same reply.
W20260709 13:07:26.904809 25465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.875s	user 0.007s	sys 0.028s
I20260709 13:07:26.859477 25557 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:26.852397 25775 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:26.985052 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:27.218261 23111 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:27.007848 25675 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:27.069802 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:26.800557 25765 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:27.072758 22396 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.015s	sys 0.013s
W20260709 13:07:27.245988 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 1.27407e+06us
I20260709 13:07:27.247383 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:26.855821 25769 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:27.095605 23109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 747) took 1834 ms. Trace:
I20260709 13:07:27.095901 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:27.249594 22578 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:27.098906 22427 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:27.099575 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:27.250674 22576 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:27.101227 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:27.102963 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:27.110131 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1540) took 1532 ms. Trace:
I20260709 13:07:27.113876 25511 raft_consensus.cc:3055] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:27.115556 22424 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:27.252404 22505 rpcz_store.cc:276] 0709 13:07:25.577880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.736106 (+1158226us) service_pool.cc:224] Handling call
0709 13:07:26.960135 (+224029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.037421 (+ 77286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.109875 (+ 72454us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400183dd0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:27.110049 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489004416}
I20260709 13:07:27.124001 22429 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:27.124902 22426 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:27.125795 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 746) took 1864 ms. Trace:
I20260709 13:07:27.254213 23113 rpcz_store.cc:276] 0709 13:07:25.261048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.261217 (+   169us) service_pool.cc:224] Handling call
0709 13:07:25.291199 (+ 29982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.316703 (+1025504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.316737 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.316782 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:26.316811 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.125530 (+808719us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002977d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:27.125585 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.125728 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2357878656}
I20260709 13:07:27.131558 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.255704 22430 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
W20260709 13:07:27.136502 25732 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 2.170s	user 0.005s	sys 0.020s
W20260709 13:07:27.142123 22504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1541) took 1564 ms (client timeout 1849 ms). Trace:
I20260709 13:07:27.256718 22582 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:07:27.256991 22504 rpcz_store.cc:269] 0709 13:07:25.578147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.290780 (+712633us) service_pool.cc:224] Handling call
0709 13:07:27.141888 (+851108us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b540021b6d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:27.142029 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221329152}
I20260709 13:07:27.257568 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:27.258224 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:27.258224 22576 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:27.140067 25718 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:27.163776 25696 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.255730 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:27.161895 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1511) took 2916 ms. Trace:
I20260709 13:07:27.261010 22579 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:27.167640 25678 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:27.202193 22575 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:27.205480 22545 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:27.070742 25474 consensus_meta.cc:287] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.786s	user 0.010s	sys 0.000s
I20260709 13:07:27.062335 25551 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:27.063594 25510 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:27.332258 25510 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:27.333053 25770 consensus_queue.cc:1059] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:27.333815 25770 consensus_queue.cc:1243] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer e32ba8e6132b4f8e98a99066b6fffe05 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:27.334263 25770 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:27.335647 25770 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:27.090840 25444 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:27.336680 25444 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.337083 25444 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.012771 25751 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:26.941205 25635 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:27.362648 22474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.001s	sys 0.079s
W20260709 13:07:27.363394 22474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.001s	sys 0.079s
W20260709 13:07:27.204578 23079 connection.cc:256] RPC call timeout handler was delayed by -1.7070834810000406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 13:07:27.214507 23077 connection.cc:256] RPC call timeout handler was delayed by -1.0033810150000591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 13:07:27.364899 23079 connection.cc:256] RPC call timeout handler was delayed by -1.0514924280000741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
I20260709 13:07:27.248132 22507 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
W20260709 13:07:27.210567 25465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.198s	user 0.007s	sys 0.028s
I20260709 13:07:27.249117 23109 rpcz_store.cc:276] 0709 13:07:25.261398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.287138 (+ 25740us) service_pool.cc:224] Handling call
0709 13:07:25.338897 (+ 51759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.572726 (+1233829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.095332 (+522606us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400543654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:27.095534 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291554688}
I20260709 13:07:27.251658 22580 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:27.120313 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.367390 23110 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:27.367666 22428 raft_consensus.cc:2410] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:27.208137 25535 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:27.213919 25720 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:27.240541 25715 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:27.014503 25686 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:27.070062 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 56354.7us
I20260709 13:07:27.203693 25779 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:27.261089 22502 rpcz_store.cc:276] 0709 13:07:24.245682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.254556 (+  8874us) service_pool.cc:224] Handling call
0709 13:07:24.254865 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.637566 (+2382701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.161536 (+523970us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b54003ab954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:27.161780 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5477959424}
I20260709 13:07:27.391199 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:27.296631 25784 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:07:27.252791 25511 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:27.091090 25764 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 13:07:27.300909 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:27.370280 25649 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.305996 25766 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:27.408265 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.410521 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:27.309221 25558 consensus_meta.cc:287] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 1.010s	user 0.009s	sys 0.000s
I20260709 13:07:27.310007 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.311115 25703 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:27.244112 25775 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:27.316128 25753 consensus_meta.cc:287] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.000s
I20260709 13:07:27.321398 25772 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:27.265038 25669 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:27.324832 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:27.327917 25696 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:27.330886 22330 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43642 (request call id 133) took 14010 ms (client timeout 15000 ms). Trace:
W20260709 13:07:27.346879 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 141466us
W20260709 13:07:27.368811 22500 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.007s	sys 0.041s
I20260709 13:07:27.369598 22396 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:27.417766 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48289.3us
I20260709 13:07:27.418541 22578 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:27.418980 22396 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.372512 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:27.210683 25627 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:27.374245 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:27.420385 23110 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:27.377476 23077 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:27.421424 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44117.5us
I20260709 13:07:27.411512 22428 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:27.422554 22500 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.007s	sys 0.041s
I20260709 13:07:27.381965 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.427824 22426 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:27.383665 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:27.428973 23111 raft_consensus.cc:2393] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:27.385545 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:27.220929 25402 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:27.376384 25543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.024s	sys 0.025s
I20260709 13:07:27.368300 25625 raft_consensus.cc:3055] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:27.374697 25501 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:27.369004 25675 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.302237 25387 consensus_meta.cc:287] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.000s
I20260709 13:07:27.401587 22473 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:27.373337 25535 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.402505 25764 consensus_queue.cc:1243] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer 10c2f471167442c0b75d8cd50ed8c40c log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:27.407401 25635 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:27.417392 25775 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:27.341939 25474 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:27.389088 25560 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:07:27.384812 25720 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:27.390626 25715 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:27.567765 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:27.583876 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:27.581552 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:27.612375 22424 raft_consensus.cc:2368] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10.
I20260709 13:07:27.475250 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:27.413492 22330 rpcz_store.cc:269] 0709 13:07:13.368341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.368589 (+   248us) service_pool.cc:224] Handling call
0709 13:07:27.330779 (+13962190us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:23.287222 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:23.537870 (+250648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:23.537929 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:07:23.537946 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:23.539184 (+  1238us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:23.539266 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:23.539300 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:07:23.642033 (+102733us) tablet.cc:701] Row locks acquired
0709 13:07:23.664528 (+ 22495us) write_op.cc:260] PREPARE: finished
0709 13:07:23.679910 (+ 15382us) write_op.cc:270] Start()
0709 13:07:23.701889 (+ 21979us) write_op.cc:276] Timestamp: P: 1783602443672880 usec, L: 0
0709 13:07:23.701921 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:07:23.706897 (+  4976us) log.cc:844] Serialized 5660 byte log entry
0709 13:07:24.104546 (+397649us) op_driver.cc:464] REPLICATION: finished
0709 13:07:24.490384 (+385838us) write_op.cc:301] APPLY: starting
0709 13:07:24.505787 (+ 15403us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:24.812012 (+306225us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:24.891876 (+ 79864us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:24.893994 (+  2118us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:24.894427 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:07:24.894483 (+    56us) write_op.cc:312] APPLY: finished
0709 13:07:24.894934 (+   451us) log.cc:844] Serialized 101 byte log entry
0709 13:07:24.897570 (+  2636us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:24.897759 (+   189us) write_op.cc:454] Released schema lock
0709 13:07:24.897832 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:24.900329 (+  2497us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:24.900368 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2560252,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":271139,"apply.run_cpu_time_us":5410,"apply.run_wall_time_us":448376,"num_ops":14,"prepare.queue_time_us":445878,"prepare.run_cpu_time_us":48477,"prepare.run_wall_time_us":520634,"raft.queue_time_us":212555,"raft.run_cpu_time_us":5899,"raft.run_wall_time_us":285811,"replication_time_us":385137,"thread_start_us":618905,"threads_started":4,"wal-append.queue_time_us":124713,"wal-append.run_cpu_time_us":30840,"wal-append.run_wall_time_us":2064188}]]}
W20260709 13:07:27.615964 22546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.034s	sys 0.049s
W20260709 13:07:27.618348 22546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.034s	sys 0.050s
I20260709 13:07:27.411435 25766 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:27.616364 22428 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
W20260709 13:07:27.625806 22474 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.026s (SENT) [suppressed 28 similar messages]
W20260709 13:07:27.627516 22471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.052s	sys 0.054s
I20260709 13:07:27.627609 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:27.619045 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 766962us
I20260709 13:07:27.628583 22426 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
W20260709 13:07:27.477296 25543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.024s	sys 0.025s
I20260709 13:07:27.619494 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:27.616946 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 221433us
W20260709 13:07:27.609772 25744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.027s	sys 0.064s
I20260709 13:07:27.399358 25779 raft_consensus.cc:697] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:27.579946 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.474255 25532 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:27.610496 25656 consensus_meta.cc:287] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 1.005s	user 0.018s	sys 0.000s
I20260709 13:07:27.632112 22506 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:27.627281 25770 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:27.627915 22471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.053s	sys 0.054s
I20260709 13:07:27.609275 25535 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.416676 25774 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:27.635861 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:27.632865 23076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.043s	sys 0.065s
I20260709 13:07:27.658794 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:27.637195 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.631256 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.629768 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:27.669286 23110 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
I20260709 13:07:27.629503 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.670989 22546 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.671816 25771 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:27.672183 25771 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.672521 25771 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.672643 25635 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.674026 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.674839 25669 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:27.676419 25635 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:27.677727 22546 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.655709 25532 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:07:27.629194 25759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.008s	sys 0.066s
W20260709 13:07:27.636215 25744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.027s	sys 0.064s
W20260709 13:07:27.632356 25719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.014s	sys 0.049s
W20260709 13:07:27.651305 25780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.019s	sys 0.043s
I20260709 13:07:27.619525 25675 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:27.663401 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.471344 25753 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:27.663455 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:27.668044 23076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.043s	sys 0.065s
W20260709 13:07:27.752413 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 941053us
I20260709 13:07:27.609478 25625 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:27.476274 25558 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:27.683259 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:27.754509 23110 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:27.478283 25627 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:27.685168 22546 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.472539 25649 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:27.685675 22431 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.006s	sys 0.017s
W20260709 13:07:27.758083 22431 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.006s	sys 0.017s
I20260709 13:07:27.683374 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:27.662685 25540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.019s	sys 0.034s
I20260709 13:07:27.639542 25751 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:27.766340 22433 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:27.766732 23107 raft_consensus.cc:2410] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:27.651288 25766 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:27.662568 25681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.019s	sys 0.035s
I20260709 13:07:27.688850 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:27.695385 25685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.015s	sys 0.009s
W20260709 13:07:27.620916 22581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.019s	sys 0.042s
W20260709 13:07:27.780853 22581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.019s	sys 0.043s
W20260709 13:07:27.691490 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.624457 25501 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:27.590895 25511 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:27.694151 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 275269us
I20260709 13:07:27.809072 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.810503 22396 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.658560 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:27.747141 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.662055 25770 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:27.472074 25551 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:27.688262 25532 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.654196 25703 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 13:07:27.695431 25719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.014s	sys 0.050s
I20260709 13:07:27.763116 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:27.762435 25387 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.769681 22428 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:07:27.690270 22425 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.020s	sys 0.005s
I20260709 13:07:27.774289 25718 consensus_queue.cc:1059] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:07:27.762833 25540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.019s	sys 0.035s
I20260709 13:07:27.775213 22424 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:27.868940 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1637) took 1535 ms. Trace:
I20260709 13:07:27.869411 22573 rpcz_store.cc:276] 0709 13:07:26.333466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.333634 (+   168us) service_pool.cc:224] Handling call
0709 13:07:27.868756 (+1535122us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400088754. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:27.868883 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258608384}
I20260709 13:07:27.776628 23077 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.869953 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.780140 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:27.689846 25772 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:07:27.782059 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1639) took 1448 ms. Trace:
W20260709 13:07:27.803429 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 118338us
I20260709 13:07:27.872506 22581 rpcz_store.cc:276] 0709 13:07:26.334099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.334243 (+   144us) service_pool.cc:224] Handling call
0709 13:07:26.339234 (+  4991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.339495 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:26.958354 (+618859us) log.cc:844] Serialized 14 byte log entry
0709 13:07:27.781537 (+823183us) log.cc:844] Serialized 14 byte log entry
0709 13:07:27.781703 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:27.781749 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:27.781806 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.781878 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.781999 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37263,"prepare.queue_time_us":693360,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":23952,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":53038,"spinlock_wait_cycles":58299520,"thread_start_us":1383104,"threads_started":2}
I20260709 13:07:27.874334 22546 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.774783 25766 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:27.775605 25681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.019s	sys 0.036s
I20260709 13:07:27.777330 25744 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.814932 25696 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.843696 25633 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:27.754218 25780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.022s	sys 0.050s
I20260709 13:07:27.861604 25720 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:27.862780 25715 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:27.865021 22425 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.020s	sys 0.005s
I20260709 13:07:27.860073 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.894212 22430 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:27.844761 22396 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.870600 22424 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:27.895768 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.806223 25765 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:27.896417 22424 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:27.884707 25696 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:27.897323 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.897873 22424 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5.
I20260709 13:07:27.898761 25696 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:27.687230 25759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.009s	sys 0.066s
W20260709 13:07:27.900995 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 56356.7us
I20260709 13:07:27.685575 25774 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:27.878506 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 101961us
W20260709 13:07:27.879798 25781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.055s	sys 0.079s
I20260709 13:07:27.665103 25656 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:27.907272 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:27.879544 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 457825us
I20260709 13:07:27.867646 25770 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.859506 25719 raft_consensus.cc:697] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:27.901659 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:27.806728 25751 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.911782 25656 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:27.912454 25772 raft_consensus.cc:2764] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:27.912463 25812 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:27.907864 25781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.055s	sys 0.079s
I20260709 13:07:27.911701 25715 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:27.908151 25744 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:27.870893 25625 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:27.950496 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1486) took 2049 ms. Trace:
I20260709 13:07:27.950947 22506 rpcz_store.cc:276] 0709 13:07:25.900660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.829367 (+928707us) service_pool.cc:224] Handling call
0709 13:07:26.830333 (+   966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.659595 (+829262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.950225 (+290630us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b540019aad4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:27.950428 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842062080}
I20260709 13:07:27.690166 25635 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.917229 25532 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:27.884194 25766 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:27.918149 25793 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 13:07:27.918949 25797 log.cc:927] Time spent T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:07:27.780825 25685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.019s	sys 0.009s
I20260709 13:07:27.922614 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:27.917124 22499 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:27.892148 25642 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:27.905992 25758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.024s
W20260709 13:07:27.929919 25444 consensus_meta.cc:287] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 13:07:27.893874 25649 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:27.890439 25402 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:27.891955 25511 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.904881 25474 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:27.933840 25465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.006s	sys 0.022s
I20260709 13:07:27.913789 22396 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:27.873106 25387 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:27.998641 25758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.000s	sys 0.025s
W20260709 13:07:27.958761 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 212360us
I20260709 13:07:27.972553 25753 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:27.949946 25731 consensus_meta.cc:287] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 1.365s	user 0.012s	sys 0.000s
I20260709 13:07:27.986754 25774 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:27.986941 25635 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:27.987768 25627 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:27.936892 25751 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:27.983708 25383 consensus_meta.cc:287] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 1.236s	user 0.013s	sys 0.005s
I20260709 13:07:27.992297 25560 raft_consensus.cc:3055] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:28.033059 22547 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:27.994179 25532 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:27.995235 22431 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:27.998037 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:27.954710 25715 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:27.968214 25625 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.000723 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:27.804073 25779 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:27.959251 25675 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:28.002341 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 146100us
I20260709 13:07:27.923362 25501 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:28.007682 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 133452us
I20260709 13:07:28.056303 22546 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:28.030813 25810 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.946110 25633 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.971676 25685 raft_consensus.cc:697] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:27.983464 25812 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:28.017306 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 103589us
I20260709 13:07:28.094935 23112 raft_consensus.cc:1240] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:27.955451 25744 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.021869 22501 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:07:28.007133 25465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.006s	sys 0.022s
I20260709 13:07:27.992873 25642 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:28.041577 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:28.046772 22505 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:28.047268 22398 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:28.037642 25673 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.048066 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:28.102293 22573 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:28.048671 22431 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:28.005012 25444 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:27.931387 25775 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.058629 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:28.105120 22396 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:07:28.105388 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 46848.2us
I20260709 13:07:28.106586 22546 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.107640 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.059168 25759 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.060194 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:28.112488 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 52371.7us
I20260709 13:07:28.030696 25635 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.064016 23108 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:28.036785 25799 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:07:28.078274 25751 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.020551 25719 consensus_queue.cc:237] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.081763 25387 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.084628 25715 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.087240 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:28.088016 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:28.046118 25798 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:07:28.036804 25560 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:28.101121 22505 pending_rounds.cc:85] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 3
W20260709 13:07:28.103220 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 56080.4us
I20260709 13:07:28.130390 22505 pending_rounds.cc:107] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:28.130760 22505 raft_consensus.cc:2889] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.104027 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:28.109001 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:28.110987 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.062709 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:28.115780 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:28.113665 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:28.132877 23112 raft_consensus.cc:2393] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 5: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:28.133774 22399 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:28.134492 22399 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:28.100598 25728 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.091442 25825 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.116549 25772 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.124168 22427 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:28.102042 25642 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.142249 25728 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.142679 25560 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.128968 25822 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:28.138160 25825 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:28.144255 25825 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.144665 25675 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:28.145110 25675 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:28.145541 25675 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.120404 25810 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:28.128047 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1490) took 2173 ms. Trace:
I20260709 13:07:28.148108 22499 rpcz_store.cc:276] 0709 13:07:25.954647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.603633 (+648986us) service_pool.cc:224] Handling call
0709 13:07:28.127751 (+1524118us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001842d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:28.127971 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923409152}
I20260709 13:07:28.129536 22581 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.148840 25810 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:28.151711 25753 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.113576 25758 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.135398 25824 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.152772 25758 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.115566 25633 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:28.153208 25758 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.153631 25633 raft_consensus.cc:697] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:28.153967 25444 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.114269 25673 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.154567 25633 consensus_queue.cc:237] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.143854 25822 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:28.156374 25822 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.118230 25802 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.081243 25535 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.109894 22396 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.137745 25791 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:07:28.172370 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:28.121295 25510 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.137413 22546 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.152266 25753 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.159273 22399 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:28.167265 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1483) took 2267 ms. Trace:
W20260709 13:07:28.169032 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.168650 25821 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:28.158445 25759 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.193265 25759 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:28.193756 25759 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.186367 25387 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.195346 25387 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:28.158461 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.173606 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 63788.9us
I20260709 13:07:28.175779 22581 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:28.183861 22399 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:28.183408 22500 rpcz_store.cc:276] 0709 13:07:25.899789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.737433 (+837644us) service_pool.cc:224] Handling call
0709 13:07:26.748646 (+ 11213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.748881 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:27.423009 (+674128us) log.cc:844] Serialized 14 byte log entry
0709 13:07:27.892898 (+469889us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.166713 (+273815us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18003a5460. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069cafc0a 00007f00733ef219 00007f0069d37a40 00007f0069d324e4 00007f0069d32455 00007f006ce1a060 00007f006ce2c716 00007f006ce3d287 00007f006ce3d208
0709 13:07:28.166903 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.166959 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:28.167011 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.167077 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.167200 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":271687,"prepare.queue_time_us":284503,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":281487,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":3944,"spinlock_wait_cycles":44693248,"thread_start_us":1130938,"threads_started":2,"wal-append.queue_time_us":594878}
I20260709 13:07:28.198064 22396 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.143843 25560 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:28.185256 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.185354 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 47990.2us
I20260709 13:07:28.154431 25635 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.188709 25770 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.198076 22502 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:28.182633 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.160356 25673 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.205384 25673 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:28.199157 22399 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:28.186589 25753 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.178918 25824 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.206317 25673 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.197335 25444 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:28.209149 25444 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:28.209641 25444 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.209968 25642 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.205801 25744 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.124305 25685 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.181679 25799 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.213848 25799 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:28.214392 25810 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.151932 25771 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.181067 25510 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:28.216960 25510 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.214356 25799 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.217661 25771 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:28.200807 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.225214 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:28.226050 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:28.226588 22396 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.226858 25791 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:28.227419 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:28.227749 25810 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.228724 25810 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:28.229198 25824 consensus_queue.cc:1048] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:28.229795 22396 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.230027 25816 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:28.231602 23077 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:28.231834 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.233516 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.234009 23077 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:28.234555 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.235363 25775 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.235775 25775 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.235857 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.236156 25775 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.233532 22578 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:28.238271 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.239651 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.240700 25561 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:28.241163 25561 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.241528 25561 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.226739 22573 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:28.244562 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.245389 25824 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.245865 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.249125 25718 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:28.227458 25791 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:28.245961 25824 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.247702 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.248162 25532 consensus_queue.cc:1059] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:28.250142 25791 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.258519 25561 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.251663 22575 pending_rounds.cc:85] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:07:28.260954 22575 pending_rounds.cc:107] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:28.261219 22575 raft_consensus.cc:2889] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.261559 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.254323 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:28.262694 22573 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.249280 22506 raft_consensus.cc:2410] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:28.253609 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:28.264405 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.255553 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.265425 22579 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.268554 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:28.269536 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:28.269836 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:28.273721 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 72978.1us
I20260709 13:07:28.275010 22546 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.274868 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.278544 22399 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.279340 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.280095 22396 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.257315 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.282586 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.283279 22500 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:28.288640 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.289618 22506 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.280221 22499 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:28.293113 22499 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:07:28.297592 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.302439 22579 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:28.304360 22500 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:07:28.219475 25765 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:28.304790 22500 pending_rounds.cc:85] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 4
I20260709 13:07:28.306842 22500 pending_rounds.cc:107] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:07:28.307101 22500 raft_consensus.cc:2889] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.212350 25642 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:28.306140 22432 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:28.255510 25532 raft_consensus.cc:3055] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:28.255820 25810 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.252005 25824 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.304122 25635 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.321667 22506 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:28.213884 25758 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.322865 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.314630 25816 consensus_queue.cc:1243] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer e47a624c3ddb48c5a8947ac0b3e71f84 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:28.324756 22396 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.291138 25673 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.325320 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.310011 25771 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.325973 22431 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.310184 25765 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:28.312902 25685 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.295105 25561 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:28.311534 25764 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.328985 22396 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.329133 25535 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.312656 25532 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:07:28.356163 25830 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:07:28.356204 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.357611 25532 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.358724 25532 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:28.362855 25814 log.cc:927] Time spent T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.313s	user 0.001s	sys 0.001s
W20260709 13:07:28.363037 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.363283 25825 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:28.331195 25817 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
I20260709 13:07:28.373958 22426 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:28.333577 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.376128 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:28.377043 22431 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:28.378258 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.327697 25816 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:28.338284 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.327724 25026 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.343793 25759 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.331766 25765 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.394645 25026 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.346971 22573 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:28.397956 25802 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:28.333621 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.398854 22506 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:28.398644 25802 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.398919 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:28.399816 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.397956 25026 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.401000 25802 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.401376 23076 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:28.402281 25718 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:28.402706 25718 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:28.403091 25718 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.403564 25759 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:28.387840 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 58908.7us
I20260709 13:07:28.404666 22396 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:28.400923 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.405962 22506 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:28.406841 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.407368 22506 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:28.408119 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.408710 22506 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:28.409569 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.410409 22506 raft_consensus.cc:2393] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:28.411194 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.412501 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.413115 22506 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:28.413786 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:28.415518 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.416666 22507 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:28.316941 25675 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.417142 22507 pending_rounds.cc:85] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 3
I20260709 13:07:28.421531 22507 pending_rounds.cc:107] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:28.421834 22507 raft_consensus.cc:2889] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.422850 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.425300 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:28.417001 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 138531us
I20260709 13:07:28.428117 23076 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.430423 25803 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.432521 25758 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.433502 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:28.436688 25841 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:28.437240 25841 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.374097 25775 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.438898 25803 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.439518 25775 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.384819 25744 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.419021 25561 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:07:28.441123 22580 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:28.442075 22396 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:28.346760 25822 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.443607 22396 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:28.444550 25822 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:28.444753 25764 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.445278 25764 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.445623 25764 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.446211 25811 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.446696 25811 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.447150 25811 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.420310 25510 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.437652 25841 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.451627 23106 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:28.458479 22429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2347) took 1094 ms. Trace:
I20260709 13:07:28.449043 25802 consensus_queue.cc:1059] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:07:28.467530 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:28.469554 25838 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:07:28.475039 22427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 2336) took 1341 ms (client timeout 1531 ms). Trace:
W20260709 13:07:28.475522 22427 rpcz_store.cc:269] 0709 13:07:27.133396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.309728 (+176332us) service_pool.cc:224] Handling call
0709 13:07:28.474823 (+1165095us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54003ac5d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:28.474970 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619708160}
I20260709 13:07:28.477026 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 2343) took 1268 ms. Trace:
I20260709 13:07:28.477496 22428 rpcz_store.cc:276] 0709 13:07:27.209153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.631005 (+421852us) service_pool.cc:224] Handling call
0709 13:07:28.476820 (+845815us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b540021ff54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:28.476937 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221092736}
I20260709 13:07:28.437412 25795 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.478991 25795 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:28.479417 25795 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.478637 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.468395 23110 raft_consensus.cc:2393] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:07:28.478502 25846 log.cc:927] Time spent T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:07:28.488992 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.460719 22429 rpcz_store.cc:276] 0709 13:07:27.364000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.961868 (+597868us) service_pool.cc:224] Handling call
0709 13:07:27.962140 (+   272us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:27.999121 (+ 36981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.999152 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:28.003829 (+  4677us) log.cc:844] Serialized 52 byte log entry
0709 13:07:28.101462 (+ 97633us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:28.124927 (+ 23465us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.125109 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.125163 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.137678 (+ 12515us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4800080358. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0071d4baa1 00007f0071d42b37 00007f0071d429ca 00007f0071e3a26f 00007f0071e39f37 00007f0071e4e55c 00007f0071e4e508 00007f0071e4e488 00007f0071e4e443 00007f0071e4d6ec 00007f0070d77a96
0709 13:07:28.429159 (+291481us) raft_consensus.cc:1685] finished
0709 13:07:28.458213 (+ 29054us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.458406 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67185,"prepare.queue_time_us":25098,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":13289,"raft.queue_time_us":37932,"raft.run_cpu_time_us":2336,"raft.run_wall_time_us":156208,"spinlock_wait_cycles":7105280,"thread_start_us":67011,"threads_started":1,"wal-append.queue_time_us":121482}
I20260709 13:07:28.490967 22429 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.486059 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.493739 22429 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:07:28.426694 25839 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.427354 25649 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:28.496922 22472 leader_election.cc:400] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10.
I20260709 13:07:28.498442 23077 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:28.502602 22472 leader_election.cc:403] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:28.502390 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.446585 25444 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.503698 23077 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:28.511402 25825 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.419199 25791 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.428366 25766 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.513960 22472 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:28.489681 25810 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:28.457847 25824 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:07:28.547423 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.520960 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.450688 25718 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.553300 25675 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.554847 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:28.555178 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.502295 25758 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:28.560973 22428 raft_consensus.cc:2393] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:28.558349 22472 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:28.564116 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.519309 25532 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.565798 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:28.582389 22424 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.522365 25560 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:28.517467 25796 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10.
I20260709 13:07:28.574548 25551 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:28.575874 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.579816 25845 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:07:28.512205 25642 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:28.583532 22472 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:28.554239 25444 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.560093 25535 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:28.593293 22472 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:28.517629 25685 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.590060 25758 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:28.555595 25737 consensus_queue.cc:1059] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:07:28.583834 25625 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.495528 25842 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:07:28.517427 25841 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.563098 25810 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:28.585418 25673 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:28.597255 25026 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.600888 25642 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:28.597712 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:28.619421 22546 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49184 dropped due to backpressure: service queue is full with 50 items
I20260709 13:07:28.618500 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.599479 25535 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:28.619369 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:28.641088 22576 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:28.616899 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.556353 25765 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.620694 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1494) took 1603 ms. Trace:
I20260709 13:07:28.599699 25753 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.615442 25718 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:28.599908 25672 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.037s	sys 0.049s
I20260709 13:07:28.644497 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:28.645164 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.628293 22431 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.646211 25765 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:28.646867 25672 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.037s	sys 0.049s
I20260709 13:07:28.647428 25766 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.634064 25810 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.649358 25753 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.650292 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.650437 25642 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.651541 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.652165 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:28.642593 25535 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.635265 25758 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.641698 22504 rpcz_store.cc:276] 0709 13:07:27.017722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.259163 (+241441us) service_pool.cc:224] Handling call
0709 13:07:27.259440 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.565673 (+306233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:27.589083 (+ 23410us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.219179 (+630096us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.219721 (+   542us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.221527 (+  1806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.221588 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:28.221640 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.471861 (+250221us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b1800406ea0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d35522 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:07:28.619581 (+147720us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b1800406ea0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d032a6 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419
0709 13:07:28.620448 (+   867us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400181fd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:28.620506 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.620634 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":243814,"prepare.queue_time_us":168226,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":3967,"raft.queue_time_us":237543,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":36972,"spinlock_wait_cycles":845528448,"thread_start_us":395791,"threads_started":2,"wal-append.queue_time_us":504578}
I20260709 13:07:28.629633 25625 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:28.639040 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.641948 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.656327 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.658501 22576 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:28.675993 22500 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:28.638502 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45296us
I20260709 13:07:28.679620 22428 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:28.664573 22431 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:28.640825 25026 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.637239 25673 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:28.640954 25402 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:28.684677 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 91672.5us
W20260709 13:07:28.691787 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.675071 25625 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.687554 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.698025 22504 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:28.684856 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.690147 25026 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:28.703872 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.706238 25831 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:07:28.692157 25673 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.753019 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.753175 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2328) took 1631 ms. Trace:
I20260709 13:07:28.754061 22432 rpcz_store.cc:276] 0709 13:07:27.121505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.121638 (+   133us) service_pool.cc:224] Handling call
0709 13:07:27.121975 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.310246 (+1188271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.752871 (+442625us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540043d854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:28.753104 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2722680576}
W20260709 13:07:28.765295 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.639860 22546 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49184 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2350)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2354)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2343)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2346)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2352)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2358)
I20260709 13:07:28.772014 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.773358 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.774457 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.775555 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.777347 25625 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.779974 23113 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:28.780758 25625 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.781342 25697 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:28.781800 25697 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:28.782629 25697 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.783651 25697 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.785181 23109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 422) took 1391 ms. Trace:
I20260709 13:07:28.784988 25811 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.785619 23109 rpcz_store.cc:276] 0709 13:07:27.393449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.394032 (+   583us) service_pool.cc:224] Handling call
0709 13:07:27.471810 (+ 77778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.631455 (+159645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.631482 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:27.631521 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:27.631551 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.784931 (+1153380us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400205654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:28.784974 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.785119 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366717312}
I20260709 13:07:28.787397 25811 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.787129 25026 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.788584 22427 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:28.790103 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 433) took 1421 ms. Trace:
I20260709 13:07:28.790529 22502 rpcz_store.cc:276] 0709 13:07:27.369158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.390822 (+ 21664us) service_pool.cc:224] Handling call
0709 13:07:28.789883 (+1399061us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b5400175cd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:28.790010 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853367552}
W20260709 13:07:28.791162 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.791064 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.771445 22546 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49184 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2350)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2354)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2343)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2346)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2352)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1672)
W20260709 13:07:28.787660 25805 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.854s	user 0.000s	sys 0.002s
I20260709 13:07:28.796360 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.794346 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:28.797606 22500 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.795382 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.798693 22502 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:28.799082 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:28.790390 25799 consensus_meta.cc:287] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 13:07:28.799373 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:28.800645 25799 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.765880 25764 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.802874 25799 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:28.802874 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2322) took 1703 ms. Trace:
I20260709 13:07:28.804193 23107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59024 (request call id 419) took 1432 ms. Trace:
I20260709 13:07:28.804993 22433 rpcz_store.cc:276] 0709 13:07:27.099561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.100335 (+   774us) service_pool.cc:224] Handling call
0709 13:07:27.101120 (+   785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.766776 (+665656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.802640 (+1035864us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b540038a4d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:28.802810 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529467264}
I20260709 13:07:28.806466 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.807046 22433 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:28.807857 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.805171 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.809015 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.809455 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.810518 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.811015 22502 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.809573 22433 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.792856 25775 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.816813 25775 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.818521 25795 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:28.823575 22433 raft_consensus.cc:2410] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:28.805310 23107 rpcz_store.cc:276] 0709 13:07:27.371923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.372108 (+   185us) service_pool.cc:224] Handling call
0709 13:07:28.803990 (+1431882us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400605ed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:28.804130 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796587264}
I20260709 13:07:28.825639 25841 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.793978 25026 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.807641 22546 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49188 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2350)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2354)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2382)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2343)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2346)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2352)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1672)
I20260709 13:07:28.828560 22546 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49184 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2350)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2354)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2382)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2343)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2346)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2352)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1672)
I20260709 13:07:28.832119 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:28.834456 22502 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:28.835829 22433 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.836323 22396 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:28.805240 22425 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:28.847167 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.847811 22502 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.850274 22433 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:28.851334 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.852509 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.853493 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.854034 22433 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:28.854575 22331 catalog_manager.cc:5697] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 2 to 5, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 5 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.858536 22331 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 2 to 4, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 4 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.846189 25841 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:28.857657 25535 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.860409 25764 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:28.883284 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.884639 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.878180 22502 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:28.913758 22500 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:28.915145 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:28.915587 23108 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:28.864929 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:28.863327 25673 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:28.922093 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.877419 25791 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.877099 25841 raft_consensus.cc:697] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:28.879601 25535 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.933017 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:28.934139 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 392) took 1781 ms. Trace:
I20260709 13:07:28.934289 22575 raft_consensus.cc:2410] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:28.921406 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.913230 25771 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.925691 25697 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.926131 25849 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.515s	user 0.004s	sys 0.000s
I20260709 13:07:28.928047 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:28.861595 22331 catalog_manager.cc:5697] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 1 to 6, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 6 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:28.936151 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:28.934567 22424 rpcz_store.cc:276] 0709 13:07:27.152757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.899390 (+746633us) service_pool.cc:224] Handling call
0709 13:07:27.899631 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.582976 (+683345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.933878 (+350902us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54000d6954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:28.934076 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569660288}
W20260709 13:07:28.935801 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 252118us
I20260709 13:07:28.936990 22580 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.938731 22433 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:28.931668 22546 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49184 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2354)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2382)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2343)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2346)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2352)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1672)
I20260709 13:07:28.946730 22546 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49184 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2354)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2382)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2343)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2346)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2352)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1672)
I20260709 13:07:29.044796 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:29.004382 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:29.057315 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:28.955463 23106 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.894973 22575 raft_consensus.cc:2376] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8. Re-sending same reply.
I20260709 13:07:29.895551 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2370) took 1279 ms. Trace:
I20260709 13:07:29.003096 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1547) took 1244 ms. Trace:
I20260709 13:07:29.053325 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:29.897504 22574 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:29.898092 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.898937 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.899595 25723 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:29.900154 25723 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:29.900882 25780 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.856453 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:29.901934 22576 raft_consensus.cc:2393] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:29.901592 25780 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:29.902413 22576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1671) took 1298 ms (client timeout 1652 ms). Trace:
W20260709 13:07:29.902779 22576 rpcz_store.cc:269] 0709 13:07:28.603607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.856109 (+1252502us) service_pool.cc:224] Handling call
0709 13:07:29.902351 (+ 46242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.903537 25723 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:29.903885 25780 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:29.411880 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:29.165966 25820 log.cc:927] Time spent T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.122s	user 0.001s	sys 0.001s
I20260709 13:07:29.905838 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1574) took 1231 ms. Trace:
I20260709 13:07:29.906309 22500 rpcz_store.cc:276] 0709 13:07:28.674073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.411547 (+737474us) service_pool.cc:224] Handling call
0709 13:07:29.905776 (+494229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.394492 25633 raft_consensus.cc:3055] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.907513 25633 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:28.928886 25795 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:28.977203 25387 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:29.075237 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:28.955300 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:29.910597 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1503) took 1405 ms. Trace:
I20260709 13:07:29.910969 22425 rpcz_store.cc:276] 0709 13:07:28.505523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.937091 (+431568us) service_pool.cc:224] Handling call
0709 13:07:29.910528 (+973437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.948601 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:29.912997 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 964425us
I20260709 13:07:29.913818 23076 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:29.034116 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:29.915338 22499 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:29.447906 22426 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 2333) took 2315 ms (client timeout 2058 ms). Trace:
W20260709 13:07:29.916832 22426 rpcz_store.cc:269] 0709 13:07:27.132535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.634251 (+501716us) service_pool.cc:224] Handling call
0709 13:07:29.447646 (+1813395us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54001e7dd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:29.447812 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622234368}
I20260709 13:07:29.134315 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1545) took 1376 ms. Trace:
I20260709 13:07:28.996107 22331 catalog_manager.cc:5697] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 4 to 5, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 5 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.917976 22507 rpcz_store.cc:276] 0709 13:07:27.758421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.760572 (+  2151us) service_pool.cc:224] Handling call
0709 13:07:27.778729 (+ 18157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.422314 (+643585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.133993 (+711679us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54003e9c54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:29.134226 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466197760}
I20260709 13:07:29.919086 22331 catalog_manager.cc:5697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:29.919426 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:29.313848 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:29.165174 25843 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.524s	user 0.002s	sys 0.000s
I20260709 13:07:29.921744 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1664) took 1667 ms. Trace:
W20260709 13:07:29.012619 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.921885 22507 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:29.896613 22505 rpcz_store.cc:276] 0709 13:07:27.759016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.895427 (+136411us) service_pool.cc:224] Handling call
0709 13:07:27.925818 (+ 30391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.140895 (+215077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.002810 (+861915us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540019afd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:29.003027 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277374208}
I20260709 13:07:29.907611 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:29.932200 22424 raft_consensus.cc:1217] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Deduplicated request from leader. Original: 5.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 13:07:29.944669 22506 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:29.945683 22500 raft_consensus.cc:2393] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:29.894551 22579 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
W20260709 13:07:29.947000 22579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2362) took 1350 ms (client timeout 1631 ms). Trace:
I20260709 13:07:29.947364 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1498) took 1488 ms. Trace:
I20260709 13:07:29.946338 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1577) took 1024 ms. Trace:
W20260709 13:07:28.955624 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.947885 22507 pending_rounds.cc:85] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 5
I20260709 13:07:29.951099 22507 pending_rounds.cc:107] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:29.951459 22507 raft_consensus.cc:2889] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:29.952366 22428 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1508) took 1382 ms (client timeout 1585 ms). Trace:
W20260709 13:07:29.953603 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.331326 22501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 432) took 3683 ms (client timeout 2224 ms). Trace:
I20260709 13:07:29.955132 22433 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:29.945940 22505 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.931703 25558 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:29.944025 22582 rpcz_store.cc:276] 0709 13:07:28.253848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.254412 (+   564us) service_pool.cc:224] Handling call
0709 13:07:28.254728 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.274151 (+ 19423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.274180 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.295552 (+ 21372us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.482531 (+186979us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:28.482571 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.482638 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.055024 (+572386us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b48002601d8. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0071d4baa1 00007f0071d42b37 00007f0071d429ca 00007f0071e3a26f 00007f0071e39f37 00007f0071e4e55c 00007f0071e4e508 00007f0071e4e488 00007f0071e4e443 00007f0071e4d6ec 00007f0070d77a96
0709 13:07:29.164465 (+109441us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:29.921516 (+757051us) raft_consensus.cc:1685] finished
0709 13:07:29.921539 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.921679 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19047,"raft.queue_time_us":19375,"raft.run_cpu_time_us":4104,"raft.run_wall_time_us":766964,"spinlock_wait_cycles":50969856,"thread_start_us":169011,"threads_started":1,"wal-append.queue_time_us":255902}
I20260709 13:07:29.951784 22506 rpcz_store.cc:276] 0709 13:07:28.921987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.074948 (+152961us) service_pool.cc:224] Handling call
0709 13:07:29.946269 (+871321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.959071 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 437) took 1634 ms. Trace:
I20260709 13:07:29.959654 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:29.960526 22582 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:29.952494 22425 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.952690 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1568) took 1678 ms. Trace:
I20260709 13:07:29.321165 25770 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:29.947372 22579 rpcz_store.cc:269] 0709 13:07:28.596425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.004073 (+407648us) service_pool.cc:224] Handling call
0709 13:07:29.946946 (+942873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.944528 25633 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:29.947582 22546 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:55062 dropped due to backpressure: service queue is full with 50 items [suppressed 5 similar messages]
I20260709 13:07:29.520869 25652 raft_consensus.cc:3055] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.953032 22500 rpcz_store.cc:276] 0709 13:07:28.458080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.907264 (+1449184us) service_pool.cc:224] Handling call
0709 13:07:29.946780 (+ 39516us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.937711 22431 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.955983 22574 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
W20260709 13:07:29.970419 22574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1668) took 1413 ms (client timeout 1804 ms). Trace:
W20260709 13:07:29.970901 22574 rpcz_store.cc:269] 0709 13:07:28.557487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.052981 (+495494us) service_pool.cc:224] Handling call
0709 13:07:29.970357 (+917376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.318089 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:29.953454 22428 rpcz_store.cc:269] 0709 13:07:28.569606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.644889 (+ 75283us) service_pool.cc:224] Handling call
0709 13:07:29.952128 (+1307239us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b540038c2d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:29.952305 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77353856}
I20260709 13:07:29.315551 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 411) took 1051 ms. Trace:
I20260709 13:07:29.973246 22427 rpcz_store.cc:276] 0709 13:07:28.264576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.493261 (+228685us) service_pool.cc:224] Handling call
0709 13:07:28.493499 (+   238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.788997 (+295498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.315205 (+526208us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540043c954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:29.315476 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678020992}
I20260709 13:07:29.311311 22578 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:29.974979 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1659) took 1724 ms. Trace:
I20260709 13:07:29.903999 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:29.957340 25775 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:29.312445 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1653) took 1271 ms. Trace:
I20260709 13:07:29.324882 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:29.334975 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.950320 25465 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.959524 22505 rpcz_store.cc:276] 0709 13:07:28.324165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.945401 (+1621236us) service_pool.cc:224] Handling call
0709 13:07:29.945758 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.958624 (+ 12866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.958857 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.978154 22545 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:29.983525 22577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1669) took 1425 ms (client timeout 1658 ms). Trace:
W20260709 13:07:29.984583 22577 rpcz_store.cc:269] 0709 13:07:28.558408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.317755 (+759347us) service_pool.cc:224] Handling call
0709 13:07:29.983458 (+665703us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:29.985088 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.985493 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.985639 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:29.986583 22502 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:29.989645 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.961076 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2366) took 1346 ms. Trace:
I20260709 13:07:29.319660 22432 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:29.962574 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:29.992671 22582 rpcz_store.cc:276] 0709 13:07:28.614983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.959394 (+1344411us) service_pool.cc:224] Handling call
0709 13:07:29.961016 (+  1622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.993397 22579 raft_consensus.cc:2410] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:29.993693 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:29.950500 25808 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.895943 22575 rpcz_store.cc:276] 0709 13:07:28.616159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.056964 (+440805us) service_pool.cc:224] Handling call
0709 13:07:29.895489 (+838525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.003243 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:29.945952 22424 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:29.961547 22507 rpcz_store.cc:276] 0709 13:07:28.274414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.921134 (+1646720us) service_pool.cc:224] Handling call
0709 13:07:29.921509 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.952424 (+ 30915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.952636 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11392}
I20260709 13:07:29.964424 23106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 611) took 1016 ms. Trace:
I20260709 13:07:30.004536 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2356) took 1491 ms. Trace:
I20260709 13:07:29.965178 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1509) took 1395 ms. Trace:
W20260709 13:07:29.954974 22501 rpcz_store.cc:269] 0709 13:07:25.647590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.325320 (+677730us) service_pool.cc:224] Handling call
0709 13:07:29.331022 (+3005702us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540021a2d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:29.331207 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3396677504}
I20260709 13:07:30.004719 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2350) took 1503 ms. Trace:
I20260709 13:07:30.005122 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2361) took 1409 ms. Trace:
I20260709 13:07:30.005486 22433 rpcz_store.cc:276] 0709 13:07:28.569892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.954537 (+1384645us) service_pool.cc:224] Handling call
0709 13:07:29.954910 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.964900 (+  9990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.965122 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.005868 22577 rpcz_store.cc:276] 0709 13:07:28.596147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.985350 (+1389203us) service_pool.cc:224] Handling call
0709 13:07:30.005062 (+ 19712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.007239 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:29.975703 22331 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 4 to 5, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 5 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:29.976644 22578 rpcz_store.cc:276] 0709 13:07:28.250168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.254399 (+  4231us) service_pool.cc:224] Handling call
0709 13:07:29.310564 (+1056165us) spinlock_profiling.cc:243] Waited 989 us on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:07:29.310851 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.974680 (+663829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.974918 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275712}
I20260709 13:07:29.962395 22546 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:55062 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2354)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2382)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55062 (request call id 387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55062 (request call id 385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1674)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2343)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2346)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2352)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 384)
I20260709 13:07:29.921393 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:30.043120 22504 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.043198 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:29.977937 22580 consensus_meta.cc:287] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 1.039s	user 0.009s	sys 0.001s
I20260709 13:07:29.972193 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2363) took 1453 ms. Trace:
I20260709 13:07:30.044548 22431 rpcz_store.cc:276] 0709 13:07:28.521499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.936938 (+1415439us) service_pool.cc:224] Handling call
0709 13:07:29.937507 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.971875 (+ 34368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.972117 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.981060 22499 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:30.045761 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1582) took 1120 ms. Trace:
I20260709 13:07:29.993852 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2371) took 1377 ms. Trace:
I20260709 13:07:29.331964 22508 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:29.983392 22581 rpcz_store.cc:276] 0709 13:07:28.041109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.041292 (+   183us) service_pool.cc:224] Handling call
0709 13:07:29.312228 (+1270936us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b54001ccad4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:29.312368 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65895680}
I20260709 13:07:30.046059 22501 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:07:30.046855 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.047667 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2375) took 1429 ms. Trace:
I20260709 13:07:30.047988 22581 rpcz_store.cc:276] 0709 13:07:28.617803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.046560 (+1428757us) service_pool.cc:224] Handling call
0709 13:07:30.047601 (+  1041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.995220 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2372) took 1378 ms. Trace:
I20260709 13:07:30.048768 22582 rpcz_store.cc:276] 0709 13:07:28.616908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.993406 (+1376498us) service_pool.cc:224] Handling call
0709 13:07:29.995129 (+  1723us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.996980 22502 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:30.049731 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1578) took 1127 ms. Trace:
I20260709 13:07:30.050076 22502 rpcz_store.cc:276] 0709 13:07:28.922222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.324564 (+402342us) service_pool.cc:224] Handling call
0709 13:07:30.049664 (+725100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.051592 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 448) took 1658 ms. Trace:
I20260709 13:07:30.001612 25465 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.005028 22424 rpcz_store.cc:276] 0709 13:07:28.512948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.931710 (+1418762us) service_pool.cc:224] Handling call
0709 13:07:29.932084 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.004223 (+ 72139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.004430 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.041986 22331 catalog_manager.cc:5697] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 3 to 4, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 4 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.064509 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2367) took 1386 ms. Trace:
I20260709 13:07:30.064909 22424 rpcz_store.cc:276] 0709 13:07:28.677850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.063637 (+1385787us) service_pool.cc:224] Handling call
0709 13:07:30.063962 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.064149 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.064172 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.064211 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:30.064243 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.064309 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.064424 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.066430 22424 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:30.007279 22433 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.066754 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:30.066995 22577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2373) took 1449 ms (client timeout 1908 ms). Trace:
I20260709 13:07:29.976279 22576 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:30.067579 22577 rpcz_store.cc:269] 0709 13:07:28.617186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.007008 (+1389822us) service_pool.cc:224] Handling call
0709 13:07:30.066914 (+ 59906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.016165 25795 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:30.006363 22472 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:30.004585 23106 rpcz_store.cc:276] 0709 13:07:28.948078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.948222 (+   144us) service_pool.cc:224] Handling call
0709 13:07:28.955272 (+  7050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.964046 (+1008774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.964349 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.067453 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1512) took 1479 ms. Trace:
W20260709 13:07:30.069053 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 62773us
I20260709 13:07:30.067032 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2368) took 1389 ms. Trace:
I20260709 13:07:28.956791 25649 raft_consensus.cc:3055] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:29.895687 25624 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.940862 25825 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:29.011772 25821 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.521458 25510 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:30.020346 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:30.081017 22574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2383) took 1274 ms (client timeout 1667 ms). Trace:
W20260709 13:07:30.081440 22574 rpcz_store.cc:269] 0709 13:07:28.806476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.020007 (+1213531us) service_pool.cc:224] Handling call
0709 13:07:30.080929 (+ 60922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.082433 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.083247 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2359) took 1487 ms. Trace:
I20260709 13:07:30.083561 22574 rpcz_store.cc:276] 0709 13:07:28.595563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.082118 (+1486555us) service_pool.cc:224] Handling call
0709 13:07:30.083189 (+  1071us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.021911 22500 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.085114 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 445) took 1755 ms. Trace:
I20260709 13:07:30.085469 22500 rpcz_store.cc:276] 0709 13:07:28.329997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.989731 (+1659734us) service_pool.cc:224] Handling call
0709 13:07:30.021701 (+ 31970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.084845 (+ 63144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.085057 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.086658 22500 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.087215 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1499) took 1628 ms. Trace:
I20260709 13:07:30.087513 22500 rpcz_store.cc:276] 0709 13:07:28.458255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.086162 (+1627907us) service_pool.cc:224] Handling call
0709 13:07:30.086496 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.086970 (+   474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.087159 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:30.088600 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.982972 25812 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.972347 25652 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:30.009868 25387 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:30.017439 22432 rpcz_store.cc:276] 0709 13:07:28.501630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.319022 (+817392us) service_pool.cc:224] Handling call
0709 13:07:29.319413 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.004188 (+684775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.004661 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.009828 25808 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:30.009219 25779 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.008772 25633 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.044063 22578 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:30.118778 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2384) took 1312 ms. Trace:
I20260709 13:07:30.119169 22578 rpcz_store.cc:276] 0709 13:07:28.806752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.042865 (+1236113us) service_pool.cc:224] Handling call
0709 13:07:30.118709 (+ 75844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.052841 22505 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:30.119546 22576 raft_consensus.cc:2410] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:30.053184 22579 rpcz_store.cc:276] 0709 13:07:28.616410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.962277 (+1345867us) service_pool.cc:224] Handling call
0709 13:07:29.993795 (+ 31518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.044340 22580 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:07:30.120045 22576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2357) took 1525 ms (client timeout 1789 ms). Trace:
W20260709 13:07:30.120323 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2377) took 1501 ms (client timeout 1648 ms). Trace:
I20260709 13:07:30.054193 22508 pending_rounds.cc:85] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 9
W20260709 13:07:30.120569 22576 rpcz_store.cc:269] 0709 13:07:28.594990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.903744 (+1308754us) service_pool.cc:224] Handling call
0709 13:07:30.119981 (+216237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.012702 25775 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:30.046119 22499 rpcz_store.cc:276] 0709 13:07:28.925204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.033799 (+108595us) service_pool.cc:224] Handling call
0709 13:07:30.045703 (+1011904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.122411 22499 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.123049 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1507) took 1627 ms. Trace:
I20260709 13:07:30.123379 22499 rpcz_store.cc:276] 0709 13:07:28.495977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.121872 (+1625895us) service_pool.cc:224] Handling call
0709 13:07:30.122209 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.122805 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.122988 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:30.120795 22580 rpcz_store.cc:269] 0709 13:07:28.618518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.927753 (+309235us) service_pool.cc:224] Handling call
0709 13:07:30.120265 (+1192512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.126322 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.127117 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2388) took 1196 ms. Trace:
I20260709 13:07:30.127425 22580 rpcz_store.cc:276] 0709 13:07:28.931000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.126022 (+1195022us) service_pool.cc:224] Handling call
0709 13:07:30.127060 (+  1038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.129096 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.129786 22578 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.051949 22502 rpcz_store.cc:276] 0709 13:07:28.392925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.050746 (+1657821us) service_pool.cc:224] Handling call
0709 13:07:30.051075 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.051256 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.051282 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.051328 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:30.051362 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.051418 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.051532 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.132169 22502 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.132865 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1569) took 1541 ms. Trace:
I20260709 13:07:30.133172 22502 rpcz_store.cc:276] 0709 13:07:28.591658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.131629 (+1539971us) service_pool.cc:224] Handling call
0709 13:07:30.131982 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.132607 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.132805 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.010145 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2374) took 1392 ms. Trace:
I20260709 13:07:30.134356 22575 rpcz_store.cc:276] 0709 13:07:28.617486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.002922 (+1385436us) service_pool.cc:224] Handling call
0709 13:07:30.010069 (+  7147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.135349 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.010195 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:30.137470 22507 raft_consensus.cc:2410] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:30.068608 22433 rpcz_store.cc:276] 0709 13:07:28.587982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.006809 (+1418827us) service_pool.cc:224] Handling call
0709 13:07:30.007112 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.067203 (+ 60091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.067397 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.070998 22582 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.070163 22424 rpcz_store.cc:276] 0709 13:07:28.678111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.065883 (+1387772us) service_pool.cc:224] Handling call
0709 13:07:30.066233 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.066809 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.066982 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.071671 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:28.946893 25841 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.068809 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.144593 22577 raft_consensus.cc:2410] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:30.145117 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2385) took 1317 ms. Trace:
I20260709 13:07:30.145435 22577 rpcz_store.cc:276] 0709 13:07:28.828177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.068496 (+1240319us) service_pool.cc:224] Handling call
0709 13:07:30.145047 (+ 76551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.146313 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.069914 22472 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:30.078657 25825 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:29.975183 25758 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.091703 22431 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:30.099941 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.150818 22574 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:07:30.151587 22574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2363) took 1554 ms (client timeout 2065 ms). Trace:
I20260709 13:07:28.941264 25697 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:30.157889 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:30.173660 22429 raft_consensus.cc:2393] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:30.108109 25795 raft_consensus.cc:697] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:07:30.174572 22429 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1510) took 1587 ms (client timeout 1967 ms). Trace:
W20260709 13:07:30.175132 22429 rpcz_store.cc:269] 0709 13:07:28.587474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.828654 (+241180us) service_pool.cc:224] Handling call
0709 13:07:30.157641 (+1328987us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:07:30.174460 (+ 16819us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7522176}
I20260709 13:07:30.128317 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.117341 25812 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.141822 25652 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:30.076841 25723 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.193164 22573 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.074239 25649 raft_consensus.cc:740] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:07:30.148999 22581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2354) took 1555 ms (client timeout 2026 ms). Trace:
W20260709 13:07:30.197902 22581 rpcz_store.cc:269] 0709 13:07:28.593989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.071362 (+1477373us) service_pool.cc:224] Handling call
0709 13:07:30.148903 (+ 77541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.199211 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:30.174274 25444 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.031s	sys 0.055s
I20260709 13:07:30.121192 22508 pending_rounds.cc:107] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:30.219930 22508 raft_consensus.cc:2889] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:30.152081 22574 rpcz_store.cc:269] 0709 13:07:28.596755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.084210 (+1487455us) service_pool.cc:224] Handling call
0709 13:07:30.151491 (+ 67281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.152451 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.221392 22579 raft_consensus.cc:2410] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:30.150945 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.222376 22576 raft_consensus.cc:2376] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8. Re-sending same reply.
W20260709 13:07:30.222905 22576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2351) took 1703 ms (client timeout 2178 ms). Trace:
W20260709 13:07:30.223248 22576 rpcz_store.cc:269] 0709 13:07:28.519240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.150611 (+1631371us) service_pool.cc:224] Handling call
0709 13:07:30.222845 (+ 72234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.155292 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2368) took 1539 ms. Trace:
I20260709 13:07:30.142632 25465 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:30.172341 25775 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:30.228329 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2390) took 1282 ms. Trace:
I20260709 13:07:30.228848 22579 rpcz_store.cc:276] 0709 13:07:28.945970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.152099 (+1206129us) service_pool.cc:224] Handling call
0709 13:07:30.228241 (+ 76142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.229825 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.189181 22504 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:30.190776 22582 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
W20260709 13:07:30.232756 22582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1665) took 1734 ms (client timeout 2150 ms). Trace:
W20260709 13:07:30.233139 22582 rpcz_store.cc:269] 0709 13:07:28.498126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.066504 (+1568378us) service_pool.cc:224] Handling call
0709 13:07:30.232688 (+166184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.233911 22573 raft_consensus.cc:2410] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:30.234042 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.234855 22582 raft_consensus.cc:2410] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:30.192170 23108 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.125229 25779 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:30.147905 22575 raft_consensus.cc:2393] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:30.193619 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:30.150895 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1513) took 1562 ms. Trace:
I20260709 13:07:30.237709 22431 rpcz_store.cc:276] 0709 13:07:28.588220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.045472 (+1457252us) service_pool.cc:224] Handling call
0709 13:07:30.091443 (+ 45971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.150515 (+ 59072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.150821 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:30.224907 25444 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.032s	sys 0.055s
I20260709 13:07:30.247128 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.247819 22574 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:30.248286 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2376) took 1630 ms. Trace:
I20260709 13:07:30.248596 22574 rpcz_store.cc:276] 0709 13:07:28.618092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.220824 (+1602732us) service_pool.cc:224] Handling call
0709 13:07:30.248222 (+ 27398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.224190 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.226054 22577 rpcz_store.cc:276] 0709 13:07:28.615585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.146063 (+1530478us) service_pool.cc:224] Handling call
0709 13:07:30.155123 (+  9060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.230556 22578 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
W20260709 13:07:30.231211 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 317472us
I20260709 13:07:30.231664 23106 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:30.200317 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2365) took 1585 ms. Trace:
I20260709 13:07:30.241349 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:30.241940 22575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2339) took 1825 ms (client timeout 2384 ms). Trace:
I20260709 13:07:30.232079 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2364) took 1618 ms. Trace:
I20260709 13:07:30.239114 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:30.197996 25723 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:07:30.242434 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 287282us
I20260709 13:07:30.175597 25758 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:30.224880 25558 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.293859 22575 rpcz_store.cc:269] 0709 13:07:28.416380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.135052 (+1718672us) service_pool.cc:224] Handling call
0709 13:07:30.241875 (+106823us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:30.291205 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.297950 25723 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:30.298215 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.299566 22474 leader_election.cc:336] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.743s (SENT)
I20260709 13:07:30.299721 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1579) took 1377 ms. Trace:
I20260709 13:07:30.300081 22504 rpcz_store.cc:276] 0709 13:07:28.922462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.298462 (+1376000us) service_pool.cc:224] Handling call
0709 13:07:30.298801 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.299405 (+   604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.299431 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.299472 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:30.299503 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.299562 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.299670 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:30.301453 22474 leader_election.cc:336] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.842s (SENT)
I20260709 13:07:30.301918 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:30.294697 22581 rpcz_store.cc:276] 0709 13:07:28.614612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.198868 (+1584256us) service_pool.cc:224] Handling call
0709 13:07:30.200230 (+  1362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.303543 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.294257 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:30.295192 22578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2380) took 1524 ms (client timeout 2026 ms). Trace:
I20260709 13:07:30.305528 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2381) took 1499 ms. Trace:
I20260709 13:07:30.293403 22576 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:30.217407 25649 consensus_queue.cc:260] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.305986 22577 rpcz_store.cc:276] 0709 13:07:28.805785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.293990 (+1488205us) service_pool.cc:224] Handling call
0709 13:07:30.305458 (+ 11468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.306828 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.234722 25652 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.295898 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2369) took 1680 ms. Trace:
I20260709 13:07:30.325923 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.326140 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:30.326246 22582 rpcz_store.cc:276] 0709 13:07:28.615887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.233779 (+1617892us) service_pool.cc:224] Handling call
0709 13:07:30.295833 (+ 62054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.327148 23111 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
I20260709 13:07:30.327538 22575 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.327807 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.304363 22581 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:30.329519 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 359641us
I20260709 13:07:30.330153 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2382) took 1524 ms. Trace:
I20260709 13:07:30.330673 22581 rpcz_store.cc:276] 0709 13:07:28.806196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.303270 (+1497074us) service_pool.cc:224] Handling call
0709 13:07:30.330084 (+ 26814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.332835 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.241729 25779 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.307935 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2347) took 1885 ms. Trace:
W20260709 13:07:30.305757 22578 rpcz_store.cc:269] 0709 13:07:28.771068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.128849 (+1357781us) service_pool.cc:224] Handling call
0709 13:07:30.295134 (+166285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.309055 22579 rpcz_store.cc:276] 0709 13:07:28.613357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.229543 (+1616186us) service_pool.cc:224] Handling call
0709 13:07:30.232017 (+  2474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.313133 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:30.347385 23113 raft_consensus.cc:2410] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:30.348286 22582 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:30.348866 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.349490 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.350376 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.350706 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.351191 22579 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.239110 25465 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:30.335353 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.359182 22577 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:30.360416 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 58980.2us
I20260709 13:07:30.351363 22582 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:30.337733 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 267883us
W20260709 13:07:30.361258 22474 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.885s (SENT)
I20260709 13:07:30.294791 23108 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:30.340270 22504 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:30.362464 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1581) took 1437 ms. Trace:
I20260709 13:07:30.343622 25649 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.346225 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.373656 22581 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:30.374243 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:30.324705 22574 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:30.357069 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.375267 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2387) took 1444 ms. Trace:
I20260709 13:07:30.375578 22578 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:30.375660 22574 rpcz_store.cc:276] 0709 13:07:28.930613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.249268 (+1318655us) service_pool.cc:224] Handling call
0709 13:07:30.375199 (+125931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.315243 25812 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:30.362875 22504 rpcz_store.cc:276] 0709 13:07:28.924948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.301553 (+1376605us) service_pool.cc:224] Handling call
0709 13:07:30.301962 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.362208 (+ 60246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.362410 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.346277 22576 rpcz_store.cc:276] 0709 13:07:28.422719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.223908 (+1801189us) service_pool.cc:224] Handling call
0709 13:07:30.307865 (+ 83957us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:30.363152 22474 leader_election.cc:336] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.908s (SENT)
I20260709 13:07:30.355492 25803 raft_consensus.cc:3055] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:30.386795 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.395110 22578 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.385977 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.396219 22581 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:30.397276 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.351823 25387 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:30.383334 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.398020 22581 raft_consensus.cc:2376] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 5. Re-sending same reply.
I20260709 13:07:30.392578 22576 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:30.401504 22574 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:07:30.402798 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2335) took 1989 ms. Trace:
I20260709 13:07:30.403213 22574 rpcz_store.cc:276] 0709 13:07:28.413734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.376668 (+1962934us) service_pool.cc:224] Handling call
0709 13:07:30.401120 (+ 24452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:30.402280 (+  1160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.402723 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.306308 25558 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.406286 22581 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:30.405699 22577 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:30.407502 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2337) took 1991 ms. Trace:
I20260709 13:07:30.408044 22577 rpcz_store.cc:276] 0709 13:07:28.415826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.403787 (+1987961us) service_pool.cc:224] Handling call
0709 13:07:30.404451 (+   664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.407261 (+  2810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.407447 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.399758 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2336) took 1985 ms. Trace:
I20260709 13:07:30.303684 25795 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.418921 22578 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:30.423512 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.424844 22578 raft_consensus.cc:2393] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:30.409770 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.390354 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:30.411530 22576 rpcz_store.cc:276] 0709 13:07:28.414039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.377927 (+1963888us) service_pool.cc:224] Handling call
0709 13:07:30.392034 (+ 14107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.399488 (+  7454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.399703 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.408442 22582 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:30.413735 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2338) took 1991 ms. Trace:
I20260709 13:07:30.427273 22581 rpcz_store.cc:276] 0709 13:07:28.416123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.405506 (+1989383us) service_pool.cc:224] Handling call
0709 13:07:30.405986 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.407012 (+  1026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.407218 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.429525 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2342) took 2012 ms. Trace:
I20260709 13:07:30.430030 22582 rpcz_store.cc:276] 0709 13:07:28.417205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.428651 (+2011446us) service_pool.cc:224] Handling call
0709 13:07:30.429000 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.429192 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.429217 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.429259 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:30.429290 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.429341 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.429465 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.400297 25873 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.394629 25803 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:30.400246 25387 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:30.432986 22582 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:30.433171 22504 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:30.433655 22578 raft_consensus.cc:1240] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:30.437310 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2345) took 2015 ms. Trace:
I20260709 13:07:30.438001 22578 rpcz_store.cc:276] 0709 13:07:28.422141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.433115 (+2010974us) service_pool.cc:224] Handling call
0709 13:07:30.433455 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.436781 (+  3326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.437184 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.439196 22504 pending_rounds.cc:85] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 4
I20260709 13:07:30.372798 25465 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.440610 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2343) took 2022 ms. Trace:
I20260709 13:07:30.452888 22582 rpcz_store.cc:276] 0709 13:07:28.417453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.431863 (+2014410us) service_pool.cc:224] Handling call
0709 13:07:30.432568 (+   705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.439075 (+  6507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.440271 (+  1196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.441243 22504 pending_rounds.cc:107] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:30.454619 22504 raft_consensus.cc:2889] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.455360 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1583) took 1529 ms. Trace:
I20260709 13:07:30.455667 22504 rpcz_store.cc:276] 0709 13:07:28.925480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.408936 (+1483456us) service_pool.cc:224] Handling call
0709 13:07:30.432523 (+ 23587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.455086 (+ 22563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.455299 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:30.434680 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 71533.8us
I20260709 13:07:30.458204 22574 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:30.458920 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2340) took 2042 ms. Trace:
I20260709 13:07:30.454273 22582 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:30.459038 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 127686us
I20260709 13:07:30.459240 22574 rpcz_store.cc:276] 0709 13:07:28.416685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.425771 (+2009086us) service_pool.cc:224] Handling call
0709 13:07:30.457966 (+ 32195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.458640 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.458864 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:30.460824 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 86746.1us
I20260709 13:07:30.418870 25697 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:30.401504 25812 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:07:30.465128 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2348) took 2013 ms. Trace:
I20260709 13:07:30.465898 22582 rpcz_store.cc:276] 0709 13:07:28.451639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.453740 (+2002101us) service_pool.cc:224] Handling call
0709 13:07:30.454082 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.459940 (+  5858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.465067 (+  5127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.467269 22582 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:30.455768 22575 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:30.467909 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2349) took 1981 ms. Trace:
I20260709 13:07:30.468225 22582 rpcz_store.cc:276] 0709 13:07:28.486931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.466749 (+1979818us) service_pool.cc:224] Handling call
0709 13:07:30.467092 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.467642 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.467859 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.470118 22582 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:30.470276 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:30.471313 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1667) took 1970 ms. Trace:
I20260709 13:07:30.471800 22582 rpcz_store.cc:276] 0709 13:07:28.500752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.469279 (+1968527us) service_pool.cc:224] Handling call
0709 13:07:30.469796 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.470953 (+  1157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.471248 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.420753 25876 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:30.421237 25808 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:30.474071 23113 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.472961 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.474274 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:30.479451 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 440) took 2154 ms. Trace:
I20260709 13:07:30.471975 25444 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.480643 25444 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:30.485019 25879 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.485311 25653 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.485494 25728 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:30.403363 25775 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.478741 23106 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:30.489593 25697 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.490226 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1576) took 1568 ms. Trace:
I20260709 13:07:30.491358 23104 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:30.495947 22582 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:30.496944 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:30.514940 22504 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:30.497044 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.516722 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.516453 25723 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:30.517277 22574 raft_consensus.cc:2376] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9. Re-sending same reply.
I20260709 13:07:30.518173 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.518847 22574 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:30.519002 25723 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:30.519651 25723 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.519953 22574 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:30.495018 23113 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:30.480043 22506 rpcz_store.cc:276] 0709 13:07:28.324987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.959279 (+1634292us) service_pool.cc:224] Handling call
0709 13:07:29.959603 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.959864 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:30.325055 (+365191us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.478163 (+153108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.478411 (+   248us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:30.478756 (+   345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.478866 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.479338 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":514564,"threads_started":3}
I20260709 13:07:30.474912 25878 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.439059 25874 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:07:30.533028 22506 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:30.534242 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1510) took 1595 ms. Trace:
I20260709 13:07:30.534600 22506 rpcz_store.cc:276] 0709 13:07:28.939057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.532313 (+1593256us) service_pool.cc:224] Handling call
0709 13:07:30.532670 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.533981 (+  1311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.534183 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.535832 25869 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.536533 22506 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.537233 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1511) took 1588 ms. Trace:
I20260709 13:07:30.537537 22506 rpcz_store.cc:276] 0709 13:07:28.949050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.535989 (+1586939us) service_pool.cc:224] Handling call
0709 13:07:30.536322 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.536991 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.537179 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.538956 22506 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:30.522655 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1575) took 1826 ms. Trace:
I20260709 13:07:30.533408 25465 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:30.532053 23113 pending_rounds.cc:85] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 5
I20260709 13:07:30.544410 23113 pending_rounds.cc:107] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:30.520313 25723 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.545966 23113 raft_consensus.cc:2889] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.532626 22579 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:30.541844 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2355) took 1947 ms. Trace:
I20260709 13:07:30.549522 22578 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:30.551044 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.523492 25758 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:30.525259 25880 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.438654 25873 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:30.547071 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2352) took 1987 ms. Trace:
I20260709 13:07:30.475446 25877 consensus_queue.cc:1059] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:07:30.508162 25780 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:07:30.534754 25874 consensus_queue.cc:1059] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:07:30.528713 25653 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.490393 25803 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.514020 25879 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:30.494854 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.555009 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.845330 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2346) took 2422 ms. Trace:
I20260709 13:07:30.549535 22574 rpcz_store.cc:276] 0709 13:07:28.594380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.519342 (+1924962us) service_pool.cc:224] Handling call
0709 13:07:30.519635 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.520292 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.541725 (+ 21433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.845867 22579 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:30.555253 22582 rpcz_store.cc:276] 0709 13:07:28.559253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.480382 (+1921129us) service_pool.cc:224] Handling call
0709 13:07:30.495540 (+ 15158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.546491 (+ 50951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.546948 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.847608 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.848780 22579 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:30.849272 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.753300 25911 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:30.851840 22575 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.851058 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.853134 22581 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:30.852738 25911 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:30.850009 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.815191 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 444) took 2487 ms. Trace:
I20260709 13:07:30.854120 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1666) took 2354 ms. Trace:
W20260709 13:07:30.851608 22573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2367) took 2236 ms (client timeout 1745 ms). Trace:
I20260709 13:07:30.853884 22574 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:30.813870 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:30.855657 22575 rpcz_store.cc:276] 0709 13:07:28.499510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.468443 (+1968933us) service_pool.cc:224] Handling call
0709 13:07:30.851353 (+382910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.852792 (+  1439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.853879 (+  1087us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400118d50. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:30.854045 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879543168}
I20260709 13:07:30.845960 22578 rpcz_store.cc:276] 0709 13:07:28.422435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.439340 (+2016905us) service_pool.cc:224] Handling call
0709 13:07:30.549322 (+109982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.549994 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.844699 (+294705us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400375850. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:30.845037 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248803712}
I20260709 13:07:30.855041 22505 rpcz_store.cc:276] 0709 13:07:28.327462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.984149 (+1656687us) service_pool.cc:224] Handling call
0709 13:07:30.052634 (+ 68485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.119840 (+ 67206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.814689 (+694849us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b540021b1d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:30.814986 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83023232}
I20260709 13:07:30.858045 22575 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.847666 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:30.858827 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2358) took 2263 ms. Trace:
I20260709 13:07:30.859220 22575 rpcz_store.cc:276] 0709 13:07:28.595279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.857071 (+2261792us) service_pool.cc:224] Handling call
0709 13:07:30.857674 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.858543 (+   869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.858735 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30464}
I20260709 13:07:30.855923 25911 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:30.860337 22504 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:07:30.861420 22575 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:30.862159 22576 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:30.736260 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 285754us
I20260709 13:07:30.847945 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:30.769044 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.820160 22507 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:30.849783 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:30.826843 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1491) took 3884 ms. Trace:
W20260709 13:07:30.753841 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 293053us
W20260709 13:07:30.774662 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 477760us
I20260709 13:07:30.507120 25387 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:30.855413 22579 raft_consensus.cc:2393] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:30.863271 22575 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:30.854020 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2356) took 2259 ms. Trace:
I20260709 13:07:30.858008 22578 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:30.859611 22505 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:30.750546 22431 raft_consensus.cc:1240] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260709 13:07:31.000458 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.787305 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1585) took 1828 ms. Trace:
W20260709 13:07:30.735419 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.005138 22576 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:30.751434 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2353) took 2247 ms. Trace:
W20260709 13:07:30.963253 22548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.021s	sys 0.009s
I20260709 13:07:30.804260 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 446) took 2471 ms. Trace:
I20260709 13:07:30.965889 23108 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:30.968575 23078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.012s	sys 0.004s
I20260709 13:07:30.800966 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1511) took 2213 ms. Trace:
W20260709 13:07:30.965437 23077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.004s	sys 0.033s
W20260709 13:07:30.829457 22547 connection.cc:256] RPC call timeout handler was delayed by -1.1097633279999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3159s for a response
I20260709 13:07:31.099224 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1588) took 1194 ms. Trace:
I20260709 13:07:31.095830 22581 rpcz_store.cc:276] 0709 13:07:28.594703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.851977 (+2257274us) service_pool.cc:224] Handling call
0709 13:07:30.852625 (+   648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.853723 (+  1098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.853943 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.105391 22507 rpcz_store.cc:276] 0709 13:07:29.904985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.819197 (+914212us) service_pool.cc:224] Handling call
0709 13:07:30.819699 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.096864 (+277165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.099165 (+  2301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.101037 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 384) took 1154 ms. Trace:
W20260709 13:07:31.109527 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.108875 22578 rpcz_store.cc:276] 0709 13:07:29.946397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.857186 (+910789us) service_pool.cc:224] Handling call
0709 13:07:30.857678 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.099071 (+241393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.100958 (+  1887us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31872}
I20260709 13:07:31.100102 22499 rpcz_store.cc:276] 0709 13:07:28.958570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.785664 (+1827094us) service_pool.cc:224] Handling call
0709 13:07:30.786368 (+   704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.786790 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.786815 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.786872 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:30.786903 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.786981 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.787097 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:31.007160 25910 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
W20260709 13:07:31.105743 22548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.023s	sys 0.011s
I20260709 13:07:31.095393 22508 rpcz_store.cc:276] 0709 13:07:26.942458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.009957 (+ 67499us) service_pool.cc:224] Handling call
0709 13:07:29.331535 (+2321578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.225736 (+894201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.826282 (+600546us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b540021a2d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:30.826585 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5338262272}
I20260709 13:07:30.813380 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1584) took 1862 ms. Trace:
W20260709 13:07:31.111104 23078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.012s	sys 0.014s
I20260709 13:07:30.540177 22502 rpcz_store.cc:276] 0709 13:07:28.696689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.139955 (+1443266us) service_pool.cc:224] Handling call
0709 13:07:30.140329 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.345689 (+205360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.345944 (+   255us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.346982 (+  1038us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.414293 (+ 67311us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:30.414366 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.414505 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.522413 (+107908us) raft_consensus.cc:1685] finished
0709 13:07:30.522438 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.522586 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3438,"raft.queue_time_us":240544,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":18654,"thread_start_us":270926,"threads_started":2,"wal-append.queue_time_us":173570}
I20260709 13:07:30.513397 22500 rpcz_store.cc:276] 0709 13:07:28.921691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.171827 (+1250136us) service_pool.cc:224] Handling call
0709 13:07:30.198600 (+ 26773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.364885 (+166285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.364919 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.365446 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.452037 (+ 86591us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:30.452082 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.452165 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.490015 (+ 37850us) raft_consensus.cc:1685] finished
0709 13:07:30.490035 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.490165 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17971,"raft.queue_time_us":222169,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":12697,"thread_start_us":251830,"threads_started":2,"wal-append.queue_time_us":122717}
I20260709 13:07:31.113234 22506 rpcz_store.cc:276] 0709 13:07:28.950624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.538379 (+1587755us) service_pool.cc:224] Handling call
0709 13:07:30.538708 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.542178 (+  3470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.813132 (+270954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.101002 22425 rpcz_store.cc:276] 0709 13:07:28.504245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.911808 (+1407563us) service_pool.cc:224] Handling call
0709 13:07:29.952280 (+ 40472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.976777 (+ 24497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.750852 (+774075us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b540038c2d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:30.751172 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92210944}
W20260709 13:07:31.108300 23077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.011s	sys 0.036s
I20260709 13:07:30.973526 25444 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.012691 25771 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:31.104067 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1589) took 1135 ms. Trace:
W20260709 13:07:31.094367 22573 rpcz_store.cc:269] 0709 13:07:28.615270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.044462 (+429192us) service_pool.cc:224] Handling call
0709 13:07:30.851083 (+1806621us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400118d54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:30.851385 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691928960}
I20260709 13:07:30.561460 25893 consensus_queue.cc:1059] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.564s
W20260709 13:07:30.502450 22474 leader_election.cc:336] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.026s (SENT)
I20260709 13:07:31.002547 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:30.661725 25861 log.cc:927] Time spent T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.573s	user 0.001s	sys 0.001s
W20260709 13:07:30.656596 25860 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.328s	user 0.000s	sys 0.002s
W20260709 13:07:30.653427 25862 log.cc:927] Time spent T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.534s	user 0.002s	sys 0.000s
W20260709 13:07:30.555956 25868 log.cc:927] Time spent T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:07:31.127242 22505 rpcz_store.cc:276] 0709 13:07:29.964623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.858475 (+893852us) service_pool.cc:224] Handling call
0709 13:07:30.858954 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.097313 (+238359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.099743 (+  2430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:31.102054 22501 rpcz_store.cc:276] 0709 13:07:28.333042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.005868 (+1672826us) service_pool.cc:224] Handling call
0709 13:07:30.045682 (+ 39814us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:30.063026 (+ 17344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.803701 (+740675us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b54004254d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:30.804001 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68020480}
W20260709 13:07:30.645799 25863 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.538s	user 0.002s	sys 0.000s
W20260709 13:07:30.654538 25864 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.423s	user 0.000s	sys 0.001s
I20260709 13:07:31.013911 25904 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:31.133297 22432 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.004s	sys 0.015s
I20260709 13:07:30.674369 25825 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:31.137365 22396 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:31.142061 25908 raft_consensus.cc:3055] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.005738 25558 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.148097 25803 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.573984 25873 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.149704 22579 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:30.966753 23079 leader_election.cc:336] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.631s (SENT)
I20260709 13:07:31.160836 22577 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:31.163025 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1507) took 2606 ms. Trace:
I20260709 13:07:31.170647 25887 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:31.171569 25887 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.172605 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 393) took 4019 ms. Trace:
I20260709 13:07:31.162786 25904 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:31.163578 22432 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.005s	sys 0.016s
I20260709 13:07:31.004868 25876 raft_consensus.cc:697] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:31.145680 25387 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.166735 22582 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:30.550491 25808 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.610s
I20260709 13:07:30.643127 25821 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:31.163949 25771 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.165625 25908 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:30.624574 25673 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:30.536434 25869 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.185165 25510 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:31.185920 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.186030 25510 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:31.187873 25869 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:31.186074 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49073.6us
I20260709 13:07:31.103482 22428 rpcz_store.cc:276] 0709 13:07:28.587752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.972822 (+1385070us) service_pool.cc:224] Handling call
0709 13:07:30.010295 (+ 37473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.319799 (+309504us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:30.414137 (+ 94338us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.762848 (+348711us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.763129 (+   281us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.770919 (+  7790us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.771131 (+   212us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:30.771404 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.771609 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.771726 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.800431 (+ 28705us) raft_consensus.cc:1685] finished
0709 13:07:30.800457 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.800741 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":499212,"prepare.run_cpu_time_us":140,"prepare.run_wall_time_us":142,"raft.queue_time_us":456374,"raft.run_cpu_time_us":585,"raft.run_wall_time_us":4189,"thread_start_us":676005,"threads_started":3,"wal-append.queue_time_us":324003}
I20260709 13:07:31.202219 25825 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:31.179713 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.187739 25510 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.202652 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2369) took 2524 ms. Trace:
I20260709 13:07:31.173090 22430 rpcz_store.cc:276] 0709 13:07:27.153037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.950546 (+797509us) service_pool.cc:224] Handling call
0709 13:07:27.957418 (+  6872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.969511 (+ 12093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.969541 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.985608 (+ 16067us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.888407 (+902799us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b180015bda0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b 00007f006c9c1d23 00007f006c9c20d1 00007f006cddda0f
0709 13:07:29.007291 (+118884us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:29.007339 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.007515 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.655949 (+1648434us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:31.172165 (+516216us) raft_consensus.cc:1685] finished
0709 13:07:31.172201 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.172397 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15628,"raft.queue_time_us":42263,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":10005,"spinlock_wait_cycles":115495552,"thread_start_us":118616,"threads_started":1,"wal-append.queue_time_us":2240649}
I20260709 13:07:31.169826 22426 rpcz_store.cc:276] 0709 13:07:28.556123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.939312 (+1383189us) service_pool.cc:224] Handling call
0709 13:07:29.939706 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.940085 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.940114 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.940675 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.222213 (+281538us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:30.398520 (+176307us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.398727 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.398800 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.160025 (+761225us) raft_consensus.cc:1685] finished
0709 13:07:31.160067 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.162837 (+  2770us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":163492,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":95671,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":6660,"thread_start_us":444961,"threads_started":2,"wal-append.queue_time_us":417462}
I20260709 13:07:31.203213 25882 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.223680 25821 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.203178 25825 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:30.569118 25880 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.225090 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:31.220794 25649 consensus_meta.cc:287] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.777s	user 0.006s	sys 0.013s
I20260709 13:07:30.655974 25779 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:31.235674 23077 connection.cc:256] RPC call timeout handler was delayed by -1.0687179869999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 13:07:31.237020 25511 raft_consensus.cc:3055] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.245661 25511 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:31.246620 25904 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:31.247094 25511 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.248945 25887 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.248648 25882 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.249451 25808 consensus_queue.cc:1243] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer e47a624c3ddb48c5a8947ac0b3e71f84 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:07:31.249131 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.251942 25914 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.252732 25915 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.207772 22432 rpcz_store.cc:276] 0709 13:07:28.678408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.109483 (+1431075us) service_pool.cc:224] Handling call
0709 13:07:30.109814 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.110035 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:30.354928 (+244893us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.201992 (+847064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.202143 (+   151us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:31.202228 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.202353 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.202567 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":241723,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":11513,"raft.queue_time_us":61392,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":11711,"thread_start_us":1057540,"threads_started":3,"wal-append.queue_time_us":125637}
I20260709 13:07:31.255752 25444 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:31.267544 25795 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:31.267406 25444 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.269014 25795 consensus_queue.cc:1059] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:31.271904 25825 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:31.224324 25908 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.272526 25779 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.273871 25908 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.274775 25876 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.271944 25877 consensus_queue.cc:1059] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:31.273882 22580 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:31.277525 22576 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: [6.6-8.8]
W20260709 13:07:31.278456 25624 consensus_meta.cc:287] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 1.173s	user 0.008s	sys 0.012s
I20260709 13:07:31.278736 25444 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.279162 25915 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:31.280656 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.281219 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.282146 25915 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:31.283850 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:31.284893 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.285420 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.286195 25652 consensus_meta.cc:287] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.952s	user 0.012s	sys 0.008s
I20260709 13:07:31.287196 25880 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.292059 25653 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.293135 25900 raft_consensus.cc:3055] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.287657 22396 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:31.256995 25914 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:31.291575 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 325138us
W20260709 13:07:31.278515 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2386) took 2378 ms (client timeout 1891 ms). Trace:
W20260709 13:07:31.308524 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 182690us
W20260709 13:07:31.305634 22580 rpcz_store.cc:269] 0709 13:07:28.900126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.128041 (+1227915us) service_pool.cc:224] Handling call
0709 13:07:31.278273 (+1150232us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54004321d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:31.278446 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492623232}
I20260709 13:07:31.296926 22547 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.304193 25900 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:31.318563 25558 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:31.327037 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.309517 25771 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:31.314608 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:31.331424 25444 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.332281 25444 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.333637 22432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:31.334529 22432 raft_consensus.cc:606] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:31.336216 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.336357 25444 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.340981 23105 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:07:31.350821 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 97164us
I20260709 13:07:31.357146 25653 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:31.360190 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 857704us
I20260709 13:07:31.360366 25652 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:31.360710 22503 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
W20260709 13:07:31.362357 22503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1487) took 5461 ms (client timeout 2164 ms). Trace:
I20260709 13:07:31.365365 25751 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.365988 25751 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.371999 25771 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:31.376657 25877 raft_consensus.cc:3055] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.377534 25877 raft_consensus.cc:740] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:31.378739 25877 consensus_queue.cc:260] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.348811 25558 raft_consensus.cc:697] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:31.381788 25882 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:31.381327 25900 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.354136 25887 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.381594 25558 consensus_queue.cc:237] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.359347 25653 consensus_queue.cc:1059] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:31.348017 25624 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.372378 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:31.362807 22503 rpcz_store.cc:269] 0709 13:07:25.900915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.380130 (+479215us) service_pool.cc:224] Handling call
0709 13:07:31.362081 (+4981951us) spinlock_profiling.cc:243] Waited 4.76 s on lock 0x7b54000cc1d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:31.362258 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10952399744}
I20260709 13:07:31.380349 25877 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.377166 25511 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:31.409399 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 175714us
I20260709 13:07:31.410512 22547 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.412688 22473 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:31.413002 25920 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.413981 22473 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:31.415429 22473 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:31.352150 25914 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.416872 25673 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.417898 25673 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.418907 25673 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:31.419533 25673 raft_consensus.cc:697] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:31.427665 25874 consensus_queue.cc:1059] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:31.431349 23077 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.434605 25824 raft_consensus.cc:3055] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:31.435225 25824 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:31.436451 25824 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.438086 25824 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.441133 25771 raft_consensus.cc:3055] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.440810 25673 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.441637 25771 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:31.442874 25771 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.444239 25771 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:31.449312 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 77104us
I20260709 13:07:31.417948 25879 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.426239 25444 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:07:31.460736 25913 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.465467 25913 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.465888 25913 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.466114 25751 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.468827 25914 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:31.463414 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 51362.2us
I20260709 13:07:31.464666 25795 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:31.462702 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1672) took 2792 ms. Trace:
I20260709 13:07:31.475203 22574 rpcz_store.cc:276] 0709 13:07:28.660936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.857137 (+2196201us) service_pool.cc:224] Handling call
0709 13:07:30.863733 (+  6596us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:07:31.120622 (+256889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.143242 (+ 22620us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:31.306108 (+162866us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.452581 (+146473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.452635 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:31.452679 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.452745 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.452860 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":209789,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":2424,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13684,"spinlock_wait_cycles":8808832,"thread_start_us":261076,"threads_started":2}
I20260709 13:07:31.481449 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:31.482999 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 146928us
W20260709 13:07:31.485914 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 98423.5us
I20260709 13:07:31.447993 25510 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:31.484011 23108 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
W20260709 13:07:31.489006 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 101998us
I20260709 13:07:31.451814 25821 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.490103 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:31.463075 25887 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:31.484112 25874 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.496148 25874 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.478017 25795 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:31.496747 25841 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:07:31.497438 25841 consensus_queue.cc:1243] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:31.497808 25795 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.499063 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.499639 25900 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.499960 22503 raft_consensus.cc:2410] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:31.502830 22473 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:31.507040 25624 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:31.507493 25624 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.507826 25624 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.508141 25874 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.508991 25751 consensus_queue.cc:1059] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:31.510358 25879 raft_consensus.cc:3055] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:31.510773 25879 raft_consensus.cc:740] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:31.513550 22507 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.517302 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.517668 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.518186 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.518400 22399 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:31.517485 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:31.518647 25751 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:31.519937 25751 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.520730 25879 consensus_queue.cc:260] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.522544 25751 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.521385 25841 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:31.546135 22501 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:31.546633 25923 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:31.547803 22502 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:31.549418 25841 raft_consensus.cc:697] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:31.550603 25841 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.552876 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:31.504743 25925 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:31.557402 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.558915 25924 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:07:31.524681 25780 raft_consensus.cc:3055] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.560444 25780 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:31.561868 25780 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.556919 25925 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:31.580741 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 47528.8us
I20260709 13:07:31.579766 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.567926 22547 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.524063 25879 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.585518 22503 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:31.585916 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.582973 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.589669 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.592972 25780 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.593127 25624 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.595817 25624 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.587510 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.600203 22508 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:31.597033 22506 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:31.504173 25927 consensus_queue.cc:1059] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.196s
I20260709 13:07:31.603370 22501 raft_consensus.cc:2410] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:31.609961 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.580353 25511 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:31.610982 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:31.612308 22504 pending_rounds.cc:85] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 4
I20260709 13:07:31.612084 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.612919 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:31.613726 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.613857 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.601142 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.616792 22432 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.619446 25922 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:07:31.620987 25922 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.621277 25887 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:31.622014 25887 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.616461 22504 pending_rounds.cc:107] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.5
I20260709 13:07:31.624660 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:31.625581 22503 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 4.
I20260709 13:07:31.625835 22426 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:31.617117 22499 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:31.628630 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:31.629108 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.629861 22503 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:31.630627 25922 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:31.616740 22502 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:31.631520 25511 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.632267 25922 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.633312 22504 raft_consensus.cc:2917] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Aborting config change with OpId 7.5: Aborted: Op aborted by new leader
I20260709 13:07:31.633919 22504 raft_consensus.cc:2889] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:31.634073 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.641814 22432 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
W20260709 13:07:31.651624 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 133421us
W20260709 13:07:31.639654 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 124023us
I20260709 13:07:31.656754 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 397) took 1217 ms. Trace:
I20260709 13:07:31.666149 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:31.664275 25511 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.637243 25927 raft_consensus.cc:3055] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.628087 25925 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.652266 25887 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.653683 23105 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.690483 22399 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.664861 25771 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.694041 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:31.657689 22575 rpcz_store.cc:276] 0709 13:07:30.438898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.112246 (+673348us) service_pool.cc:224] Handling call
0709 13:07:31.177001 (+ 64755us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:31.234799 (+ 57798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.234836 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:31.275320 (+ 40484us) log.cc:844] Serialized 52 byte log entry
0709 13:07:31.337214 (+ 61894us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:31.654700 (+317486us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.656290 (+  1590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.656375 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.656416 (+    41us) raft_consensus.cc:1685] finished
0709 13:07:31.656429 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.656689 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1230,"prepare.queue_time_us":17641,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":27,"raft.queue_time_us":24201,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":224,"thread_start_us":366679,"threads_started":2,"wal-append.queue_time_us":78085}
I20260709 13:07:31.695541 22432 raft_consensus.cc:2393] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:31.702606 22506 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:31.681751 25927 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:31.710107 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.711331 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 278718us
I20260709 13:07:31.712937 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:31.717374 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.699473 25780 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:31.726833 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.726161 25918 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.730762 25918 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:31.733728 25930 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:07:31.734434 22546 connection.cc:256] RPC call timeout handler was delayed by -1.0160146679999116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260709 13:07:31.735453 22430 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:31.737031 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:31.737059 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.740127 25652 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.741972 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:31.742941 25653 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.709117 25922 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.709877 25779 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.746845 22547 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.754856 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:31.755926 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 65556.7us
I20260709 13:07:31.725334 25887 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.758668 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.759490 25824 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:31.759848 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:31.760236 25824 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.724865 25915 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:31.746212 25821 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.764608 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:31.745087 25918 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.766723 25824 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.736423 23105 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:31.766103 25927 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:31.774107 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.777385 23076 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:31.788676 25927 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.789022 23113 pending_rounds.cc:85] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 4
I20260709 13:07:31.789479 23113 pending_rounds.cc:107] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.5
W20260709 13:07:31.789762 25933 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:31.792425 25893 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.793516 25900 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:31.794004 25900 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.794387 25900 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.794924 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:31.795795 23104 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:07:31.796880 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 55136us
I20260709 13:07:31.797801 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:31.798611 22474 leader_election.cc:336] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.178s (SENT)
I20260709 13:07:31.799641 23076 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:31.781986 25915 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.801960 25887 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.802745 25887 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:31.804000 22396 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:31.804876 25511 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.805377 25511 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:31.805775 25511 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.749089 25780 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.804697 25882 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:31.818559 25780 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:31.818724 25882 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:31.819242 25882 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:31.820281 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.821118 22473 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:31.789815 23113 raft_consensus.cc:2917] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Aborting config change with OpId 7.5: Aborted: Op aborted by new leader
I20260709 13:07:31.813647 25913 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:31.827867 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 47761.9us
I20260709 13:07:31.754649 25779 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.811967 25918 consensus_queue.cc:1059] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:31.830075 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:31.831087 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.802613 25915 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:31.848735 22474 leader_election.cc:336] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.789s (SENT)
I20260709 13:07:31.849283 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:31.833819 23113 raft_consensus.cc:2889] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.840871 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:31.841424 25795 consensus_queue.cc:1059] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:31.829088 25751 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:31.856032 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 126627us
I20260709 13:07:31.853657 22396 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:31.856124 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 113225us
I20260709 13:07:31.848237 25920 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.868182 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.832981 25824 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:31.853711 25841 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.876058 22396 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:31.882400 25918 raft_consensus.cc:3055] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.882884 25918 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:31.883839 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.884666 25911 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:31.885294 25911 raft_consensus.cc:697] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:31.885636 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.886149 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.886448 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.886824 22547 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:31.887183 25943 log.cc:927] Time spent T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:07:31.888788 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 62796.2us
W20260709 13:07:31.890125 22474 leader_election.cc:336] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.384s (SENT)
W20260709 13:07:31.884835 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44153.5us
W20260709 13:07:31.892671 25937 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:31.892946 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:31.893920 22432 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.894476 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:31.895097 22430 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.895771 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:31.896004 25913 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.869149 25893 consensus_queue.cc:1059] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:31.877131 25510 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.898128 25510 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:31.898515 25510 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.899951 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:31.868618 25751 raft_consensus.cc:697] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:31.900746 22425 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:07:31.900820 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46500.6us
I20260709 13:07:31.901432 25751 consensus_queue.cc:237] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.902576 23079 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:31.902122 22432 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:31.897653 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:31.904954 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.880605 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:31.907621 22431 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:31.836166 25821 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:07:31.910596 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 112914us
I20260709 13:07:31.897600 25893 raft_consensus.cc:3055] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:31.913178 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:31.873373 25879 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.915720 22432 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:31.881573 25841 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:31.914690 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 66824.5us
I20260709 13:07:31.917083 22545 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:31.872011 25780 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.920200 25558 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.920686 25558 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.921046 25558 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.921368 25869 raft_consensus.cc:3055] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.921792 25869 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:31.922617 25869 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.923935 25869 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.918336 25841 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:31.929134 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.933496 22547 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:31.935428 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 46833.6us
I20260709 13:07:31.932941 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:31.883980 25918 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.943693 23105 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.941931 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:31.953300 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:31.912503 25914 raft_consensus.cc:2764] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:31.953348 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:31.933158 25652 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.951505 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:31.916340 25893 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:31.955447 22499 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.933274 25824 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:31.960552 25824 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.961273 25887 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:31.962091 25511 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.941368 25825 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:31.964668 25825 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:31.965070 25825 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.965781 25510 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.967133 22426 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:31.967983 25510 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:31.968900 25922 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.969518 25922 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.971009 25900 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.974100 22432 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.953681 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:31.938660 25649 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.886328 25911 consensus_queue.cc:237] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:31.976248 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:31.979403 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:31.980232 23108 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:31.964192 25511 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:31.993435 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 103356us
I20260709 13:07:31.955868 25780 raft_consensus.cc:2764] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:31.997445 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:31.957552 25652 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.984050 25922 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:31.976132 25915 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:32.005965 25953 log.cc:927] Time spent T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:31.993675 25653 consensus_queue.cc:1059] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:07:32.019454 25653 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:32.019840 25653 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:32.023509 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:32.024659 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.028506 25893 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.029091 25900 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:32.029923 25893 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:32.037336 25951 log.cc:927] Time spent T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:07:32.012562 22432 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:31.946593 25882 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.008247 22426 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:32.057554 25918 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.058041 25841 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.059294 23105 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
W20260709 13:07:32.063138 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.069556 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:32.015885 25652 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:32.074303 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 153954us
I20260709 13:07:32.070251 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:32.076354 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:32.078348 22503 raft_consensus.cc:2393] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:32.078770 22432 raft_consensus.cc:2393] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:32.076908 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:32.022637 25558 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:32.081002 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 134682us
I20260709 13:07:32.060271 25841 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:32.082698 22508 raft_consensus.cc:2393] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:32.083781 23112 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:07:32.088934 23112 pending_rounds.cc:85] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 10
I20260709 13:07:32.089195 23112 pending_rounds.cc:107] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:07:32.089478 23112 raft_consensus.cc:2889] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.085084 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:32.090523 23106 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:07:32.087517 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.983405 25649 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.093719 25649 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:32.095502 23079 leader_election.cc:336] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.638s (SENT)
I20260709 13:07:32.090752 22507 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.104141 22507 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:32.083570 25925 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.106950 25558 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:32.085873 25779 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:32.109944 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 86561.4us
I20260709 13:07:32.117919 22546 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:32.118407 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:32.119374 22430 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:32.125321 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:32.120945 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:32.134505 22508 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.136952 22432 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:32.116707 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:32.137981 25825 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.128577 25803 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEARNER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:32.171329 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.137491 25841 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:32.140420 25779 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.190639 22474 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:32.192910 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:32.193599 22507 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.137197 25510 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:07:32.196285 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:32.197396 23079 leader_election.cc:336] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.728s (SENT)
W20260709 13:07:32.198179 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.202935 23104 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:32.203393 23104 pending_rounds.cc:85] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 8
I20260709 13:07:32.203611 23104 pending_rounds.cc:107] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:32.203837 23104 raft_consensus.cc:2889] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.198930 25882 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:32.207152 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 64882.7us
I20260709 13:07:32.142889 25925 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 13:07:32.210749 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 95629.4us
I20260709 13:07:32.206411 23079 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:32.213161 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:32.215252 22396 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:32.192085 25841 raft_consensus.cc:697] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:32.154731 25771 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:07:32.230018 22507 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
W20260709 13:07:32.234959 25957 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:07:32.237232 22500 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:32.238561 25653 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.239878 25653 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.231376 25882 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:32.245265 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 47915.6us
I20260709 13:07:32.245903 25825 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:32.247325 25955 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:07:32.263782 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:32.272794 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.280941 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.232319 22472 leader_election.cc:336] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.058s (SENT)
I20260709 13:07:32.283105 22426 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:32.283027 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51101.1us
I20260709 13:07:32.247499 25879 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.297068 25841 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.282670 25771 consensus_queue.cc:1243] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:07:32.301460 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.281738 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 57618.7us
W20260709 13:07:32.309948 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.232702 25911 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:32.307310 23079 leader_election.cc:336] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.850s (SENT)
I20260709 13:07:32.316761 22499 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
W20260709 13:07:32.321564 22399 connection.cc:256] RPC call timeout handler was delayed by -1.4138409509999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2396s for a response
W20260709 13:07:32.322108 22399 connection.cc:256] RPC call timeout handler was delayed by -1.317686502000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
I20260709 13:07:32.320348 22508 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:32.315318 23079 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:32.351327 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.360399 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.360993 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45818.9us
I20260709 13:07:32.363577 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:32.392760 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 161643us
I20260709 13:07:32.393071 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.324318 25771 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.394851 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:32.396337 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.396618 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.417205 22582 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:32.392820 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.349557 25911 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:32.399562 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 167381us
I20260709 13:07:32.362150 25893 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.364228 22575 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 5.
W20260709 13:07:32.403724 25965 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:32.404757 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.405216 25779 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.412808 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:32.397939 25925 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.414640 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 107358us
W20260709 13:07:32.419461 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 113093us
I20260709 13:07:32.427724 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.394249 25649 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.433257 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.431519 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.363008 25558 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:07:32.435029 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.439662 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:32.441360 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:32.434916 22577 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
W20260709 13:07:32.442245 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.436344 22578 raft_consensus.cc:2393] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:32.443446 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 120834us
I20260709 13:07:32.440404 22580 raft_consensus.cc:2376] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8. Re-sending same reply.
W20260709 13:07:32.450248 22399 connection.cc:256] RPC call timeout handler was delayed by -1.1925865020000401s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
I20260709 13:07:32.454375 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:32.455838 23108 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:32.457374 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:32.458076 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.458947 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:32.459975 23104 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:32.421722 25771 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.461237 23106 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:32.463148 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:32.465425 22426 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:32.466256 22432 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:32.445784 25925 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.472632 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:32.473395 22427 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
W20260709 13:07:32.473968 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.431443 25893 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.476454 23111 raft_consensus.cc:2368] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7.
I20260709 13:07:32.479386 22429 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:32.480746 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:32.482105 25964 log.cc:927] Time spent T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.078s	user 0.001s	sys 0.001s
I20260709 13:07:32.482616 22433 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:32.484833 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 72179.7us
I20260709 13:07:32.485404 22574 raft_consensus.cc:1240] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:32.488583 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.489530 22580 raft_consensus.cc:2410] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:32.491612 22431 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:32.493183 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 52773.8us
I20260709 13:07:32.475025 25920 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.445266 25966 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:32.469376 25911 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.507468 25967 consensus_queue.cc:1059] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:32.508109 25673 consensus_queue.cc:1059] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:32.508606 25920 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:32.525663 25920 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.526364 25893 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:32.510387 22433 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:32.528650 25673 consensus_queue.cc:1059] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:32.521106 25908 raft_consensus.cc:3055] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:32.508208 25876 consensus_queue.cc:1059] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:07:32.532020 25925 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:32.532642 25876 raft_consensus.cc:3055] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:32.533113 25876 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:32.533715 23111 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:32.534050 25876 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.536878 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.521353 25771 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:32.537853 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:32.525730 25879 raft_consensus.cc:3055] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:32.538515 25879 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:32.539250 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.539486 25879 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.540225 22577 raft_consensus.cc:2410] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:32.541046 25879 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.541689 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.542312 22575 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:32.516695 22546 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:32.545220 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 51279.4us
I20260709 13:07:32.546113 22546 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:32.508211 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:32.523069 23112 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:32.549320 22472 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:32.550366 22472 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:32.551142 25673 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:32.551477 22472 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:32.551614 25673 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.552139 25673 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.552716 25893 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.553506 25893 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.554550 25877 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:32.554816 25649 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.555073 25927 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.541220 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:32.555647 25877 raft_consensus.cc:697] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:32.557052 22579 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.557617 22472 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:32.559484 22547 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:32.560956 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:32.562422 22574 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
W20260709 13:07:32.565397 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.566181 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.563375 25751 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:32.537757 25876 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.563563 22399 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:32.577426 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:32.578401 23112 raft_consensus.cc:2410] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:32.532099 25967 raft_consensus.cc:3055] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:32.556655 25624 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:32.556921 25908 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:32.587265 22430 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:32.581967 22546 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:32.568750 25771 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.569074 25751 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:32.585901 25967 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:32.595589 25967 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.597353 25967 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.600795 25893 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.604295 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:32.604852 22505 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:32.605073 22504 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:32.605517 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:32.593979 25751 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.606176 22499 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:32.605218 22501 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 13:07:32.606647 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 49410.1us
I20260709 13:07:32.606950 25652 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.589732 25824 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.608758 22573 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 10: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:32.610209 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:32.612588 25893 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:32.613415 25893 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:32.613816 25914 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:32.614290 25914 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:32.615136 25914 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.589015 25927 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.619899 25927 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.621248 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:32.616199 22579 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:32.589699 25771 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:32.631860 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 73386.6us
W20260709 13:07:32.632584 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.632691 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:32.629522 25653 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.593019 25624 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:32.634526 22508 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:32.635815 22503 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.641149 22547 leader_election.cc:400] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7.
I20260709 13:07:32.641592 22547 leader_election.cc:403] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:32.643785 22331 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33176 (request call id 263) took 31412 ms (client timeout 15000 ms). Trace:
I20260709 13:07:32.645866 22501 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:32.631592 25771 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.647290 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:32.587610 25877 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.653438 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:32.643918 25914 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:32.663735 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 151766us
I20260709 13:07:32.664760 22399 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:32.665160 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:32.666455 25927 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:32.668952 23079 leader_election.cc:336] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.090s (SENT)
I20260709 13:07:32.668985 22426 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:32.645972 25918 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 6. Current term is 7.
I20260709 13:07:32.680318 25652 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:32.682243 25920 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:32.683478 23079 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.095s (SENT) [suppressed 52 similar messages]
I20260709 13:07:32.634831 25893 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:07:32.685874 22582 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:32.687654 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:32.689385 25920 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:32.634174 25908 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.690479 25908 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.680404 25624 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.695497 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:32.706023 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:32.706573 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.707120 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:32.708006 22507 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:32.709638 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:32.713122 23076 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:32.684813 25653 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.687331 25652 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.728725 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 94115.9us
W20260709 13:07:32.728863 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 45419.7us
I20260709 13:07:32.726862 23076 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:32.734933 22474 leader_election.cc:336] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.058s (SENT)
I20260709 13:07:32.736202 22474 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:32.751674 25779 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:32.752238 25779 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:32.730948 25652 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.753118 25779 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.754735 25779 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:32.644835 22331 rpcz_store.cc:269] 0709 13:07:01.195731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.195938 (+   207us) service_pool.cc:224] Handling call
0709 13:07:32.608367 (+31412429us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:30.482027 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:30.482645 (+   618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:30.482688 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:07:30.482700 (+    12us) tablet.cc:662] Decoding operations
0709 13:07:30.483516 (+   816us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:30.483576 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:30.483605 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:07:30.484169 (+   564us) tablet.cc:701] Row locks acquired
0709 13:07:30.484189 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:07:30.484333 (+   144us) write_op.cc:270] Start()
0709 13:07:30.484450 (+   117us) write_op.cc:276] Timestamp: P: 1783602450484283 usec, L: 0
0709 13:07:30.499417 (+ 14967us) op_driver.cc:348] REPLICATION: starting
0709 13:07:30.645425 (+146008us) log.cc:844] Serialized 2840 byte log entry
0709 13:07:31.308610 (+663185us) op_driver.cc:464] REPLICATION: finished
0709 13:07:31.460788 (+152178us) write_op.cc:301] APPLY: starting
0709 13:07:31.460916 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:31.480401 (+ 19485us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:31.506299 (+ 25898us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:31.686203 (+179904us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:31.686630 (+   427us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:07:31.686689 (+    59us) write_op.cc:312] APPLY: finished
0709 13:07:31.687175 (+   486us) log.cc:844] Serialized 59 byte log entry
0709 13:07:31.688443 (+  1268us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:31.688711 (+   268us) write_op.cc:454] Released schema lock
0709 13:07:31.688834 (+   123us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:31.689466 (+   632us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:31.689514 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":233671,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":144896,"apply.run_cpu_time_us":8659,"apply.run_wall_time_us":228613,"num_ops":7,"prepare.queue_time_us":240716,"prepare.run_cpu_time_us":9476,"prepare.run_wall_time_us":484142,"raft.queue_time_us":162280,"raft.run_cpu_time_us":20803,"raft.run_wall_time_us":80010,"replication_time_us":808875,"thread_start_us":677270,"threads_started":4,"wal-append.queue_time_us":64420,"wal-append.run_cpu_time_us":22090,"wal-append.run_wall_time_us":1979559}]]}
I20260709 13:07:32.730562 25803 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.736697 25922 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:32.762836 23079 leader_election.cc:336] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.287s (SENT)
W20260709 13:07:32.764986 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.765125 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:32.769220 22505 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:32.767416 25882 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:07:32.774296 25673 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.775556 22502 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:32.760399 25803 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.759824 25652 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:32.789877 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 168097us
I20260709 13:07:32.763468 25922 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.793488 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:32.761756 25877 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:32.794674 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 129999us
W20260709 13:07:32.796918 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 62949.5us
W20260709 13:07:32.801402 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.805697 25913 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:32.806488 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:32.806747 25879 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:32.806500 25913 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:32.810835 22399 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:32.810518 25913 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.790922 25803 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.762251 25649 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:32.764577 25900 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:32.819363 25510 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:32.795470 25922 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:32.834586 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 64750.2us
I20260709 13:07:32.816888 25673 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:32.820550 25652 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.821332 25914 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:32.829510 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.838979 22546 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:32.853518 25983 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:07:32.854265 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 43507us
I20260709 13:07:32.854558 22396 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:32.855515 22399 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:32.855623 25892 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:32.856719 25824 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:32.857251 25824 raft_consensus.cc:697] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:32.858191 25824 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.852283 25893 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.865769 22396 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:32.870445 25649 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.871083 25649 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.836557 25653 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:32.873289 25653 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.875571 25653 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:32.880697 25841 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:32.885540 25986 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:07:32.838227 25558 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:32.819496 25970 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:32.828230 25751 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.888187 25771 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:32.908849 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.908699 25990 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:32.908159 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:32.921664 22500 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:32.917105 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.901191 25962 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:32.926020 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:32.922104 22545 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:32.928507 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 92557.5us
W20260709 13:07:32.927901 23079 leader_election.cc:336] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.444s (SENT)
I20260709 13:07:32.928601 22501 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:32.890204 25914 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:32.930109 23079 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:32.915162 25444 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:32.928148 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 91137.9us
I20260709 13:07:32.933683 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:32.934636 22546 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:32.938187 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.845685 25652 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.940025 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:32.928997 25954 log.cc:927] Time spent T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:32.933642 25653 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.929519 25911 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:32.971866 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49167.5us
I20260709 13:07:32.940832 25962 raft_consensus.cc:697] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:32.944250 25824 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.946303 25558 raft_consensus.cc:697] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:32.990206 25914 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:32.991366 25558 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:32.968816 25918 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.994390 25962 consensus_queue.cc:237] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:32.978236 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.950147 25444 raft_consensus.cc:697] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:32.989622 25876 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.965940 25653 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:32.996272 22474 leader_election.cc:336] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.531s (SENT)
I20260709 13:07:33.005497 22474 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:33.001361 23079 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.936s (SENT)
I20260709 13:07:32.967425 25882 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:33.004079 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.011328 23079 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:32.980856 25911 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:33.022243 22503 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
W20260709 13:07:33.025820 25989 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:07:33.027415 25991 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:07:33.028270 25991 consensus_queue.cc:1243] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer e47a624c3ddb48c5a8947ac0b3e71f84 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:33.028800 25991 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:33.029146 25991 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:33.007768 25653 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.030017 25991 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.031330 25991 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:33.032994 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 102787us
I20260709 13:07:33.033784 22546 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:33.008129 25877 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.001941 25892 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:07:33.052580 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.008288 25876 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.006114 25824 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.034505 25649 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:33.055585 25673 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.062043 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 65808.2us
I20260709 13:07:33.052901 25918 raft_consensus.cc:2764] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:07:33.077992 22474 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.631s (SENT)
I20260709 13:07:33.078493 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:33.080799 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 47105.2us
I20260709 13:07:33.020787 25993 consensus_queue.cc:1059] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:07:33.089290 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.090004 22582 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:07:33.093570 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.094308 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 145182us
I20260709 13:07:33.083926 25877 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.094547 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.085309 25751 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.084837 25771 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:33.080228 25893 consensus_queue.cc:1059] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:07:33.104826 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.077786 25673 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.108078 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.109959 22573 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:33.077261 25444 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:33.115477 25987 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:07:33.115643 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.116757 25869 raft_consensus.cc:3055] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:33.117215 25869 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:33.118091 25869 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.116570 25821 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:33.119133 25869 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.120251 25824 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.120656 25652 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:33.107812 25996 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:07:33.123008 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 121727us
I20260709 13:07:33.122576 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.127766 22581 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:33.123791 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:33.105544 25558 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:33.115362 25995 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.132864 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.133808 22573 raft_consensus.cc:2410] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:33.138559 22501 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:33.139853 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:33.141710 25914 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.142304 25914 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.142688 25914 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.145929 22576 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:33.147890 25673 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.151335 25918 raft_consensus.cc:3055] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:33.151841 25918 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:33.140928 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:33.155088 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 204621us
I20260709 13:07:33.152873 25918 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.165345 22582 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:33.170939 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:33.172750 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.152804 25994 raft_consensus.cc:3055] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:33.110661 25998 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:07:33.180553 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:33.184370 23104 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:33.185665 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 114777us
I20260709 13:07:33.179620 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.143260 25876 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.103434 25911 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.189146 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:33.188128 23076 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:33.196728 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.198751 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.181458 25994 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:33.199815 22573 raft_consensus.cc:2410] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:33.190390 25918 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.199815 22581 raft_consensus.cc:2376] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8. Re-sending same reply.
W20260709 13:07:33.203248 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 62389.2us
I20260709 13:07:33.211248 22399 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:33.200438 22474 leader_election.cc:336] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.648s (SENT)
I20260709 13:07:33.212153 22474 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:33.213377 22474 leader_election.cc:336] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.667s (SENT)
W20260709 13:07:33.213797 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.214757 25892 raft_consensus.cc:1064] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:07:33.213807 22474 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:33.216261 25751 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.216696 25879 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.217664 25892 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.210631 22327 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.227187 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.232996 22576 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:33.193048 25913 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.194914 25876 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.202091 26001 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:07:33.196538 25649 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:33.236996 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:33.245401 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.246029 22503 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:33.246194 22581 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:33.248418 25803 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.252622 25803 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.253844 25803 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.254549 25803 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.258234 25803 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.259397 25877 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.260061 25877 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:33.261025 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49841.7us
I20260709 13:07:33.261898 25962 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.261853 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:33.262274 25877 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.263729 25653 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.264040 22399 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:33.270133 22399 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:33.264227 25821 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.271024 25970 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.271497 25970 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.271840 25970 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.264815 25649 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:33.272526 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:33.272907 25649 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.273834 25914 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.277343 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:33.277050 25876 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.282251 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:33.283303 25876 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:33.284826 22504 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:33.278036 25913 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.278573 25653 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:33.278039 25994 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:33.270231 26008 log.cc:927] Time spent T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:07:33.289124 25994 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.290163 25913 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.290618 25913 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:33.291061 25913 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.289294 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:33.295672 22503 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:33.298043 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.276127 25914 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:33.313402 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.318048 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:33.318745 22508 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.319371 23108 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:33.321938 22396 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:33.324110 22582 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
W20260709 13:07:33.324437 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.326509 22503 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:33.328075 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:33.335016 23106 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:07:33.334241 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 56975.8us
I20260709 13:07:33.350387 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:33.360620 22508 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:33.362237 22545 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:33.363204 25652 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:33.364285 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.328729 25653 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.367100 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.334597 25511 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:33.344949 25914 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:33.370322 22582 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:33.369338 22581 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:33.377013 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.370440 22327 catalog_manager.cc:5697] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 6, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 6 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:33.377740 22576 raft_consensus.cc:2376] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9. Re-sending same reply.
I20260709 13:07:33.372594 23104 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:33.379858 22547 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:33.381208 22327 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.382287 25893 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:33.384852 25997 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:07:33.394469 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.371299 25972 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:33.387812 22327 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 8, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 8 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:07:33.428409 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.430896 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.431463 23106 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:33.436578 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 143581us
W20260709 13:07:33.430464 25965 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:33.438807 22508 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:33.439463 22327 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 8, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 8 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.371876 25771 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.431711 25821 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:33.377017 25511 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.442919 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.360692 25999 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:07:33.444590 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:33.443673 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 142706us
W20260709 13:07:33.454646 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.486207 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.487820 22578 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:33.491490 22474 leader_election.cc:336] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.745s (SENT)
I20260709 13:07:33.492249 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:33.497870 22327 catalog_manager.cc:5697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 2 to 6, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 6 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.503883 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.504716 22578 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:33.430099 25653 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:07:33.506304 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.508541 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:33.481842 25922 consensus_meta.cc:287] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.639s	user 0.014s	sys 0.000s
I20260709 13:07:33.510587 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.514863 22582 raft_consensus.cc:2410] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:33.509171 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.509994 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.516341 22575 raft_consensus.cc:2410] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:33.512275 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.516911 22576 raft_consensus.cc:2376] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8. Re-sending same reply.
W20260709 13:07:33.517719 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.518291 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.519575 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.520466 22574 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.477766 25511 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.538515 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.558995 22499 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:33.524586 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.559791 22576 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:33.527611 22573 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:33.559254 22579 raft_consensus.cc:2393] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 5: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:33.522557 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.538717 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.562882 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.563272 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.446209 25892 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:07:33.529871 22327 catalog_manager.cc:5697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 8, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 8 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.566661 22578 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:33.559459 22499 pending_rounds.cc:85] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 5
I20260709 13:07:33.567404 22499 pending_rounds.cc:107] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:33.567706 22499 raft_consensus.cc:2889] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.501191 25771 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.569945 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.508174 25821 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:33.573179 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.576005 22575 raft_consensus.cc:2410] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:33.519004 25879 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.579734 22578 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:33.579842 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:33.581243 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 101588us
W20260709 13:07:33.581933 22474 leader_election.cc:336] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.805s (SENT)
I20260709 13:07:33.582360 22474 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:33.565725 25997 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:33.588449 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.598925 22327 catalog_manager.cc:5697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 4 to 8, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 8 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.600133 25893 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:33.606683 22579 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:33.596356 25652 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:33.625059 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.572345 25962 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:33.585749 25876 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.628995 22327 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 6, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 6 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.630766 25652 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.632139 25893 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.604835 25510 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:07:33.522898 25922 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.585853 25914 raft_consensus.cc:697] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:33.633656 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 51754.3us
I20260709 13:07:33.811939 22574 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
W20260709 13:07:33.647544 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.674538 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.729633 22580 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:33.814853 22576 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:33.815966 22573 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:33.816164 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.818008 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:33.824872 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:33.826957 22508 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:07:33.828547 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 482183us
I20260709 13:07:33.831379 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.831574 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:33.832104 22580 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:33.832448 22506 raft_consensus.cc:2410] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:33.833110 22504 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:33.834962 22579 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:33.800741 26023 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.751607 25879 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.840955 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.841638 22474 leader_election.cc:336] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.820s (SENT)
I20260709 13:07:33.842006 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:33.842736 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:33.843341 22499 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.665375 25653 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:33.850206 22506 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:33.607954 25997 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.855268 22499 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:33.857448 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:33.857753 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:33.858522 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.677109 25913 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:33.860903 22474 leader_election.cc:336] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.834s (SENT)
W20260709 13:07:33.861449 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.862042 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:33.862309 22504 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:33.864723 25997 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.746479 25970 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.867990 22575 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:33.868530 22327 catalog_manager.cc:5697] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 8, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 8 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
W20260709 13:07:33.857402 26005 log.cc:927] Time spent T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.542s	user 0.005s	sys 0.000s
I20260709 13:07:33.871304 25970 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.857062 25771 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:33.872121 22327 catalog_manager.cc:5697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 4 to 5, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 5 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:33.847718 26023 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.874987 22327 catalog_manager.cc:5697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 8, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 8 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:33.876044 26023 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:33.849375 25879 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.876415 22327 catalog_manager.cc:5697] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 7, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 7 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:33.877236 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.877878 22579 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:33.878448 25879 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.878037 22327 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 8, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 8 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:33.672892 25821 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:33.880395 22327 catalog_manager.cc:5697] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 8, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 8 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.895920 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:33.901711 22575 raft_consensus.cc:1240] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:33.884385 25879 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:33.907620 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 240252us
I20260709 13:07:33.912067 22580 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:33.912955 22579 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:07:33.914196 22327 catalog_manager.cc:5697] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 7, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 7 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:33.915832 22327 catalog_manager.cc:5697] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 4 to 5, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 5 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:07:33.923655 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.933040 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.935889 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:33.936780 22578 raft_consensus.cc:2393] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:33.942229 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.942353 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.943221 22578 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:33.947901 25511 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.950155 25511 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:33.952682 22327 catalog_manager.cc:5697] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 7, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 7 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.954541 22327 catalog_manager.cc:5697] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 5, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 5 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:33.881500 25914 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:33.970139 25913 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:33.971236 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.972128 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.973039 22580 raft_consensus.cc:2393] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:33.981155 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:33.981980 22579 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
W20260709 13:07:34.015307 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.038981 26025 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:33.941107 25879 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:34.044713 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 230715us
I20260709 13:07:34.039789 26025 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.071664 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:34.072337 22579 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:34.073277 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 243595us
I20260709 13:07:34.074059 22399 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:34.077404 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.079370 26021 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.080397 22399 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:34.085626 22399 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:34.090052 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:34.091159 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.092902 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 223918us
W20260709 13:07:34.094870 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.094795 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:34.095517 22578 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.097147 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.098220 22399 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:34.102169 22503 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:07:34.102660 22503 pending_rounds.cc:85] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 5
I20260709 13:07:34.102900 22503 pending_rounds.cc:107] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:07:34.103134 22503 raft_consensus.cc:2889] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.110710 22574 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 9. Ops: []
I20260709 13:07:34.111199 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.111912 22573 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:34.087464 25887 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:34.118263 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 257365us
W20260709 13:07:34.123467 22474 leader_election.cc:336] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.891s (SENT)
I20260709 13:07:34.123885 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:34.120250 22508 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:34.127427 22580 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:07:34.128712 25874 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.129568 26031 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.129853 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:34.130100 26031 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.131551 25874 raft_consensus.cc:2764] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:34.130267 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:34.134353 25999 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.134773 25999 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:34.135149 25999 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.137216 22399 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:34.140794 22578 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:34.153090 22579 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:34.083261 25824 consensus_queue.cc:1059] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:34.158298 22580 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:07:34.155766 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.161054 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.161285 25922 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:34.162931 22424 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:34.164011 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:34.164399 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.156692 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.165432 22578 raft_consensus.cc:2393] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:34.163951 22428 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:34.163136 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.172495 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.132383 26031 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.184835 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.185214 26033 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.186867 25913 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.192159 22578 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 6.
I20260709 13:07:34.187206 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.187337 26004 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.164814 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.188210 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:34.165858 25998 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.190702 22432 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:34.197372 22429 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:34.198168 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:34.196143 25913 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.200667 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.202258 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.191394 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.193773 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.155558 25893 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:34.205583 26037 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:07:34.206295 25893 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.190173 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.208971 22427 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:34.195663 22579 raft_consensus.cc:2393] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:34.196378 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:34.204849 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.215052 22433 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.205647 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.204715 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.215691 22578 raft_consensus.cc:2376] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10. Re-sending same reply.
I20260709 13:07:34.222004 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:34.222978 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.191175 25887 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.227701 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 54611.8us
I20260709 13:07:34.226148 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.233536 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:34.196233 26031 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.237964 22428 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:07:34.261628 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.249392 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:34.261823 22578 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:34.249377 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:34.267622 22504 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.252027 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:34.269564 22573 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.263386 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.272135 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.273029 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:34.273563 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44147.5us
I20260709 13:07:34.277171 22428 raft_consensus.cc:2393] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 7: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:34.277280 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 148250us
I20260709 13:07:34.278694 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.279441 22579 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:34.275700 22424 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:34.280931 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:34.283478 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 443208us
I20260709 13:07:34.283768 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:34.286653 22424 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:34.291023 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.291465 22502 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:34.295251 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:34.295905 22579 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.264164 22430 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.299232 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:34.300211 22424 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.302348 22502 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:07:34.303265 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 179810us
I20260709 13:07:34.321798 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.304602 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:34.233105 25887 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.325265 22426 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:34.326915 22547 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:34.326972 22474 leader_election.cc:336] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.892s (SENT)
I20260709 13:07:34.324592 22577 raft_consensus.cc:2376] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9. Re-sending same reply.
W20260709 13:07:34.333487 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.289055 25991 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:34.345207 25991 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:34.350106 22472 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:34.344925 25652 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.361263 22431 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:34.358232 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:34.359287 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.363775 22433 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:34.333389 25771 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.372735 22399 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:34.349952 25913 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:34.370579 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:34.381999 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:34.380765 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 82965.9us
I20260709 13:07:34.389294 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.390748 22502 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.362769 25879 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.369572 25824 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:34.379331 26038 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.361135 26031 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:07:34.399895 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.369994 25991 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:07:34.395097 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.401424 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:34.410493 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:34.364511 25652 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.417030 22502 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
W20260709 13:07:34.391695 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 69432.8us
W20260709 13:07:34.420079 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.195999 26033 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:34.414124 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 137652us
I20260709 13:07:34.426479 23077 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:34.231750 26004 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.394810 25972 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:34.432978 22474 leader_election.cc:336] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.899s (SENT)
I20260709 13:07:34.441946 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.394899 26034 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:07:34.400209 25879 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.431825 25876 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:34.449677 22428 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:34.411681 25913 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:34.412365 25824 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.454886 22573 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:34.399178 26044 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:07:34.447836 25879 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.456547 22433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:34.444972 25999 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:34.455588 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45196.7us
I20260709 13:07:34.464006 22433 raft_consensus.cc:606] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:34.467046 26054 log.cc:927] Time spent T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:07:34.468063 26046 log.cc:927] Time spent T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:34.475122 22425 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:34.481153 22474 leader_election.cc:336] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.998s (SENT)
I20260709 13:07:34.486779 22575 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:34.455695 25876 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:34.488443 22582 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:34.498558 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:34.503108 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 76736.8us
I20260709 13:07:34.508971 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:34.510313 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:34.511003 22577 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.514196 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:34.514926 22507 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:34.517519 22579 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:34.519133 22579 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:07:34.520149 22474 leader_election.cc:336] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.065s (SENT)
I20260709 13:07:34.520249 22430 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:34.520934 22474 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:34.510540 25887 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:34.523255 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:34.524168 22508 raft_consensus.cc:2410] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:34.530009 22579 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:07:34.531459 22579 pending_rounds.cc:85] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 4
I20260709 13:07:34.532157 22579 pending_rounds.cc:107] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:34.532792 22579 raft_consensus.cc:2889] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.539410 22504 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:34.502892 26031 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.565593 22430 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:34.522094 26045 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.576316 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45765.9us
I20260709 13:07:34.576241 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.573005 22579 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:34.571031 22426 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:34.577556 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 52852.4us
I20260709 13:07:34.589836 22429 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:34.570441 26065 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.608130 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 101280us
I20260709 13:07:34.567344 25558 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:07:34.589411 26038 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.570057 26031 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.607210 22424 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:34.589148 26024 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.576036 26045 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.599699 25876 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.642942 26025 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:34.646145 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2410) took 1202 ms. Trace:
I20260709 13:07:34.646586 22581 rpcz_store.cc:276] 0709 13:07:33.444149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.444287 (+   138us) service_pool.cc:224] Handling call
0709 13:07:34.645950 (+1201663us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b540028bc54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:34.646085 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082614528}
I20260709 13:07:34.637917 26068 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.648744 26068 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:34.650956 26064 log.cc:927] Time spent T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 13:07:34.651201 26068 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:34.654836 22575 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:34.666441 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 135375us
I20260709 13:07:34.628947 26004 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.669173 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:34.670486 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:34.672266 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:34.616354 26065 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.675081 25511 raft_consensus.cc:3055] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:34.682775 22506 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
W20260709 13:07:34.683835 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 74907.5us
I20260709 13:07:34.655723 25824 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.683317 25511 raft_consensus.cc:740] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:34.682464 26070 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.696262 22474 leader_election.cc:336] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.220s (SENT)
I20260709 13:07:34.633536 26024 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.636142 26067 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:07:34.705166 26062 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:34.708988 25511 consensus_queue.cc:260] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.709743 26045 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.711975 26065 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:34.727111 25999 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.701920 26070 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.732002 26070 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.723941 25879 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.738631 25879 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.734346 26024 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:34.739814 25998 consensus_meta.cc:287] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.004s
I20260709 13:07:34.745002 25998 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.740756 22577 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:34.757236 22432 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
W20260709 13:07:34.774282 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 197142us
I20260709 13:07:34.799050 26031 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:34.770035 25922 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.014s	sys 0.010s
I20260709 13:07:34.859380 26037 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:34.791850 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:34.818624 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.864866 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:34.870095 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.868602 26037 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:34.825409 25652 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:34.790642 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.858728 26049 raft_consensus.cc:2764] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:34.871019 26037 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.871658 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:34.871857 26049 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:34.872376 26037 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.872429 26049 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:34.873229 23079 leader_election.cc:336] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.152s (SENT)
W20260709 13:07:34.866207 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 362248us
W20260709 13:07:34.874262 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.874750 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:34.875545 26049 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.876102 26049 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:34.799610 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 106590us
I20260709 13:07:34.835454 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:34.876869 22474 leader_election.cc:336] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.222s (SENT)
I20260709 13:07:34.789717 26024 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.878402 26024 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.879060 23108 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:34.788240 25999 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 13:07:34.868252 25922 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.018s	sys 0.012s
I20260709 13:07:34.880677 23113 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:07:34.880960 26031 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:34.790906 25879 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:34.871280 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:34.882397 23104 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:34.882098 25879 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.872557 23105 raft_consensus.cc:2410] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:34.869032 26050 raft_consensus.cc:3055] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:34.883984 26050 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:34.865943 25893 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:34.884454 25879 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.831979 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.885663 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:34.831549 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.881296 22545 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:34.834972 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.888043 23113 pending_rounds.cc:85] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 6
I20260709 13:07:34.888258 22428 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:34.889220 23108 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:07:34.889482 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:34.889864 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:34.890029 22573 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.890407 22506 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:34.871217 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.892463 26050 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.893544 26050 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.893913 22472 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:34.895378 26067 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:34.895900 26067 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:34.896402 22430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:34.896844 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.897014 26070 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:34.898066 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.896860 26067 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.898518 26070 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:34.899617 22430 raft_consensus.cc:606] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:34.888332 23113 pending_rounds.cc:107] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 13:07:34.904798 23113 raft_consensus.cc:2917] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
I20260709 13:07:34.862860 25511 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.900696 26079 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:34.847823 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.906222 22577 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:34.865064 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:34.897485 22578 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:34.904153 23108 pending_rounds.cc:85] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 6
I20260709 13:07:34.906278 26079 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.832356 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:34.908099 26079 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.900445 22472 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:34.908464 22426 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:34.886754 26085 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:34.908023 23108 pending_rounds.cc:107] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:07:34.909409 23108 raft_consensus.cc:2889] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.910485 26024 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:34.895973 26086 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:07:34.884076 22474 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:34.905277 23113 raft_consensus.cc:2889] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.913671 26070 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.913959 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44670 (request call id 1) took 18333 ms. Trace:
I20260709 13:07:34.914125 26070 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.914613 26070 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.893560 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:34.915270 22575 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:34.907449 22431 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:34.917025 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.917645 22575 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:34.913267 26031 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.920969 26031 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:34.921485 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:34.922333 22575 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:34.923918 26070 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.924670 25841 consensus_queue.cc:1059] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:34.925148 22399 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:34.921427 26031 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.928092 26065 consensus_queue.cc:1059] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:34.929548 26045 raft_consensus.cc:3055] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:34.929937 26045 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:34.930770 26045 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.931968 26045 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.933369 26030 raft_consensus.cc:3055] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:34.933818 26030 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:34.934598 26030 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.935122 26071 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:34.935635 26071 raft_consensus.cc:697] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:34.935804 26030 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.936561 26071 consensus_queue.cc:237] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.914424 23113 rpcz_store.cc:276] 0709 13:07:16.580081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.580245 (+   164us) service_pool.cc:224] Handling call
0709 13:07:16.615663 (+ 35418us) log.cc:844] Serialized 494 byte log entry
0709 13:07:16.928511 (+312848us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b18003d1440. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069cafc0a 00007f00733ef219 00007f0069d37a40 00007f0069d324e4 00007f0069d32455 00007f006cd7bb0b 00007f006ce00b63 00007f006ce28752 00007f006ce209fa
0709 13:07:34.913868 (+17985357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70445,"raft.queue_time_us":154300,"raft.run_cpu_time_us":1606,"raft.run_wall_time_us":74823,"spinlock_wait_cycles":20972288,"thread_start_us":161019,"threads_started":1,"wal-append.queue_time_us":218875,"wal-append.run_cpu_time_us":2146,"wal-append.run_wall_time_us":1059959}
I20260709 13:07:34.938555 23113 pending_rounds.cc:107] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 8.8
W20260709 13:07:34.938776 22317 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4d35c45e33c4336b33461cdbe7f7b6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:07:34.941636 22573 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:34.938815 23113 raft_consensus.cc:2889] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.949963 25972 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:34.950484 22426 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:34.952003 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:34.952417 22574 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:34.954221 22574 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:34.955966 22574 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:07:34.957767 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.958621 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:34.958931 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:34.960346 22576 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:34.959703 22574 raft_consensus.cc:2376] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11. Re-sending same reply.
I20260709 13:07:34.959761 25972 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:34.962844 22575 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:34.962872 25972 raft_consensus.cc:697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:34.964649 25972 consensus_queue.cc:237] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.968500 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:34.969291 22577 raft_consensus.cc:2376] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13. Re-sending same reply.
I20260709 13:07:34.972965 25991 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:34.973676 25991 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.974555 22472 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:34.976395 26069 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:34.976666 26045 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:34.977077 26069 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:34.977866 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 93854us
I20260709 13:07:34.979489 26069 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:34.980528 25991 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.981182 25913 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:34.982811 25991 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:34.983403 25991 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:34.985666 25991 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.988035 26070 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:34.990559 25999 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:34.996343 25999 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:35.000979 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:35.004352 26033 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:35.005605 26079 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:34.980351 22474 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:35.018092 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:35.019923 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:35.020632 22507 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:35.022670 26031 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.024384 22507 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:35.025429 25887 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:35.026003 26033 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:35.027534 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:34.779876 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:34.964275 22506 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:35.031327 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:35.526389 26076 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.075476 26045 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:35.527731 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 747895us
I20260709 13:07:35.444289 26037 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.032960 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:35.133975 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 136998us
W20260709 13:07:35.531225 23079 leader_election.cc:336] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.219s (SENT)
I20260709 13:07:35.128937 22545 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:35.380743 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.349279 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.224383 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.531726 23079 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:35.036964 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.534981 22427 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:35.536228 23076 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:35.033821 22503 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:07:35.536746 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.537273 23076 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:35.544664 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1538) took 1334 ms. Trace:
I20260709 13:07:35.545192 22432 rpcz_store.cc:276] 0709 13:07:34.197179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.197898 (+   719us) service_pool.cc:224] Handling call
0709 13:07:35.531052 (+1333154us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54003acad4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:35.531192 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258020224}
W20260709 13:07:35.550822 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 532787us
I20260709 13:07:35.552275 22474 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:35.534469 25922 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:35.038417 26070 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.528015 26045 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:35.553093 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 525604us
I20260709 13:07:35.096935 25652 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.464986 25879 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.075107 26069 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.535776 26065 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.548322 25991 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:35.559705 25972 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:35.564376 26069 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.548127 26050 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:07:35.562989 25652 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.578620 26031 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:35.561035 26045 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.561481 26079 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:35.562670 26067 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.539336 26037 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.584378 25972 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.589041 26084 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.603437 25972 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.564127 25879 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.606215 26031 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:35.587070 26034 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:07:35.591392 25922 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:35.631044 26097 log.cc:927] Time spent T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.670s	user 0.003s	sys 0.006s
I20260709 13:07:35.613473 26079 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:35.606925 26084 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.616721 25922 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.602737 26067 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.641803 26079 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.637066 26031 raft_consensus.cc:697] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:35.647898 25922 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.676972 23105 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:35.655159 26050 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.686110 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 148894us
I20260709 13:07:35.662581 26079 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:35.688438 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.566802 26029 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:35.695499 26105 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.717093 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 157344us
I20260709 13:07:35.717958 22399 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:35.695456 25991 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:35.725445 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:35.688783 26050 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.729282 26108 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:35.689284 25972 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.739678 25879 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:35.741185 26067 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:35.728250 25652 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:35.730351 26069 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:35.711361 26106 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:35.747692 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 195464us
I20260709 13:07:35.727166 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:35.750986 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 622208us
I20260709 13:07:35.750878 22474 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:35.731058 26107 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.729779 26084 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:35.756337 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 202628us
I20260709 13:07:35.759497 22474 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:35.750401 25879 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:35.751623 25652 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.750170 26067 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:35.726482 26105 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.729931 26109 consensus_queue.cc:1059] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:35.755194 25771 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.721894 26031 consensus_queue.cc:237] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.750072 26045 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.775763 26110 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:35.754043 26112 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:35.752722 26069 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:07:35.761631 26084 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.769145 26107 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.792869 26079 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.793606 26084 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.795070 26079 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:35.795701 26079 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:35.797783 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:35.755079 26114 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:35.796197 26084 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:35.785166 26113 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.810056 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:35.811131 22581 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:35.815423 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:35.816308 22581 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:35.817342 22546 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:35.818277 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:35.820673 22507 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.819471 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:35.829501 22507 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:35.832284 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:35.786482 25771 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.771028 25879 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.774114 25652 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.799670 26114 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:35.833093 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 73689.6us
I20260709 13:07:35.774446 26067 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:35.838423 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 113040us
W20260709 13:07:35.840760 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 78033.9us
I20260709 13:07:35.753504 26106 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.842394 22508 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:35.809041 26070 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:35.846408 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 119306us
I20260709 13:07:35.844655 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:35.845479 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:35.770953 25991 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.832719 26084 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.851707 22545 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:35.847690 22507 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.858083 22507 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:35.836990 26112 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:35.860352 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:35.861313 22545 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:35.894979 25879 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:35.896961 23105 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:07:35.897415 23105 pending_rounds.cc:85] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 9
I20260709 13:07:35.897631 23105 pending_rounds.cc:107] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:07:35.897852 23105 raft_consensus.cc:2889] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:35.899210 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:35.900761 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:35.901387 23113 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:35.840504 26114 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.916225 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:35.859615 26110 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.927875 23106 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:35.834292 26113 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.862224 26117 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.859340 26084 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.931522 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:35.918277 26070 raft_consensus.cc:2764] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:35.932112 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:35.863831 26109 consensus_queue.cc:1059] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:07:35.943563 26113 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:35.923489 25972 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:35.925781 26118 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:07:35.943388 26084 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:35.944552 26124 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:35.903076 26069 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:07:35.947266 26118 raft_consensus.cc:3055] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:35.947712 26118 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:35.931190 25879 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:07:35.948639 26118 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.949965 26118 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.944589 26084 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.925287 26123 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:35.950143 26121 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:35.951130 26123 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:35.952178 26123 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.954130 22547 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:35.930850 26110 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:35.955098 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:35.956535 26106 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:35.957190 26110 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:35.957832 26110 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:35.958191 26110 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.958539 26110 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.958913 26107 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:35.951162 26084 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:35.960098 25922 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:35.960984 26084 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:35.936875 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 129554us
I20260709 13:07:35.949150 25879 consensus_queue.cc:1243] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:35.963546 22503 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:35.970942 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:35.971431 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:35.972726 23105 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:07:35.971063 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 129185us
I20260709 13:07:35.974203 22474 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:36.003126 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2393) took 1816 ms. Trace:
I20260709 13:07:35.931999 26050 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:36.003666 22427 rpcz_store.cc:276] 0709 13:07:34.186611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.209612 (+ 23001us) service_pool.cc:224] Handling call
0709 13:07:35.534774 (+1325162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.548643 (+ 13869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.002873 (+454230us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003acad0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:36.003052 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2977995136}
I20260709 13:07:36.010357 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:36.010789 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 93058.6us
W20260709 13:07:36.007385 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 215443us
I20260709 13:07:36.016342 22473 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:35.969512 26119 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:35.961884 26084 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:36.018007 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 156762us
I20260709 13:07:36.007145 26107 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.030272 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 182495us
W20260709 13:07:36.028832 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 194517us
I20260709 13:07:36.030846 22545 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:35.904954 26112 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:36.037954 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63860.1us
I20260709 13:07:35.971729 26111 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:07:35.962553 26125 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:07:36.033346 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:36.051035 26033 consensus_queue.cc:1243] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer 10c2f471167442c0b75d8cd50ed8c40c log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:36.034951 26119 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:36.059296 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:36.041920 26106 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:36.013202 26128 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:07:36.042055 26113 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:36.057675 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 102653us
I20260709 13:07:36.017956 26076 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:36.042111 26129 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:36.049396 25771 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:36.073104 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.077199 23106 pending_rounds.cc:85] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 9
I20260709 13:07:36.034247 26105 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:36.070027 23076 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:36.082748 23106 pending_rounds.cc:107] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:07:36.088009 23106 raft_consensus.cc:2889] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:36.088318 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.051924 26065 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:36.061949 25922 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:36.039515 26107 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:36.062959 26127 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:36.104126 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 73903.4us
I20260709 13:07:36.073745 25652 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:36.062594 26131 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:36.053334 26117 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:07:36.083969 26129 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.116925 26129 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.120353 26130 consensus_queue.cc:1059] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:36.123688 26143 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:36.124341 26143 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:36.125895 26119 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:36.126971 26143 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:36.127661 26143 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:36.134476 23079 leader_election.cc:336] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.804s (SENT)
I20260709 13:07:36.134932 26112 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:36.135231 23079 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:36.136229 25991 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:36.138257 26127 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:36.138880 26127 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:36.063014 26132 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:07:36.097930 26105 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:36.142795 26105 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:36.145092 26105 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:36.082424 26136 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:36.106848 25771 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:36.146929 25771 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:36.147935 25771 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:36.104926 26137 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:36.152292 26137 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:36.089963 26113 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:36.154732 26113 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:36.145730 26134 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:36.063647 26106 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:36.151647 26107 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:36.097402 26109 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:36.072981 25879 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:07:36.164597 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.224771 26137 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:36.217780 26106 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.104612 26070 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:36.226935 26070 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:36.229619 26070 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:36.116353 26117 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:36.230638 26117 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:36.232743 26117 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:36.233496 26109 raft_consensus.cc:697] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:36.234722 26109 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:36.241530 26110 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:36.244060 26110 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:36.128368 26143 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:07:36.260926 26114 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:36.264688 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 188757us
W20260709 13:07:36.304791 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.306262 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:36.306840 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:36.256224 26127 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:36.337711 26131 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.340952 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 302263us
I20260709 13:07:36.256311 26129 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:36.346062 26146 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.374594 26146 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:36.375738 26045 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:36.370342 26129 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:36.361148 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:36.361420 26114 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:36.394958 22501 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:36.347757 26127 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:36.365589 26037 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:36.370323 26123 raft_consensus.cc:2955] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index 2 to 7, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:36.344559 26131 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:36.348308 26106 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:36.359937 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:36.377437 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 338177us
I20260709 13:07:36.377228 26146 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:36.384837 22508 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:36.386041 22507 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:36.387825 22503 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:36.390179 22502 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:36.395639 22505 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:07:36.395835 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 373431us
I20260709 13:07:36.380587 26116 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.993501 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:36.994724 26031 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:36.995357 26031 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:36.568141 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.408571 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:36.663479 26151 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.999632 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:36.884905 26136 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.000700 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:37.001406 25771 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.002193 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.001965 25771 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:37.003726 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:36.672912 26099 log.cc:927] Time spent T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.991s	user 0.006s	sys 0.012s
I20260709 13:07:37.003842 26119 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.577037 22546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.004s	sys 0.019s
I20260709 13:07:36.410943 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:37.005266 26071 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:36.668300 26084 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.004624 26119 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:36.412853 26143 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:37.006942 26143 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:36.559578 23112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.004s	sys 0.016s
I20260709 13:07:36.662470 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:37.010547 23107 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
W20260709 13:07:36.663170 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.586977 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.603503 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:36.998668 23108 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:37.014384 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:36.617450 25887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.009s	sys 0.013s
W20260709 13:07:37.021018 22546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.006s	sys 0.028s
W20260709 13:07:37.021888 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 988535us
W20260709 13:07:37.022529 22500 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.006s	sys 0.016s
W20260709 13:07:37.022925 22500 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.006s	sys 0.016s
W20260709 13:07:37.008942 23112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.004s	sys 0.027s
I20260709 13:07:37.012945 22504 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:36.996430 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:37.008831 26119 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:37.001561 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:37.001410 22508 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:37.009923 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:37.004563 22505 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:37.023382 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:36.995265 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:37.031524 22431 raft_consensus.cc:3055] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:37.031749 22426 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:37.032519 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.032689 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.050413 22427 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:37.033245 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:36.405167 25922 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:37.033582 22577 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:07:37.054982 23111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.008s	sys 0.016s
I20260709 13:07:37.025386 22398 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:37.011325 25771 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:37.040581 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.048619 22502 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.049254 22431 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:37.020756 25887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.460s	user 0.014s	sys 0.018s
I20260709 13:07:37.013401 26029 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:36.669987 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:37.055498 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:36.665890 26131 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:37.062747 22579 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:37.063428 23110 raft_consensus.cc:2410] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:37.060310 22431 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:36.770121 26109 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:37.056587 22505 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:37.057308 23111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.009s	sys 0.016s
I20260709 13:07:37.055747 22433 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:37.061633 22504 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:37.036907 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.067822 22505 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:37.023900 25999 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.006239 26084 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:37.032325 26159 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.073599 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:37.080971 22508 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:37.075778 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 52469.3us
I20260709 13:07:37.032598 26034 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.077905 22505 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:37.078792 22502 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:37.079267 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:37.088274 23109 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.079562 26155 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:37.064195 25887 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:36.405509 26127 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:37.080106 26150 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.118798 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 222790us
I20260709 13:07:37.081741 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:37.083098 22546 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:37.120393 22546 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:37.120550 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:37.121186 22576 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.094070 26076 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.079999 25999 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:37.090432 26034 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:37.011276 26116 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:36.998656 26151 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:37.098784 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.023618 26136 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:37.063109 25922 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:37.117954 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 121206us
I20260709 13:07:37.089901 22503 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:37.142364 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:37.091354 26152 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:37.151156 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.169798 22576 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:37.072204 26029 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:37.077488 26109 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:37.125310 26146 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.225932 23109 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:37.145392 26106 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:37.228291 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.228611 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:37.230611 23105 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:37.194218 26143 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:37.238451 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 118146us
I20260709 13:07:37.208788 26031 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:37.105309 26155 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:37.284600 23112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 664) took 1336 ms. Trace:
I20260709 13:07:37.229389 26152 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.124992 26150 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:37.319612 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.322098 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:37.323644 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:37.318133 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.318038 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.309432 22430 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:37.318521 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.318291 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:37.325764 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.326227 22427 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:37.326740 22433 raft_consensus.cc:2410] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:37.327395 22546 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:37.328922 22546 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:37.329836 26143 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.329154 26033 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.331852 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:37.336581 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.337428 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:37.337774 22433 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:37.285058 26173 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:37.297914 23112 rpcz_store.cc:276] 0709 13:07:35.913994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.921976 (+  7982us) service_pool.cc:224] Handling call
0709 13:07:35.922321 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.922563 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:36.015250 (+ 92687us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.240972 (+1225722us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.242306 (+  1334us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:37.242401 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.242503 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.249496 (+  6993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1981,"prepare.queue_time_us":192329,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":1284139,"threads_started":3,"wal-append.queue_time_us":1053983}
I20260709 13:07:37.287138 25887 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:37.331235 26033 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:37.356876 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.354717 22546 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:37.354657 22472 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:37.365200 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:37.318917 26152 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:37.333077 26146 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:37.354709 26160 log.cc:927] Time spent T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:07:37.382045 22425 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:37.434074 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.451673 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.382277 26143 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:37.378968 26123 consensus_meta.cc:287] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.017s
I20260709 13:07:37.383344 26152 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.521960 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.470918 26179 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.453297 26084 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:37.365763 26173 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:37.467043 26076 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.605051 22582 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:37.528676 26177 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:07:37.545259 26136 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:37.546248 26170 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 13:07:37.552915 26165 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
W20260709 13:07:37.559073 26167 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
W20260709 13:07:37.559818 26163 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
W20260709 13:07:37.563746 26164 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:07:37.569710 26089 log.cc:927] Time spent T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 1.993s	user 0.007s	sys 0.022s
I20260709 13:07:37.574234 22504 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:37.577035 22431 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.579177 22502 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.600904 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:37.615168 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:37.616935 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:37.472790 26146 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.621930 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:37.523847 26161 log.cc:927] Time spent T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:07:37.605402 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:37.597566 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:37.577790 26090 log.cc:927] Time spent T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 1.964s	user 0.023s	sys 0.004s
W20260709 13:07:37.588732 26162 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.465s	user 0.000s	sys 0.001s
I20260709 13:07:37.642603 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:37.572441 22505 raft_consensus.cc:2955] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 2 to 7, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:37.595748 26173 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:37.577538 25999 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:37.578562 26029 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:37.593860 26151 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:37.588891 26034 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:37.572906 26069 raft_consensus.cc:3055] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:37.699550 22545 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.588s (SENT) [suppressed 24 similar messages]
W20260709 13:07:37.965531 22580 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.025s
W20260709 13:07:38.002424 23076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.016s	sys 0.012s
I20260709 13:07:37.592878 26084 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:37.588409 25771 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:38.004142 22580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.000s	sys 0.028s
W20260709 13:07:37.959868 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.952589 26185 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.005643 22575 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:37.950430 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:38.030167 26185 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.000934 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.001803 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:37.988858 22581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.004s	sys 0.023s
W20260709 13:07:37.980610 22474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.012s	sys 0.015s
W20260709 13:07:38.033046 22581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.005s	sys 0.023s
W20260709 13:07:38.033293 22474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.012s	sys 0.015s
I20260709 13:07:38.034371 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1742) took 1009 ms. Trace:
I20260709 13:07:38.034845 22581 rpcz_store.cc:276] 0709 13:07:37.024878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.025025 (+   147us) service_pool.cc:224] Handling call
0709 13:07:37.025350 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.025557 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:37.221927 (+196370us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.033835 (+811908us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.034010 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.034060 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:38.034108 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.034180 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.034299 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":336994,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":8021,"thread_start_us":990569,"threads_started":2}
I20260709 13:07:38.036638 26131 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:38.005276 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 650667us
I20260709 13:07:38.038309 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:37.933032 26124 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:38.039471 26124 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:37.966467 26122 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.041263 22502 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:37.979604 26193 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:38.042160 26193 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:38.012874 22398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.007s	sys 0.007s
W20260709 13:07:38.013154 23079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.007s	sys 0.007s
W20260709 13:07:38.013383 22579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.007s	sys 0.008s
I20260709 13:07:37.740751 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:37.622584 26127 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:37.810541 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.020967 22431 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:07:37.990900 23111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 451) took 1608 ms. Trace:
I20260709 13:07:38.006088 22574 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
W20260709 13:07:38.026165 22546 connection.cc:256] RPC call timeout handler was delayed by -1.534362428999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 13:07:38.056692 22546 connection.cc:256] RPC call timeout handler was delayed by -1.1680624289999741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260709 13:07:37.979074 26109 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.025516 26031 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.001000 26112 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:38.047288 22398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.008s	sys 0.007s
I20260709 13:07:38.033077 22433 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
W20260709 13:07:38.048213 22579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.007s	sys 0.008s
W20260709 13:07:38.016621 23076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.016s	sys 0.012s
W20260709 13:07:38.088255 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 1.06287e+06us
W20260709 13:07:38.047582 23079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.007s	sys 0.007s
W20260709 13:07:37.946676 26165 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:07:37.604983 26155 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:38.001842 26030 raft_consensus.cc:993] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:07:37.989837 26033 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.055673 23111 rpcz_store.cc:276] 0709 13:07:36.382198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.382364 (+   166us) service_pool.cc:224] Handling call
0709 13:07:36.382681 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.383045 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.383080 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.383549 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.065303 (+681754us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:37.065343 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.065409 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.990627 (+925218us) raft_consensus.cc:1685] finished
0709 13:07:37.990650 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.990826 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141,"raft.queue_time_us":12007,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2057,"thread_start_us":619810,"threads_started":1,"wal-append.queue_time_us":885740}
I20260709 13:07:38.049100 26084 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:38.058207 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:37.579520 26150 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.003793 26069 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:37.580744 25922 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:38.056582 26185 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:37.621482 26179 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.061029 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:37.946048 26116 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:38.086362 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1695) took 1093 ms. Trace:
I20260709 13:07:38.059190 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.163861 22581 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
W20260709 13:07:38.104578 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 405042us
I20260709 13:07:38.105957 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1692) took 1114 ms. Trace:
I20260709 13:07:38.054430 25771 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.089295 26184 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.122082 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.102633 26112 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:38.143056 23105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59008 (request call id 798) took 1703 ms (client timeout 2220 ms). Trace:
I20260709 13:07:38.143759 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:37.997486 26188 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.153525 22574 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:38.149170 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:38.201529 22576 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.202193 23111 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:38.177670 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.170217 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.204089 22575 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:38.169278 23106 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:38.208226 22576 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:38.156255 23112 raft_consensus.cc:2955] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 2 to 7, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:07:38.205097 23105 rpcz_store.cc:269] 0709 13:07:36.410523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.410658 (+   135us) service_pool.cc:224] Handling call
0709 13:07:38.114038 (+1703380us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400594cd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:38.114142 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517233024}
I20260709 13:07:38.119314 22431 pending_rounds.cc:85] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 8
I20260709 13:07:38.162432 22508 rpcz_store.cc:276] 0709 13:07:36.992458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.094067 (+101609us) service_pool.cc:224] Handling call
0709 13:07:37.094411 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.227297 (+132886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.228321 (+  1024us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.232383 (+  4062us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.324520 (+ 92137us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:37.324556 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.324623 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.086098 (+761475us) raft_consensus.cc:1685] finished
0709 13:07:38.086118 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.086293 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":527066,"spinlock_wait_cycles":9541376,"thread_start_us":224126,"threads_started":2,"wal-append.queue_time_us":820306}
I20260709 13:07:38.164978 22503 rpcz_store.cc:276] 0709 13:07:36.991657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.074546 (+ 82889us) service_pool.cc:224] Handling call
0709 13:07:37.089606 (+ 15060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.145125 (+ 55519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.105743 (+960618us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b54004254d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:38.105890 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33124608}
I20260709 13:07:37.634181 26076 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:38.154533 26164 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:38.225546 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.224952 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.229975 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.226805 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:38.228962 22575 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:38.230958 22427 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:38.058550 26193 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:38.174095 26176 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:07:38.227658 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.236052 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.219455 22431 pending_rounds.cc:107] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:38.233325 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.239985 22581 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 6: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:38.240545 22431 raft_consensus.cc:2889] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.241878 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1551) took 1211 ms. Trace:
W20260709 13:07:38.247243 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.257025 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:38.258265 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.243208 22431 rpcz_store.cc:276] 0709 13:07:37.030889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.030996 (+   107us) service_pool.cc:224] Handling call
0709 13:07:37.031411 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.576828 (+545417us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b58004997d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006cd7e0aa 00007f006ce00447 00007f006ce18fe7 00007f006ce1a7de 00007f006ce24b49 00007f006ce25416 00007f006ce21d8f 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4
0709 13:07:38.241558 (+664730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.241809 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175317248}
I20260709 13:07:38.163734 26144 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.102521 26031 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.259859 22576 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 13: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:38.175390 26067 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:38.260329 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.264357 22581 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:38.209976 25922 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:38.265712 22581 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:38.263198 22575 raft_consensus.cc:2368] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9.
I20260709 13:07:38.271610 22575 raft_consensus.cc:1240] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:38.272706 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1758) took 1139 ms. Trace:
W20260709 13:07:38.262615 25444 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:07:38.282151 22575 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:38.283964 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:38.258486 26108 raft_consensus.cc:3055] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.273126 22579 rpcz_store.cc:276] 0709 13:07:37.125633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.125788 (+   155us) service_pool.cc:224] Handling call
0709 13:07:37.128546 (+  2758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.295045 (+166499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.295082 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.309817 (+ 14735us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.088677 (+778860us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:38.209202 (+120525us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.264385 (+ 55183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.264651 (+   266us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.264776 (+   125us) raft_consensus.cc:1685] finished
0709 13:07:38.264807 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.264967 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63812,"prepare.queue_time_us":121719,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":40,"raft.queue_time_us":124822,"raft.run_cpu_time_us":7238,"raft.run_wall_time_us":74785,"thread_start_us":912153,"threads_started":3,"wal-append.queue_time_us":700188}
I20260709 13:07:38.297333 22575 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:38.298616 22576 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:38.261174 26124 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.225142 25771 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:38.316736 23079 leader_election.cc:336] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.155s (SENT)
I20260709 13:07:38.317270 22581 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:38.270109 26151 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:38.324826 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:38.225333 26184 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:38.322885 22501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.012s	sys 0.036s
I20260709 13:07:38.334100 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:38.334836 22501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.012s	sys 0.036s
I20260709 13:07:38.335004 22579 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:38.294862 26108 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:38.353637 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.352376 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 476) took 1772 ms. Trace:
I20260709 13:07:38.274282 25922 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.230549 26188 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.347980 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.363955 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:38.364318 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:38.339773 26152 consensus_meta.cc:287] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.734s	user 0.008s	sys 0.003s
I20260709 13:07:38.270462 26069 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.369671 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.366506 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.371155 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.389716 22425 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:38.372601 26152 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.346820 26192 raft_consensus.cc:1081] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Signalling peer e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:07:38.372041 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.355275 22501 rpcz_store.cc:276] 0709 13:07:36.569035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.569202 (+   167us) service_pool.cc:224] Handling call
0709 13:07:36.569631 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.569892 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:37.022244 (+452352us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.587257 (+565013us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b1800465f40. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069cafc0a 00007f00733ef219 00007f0070cf658f 00007f0069d35571 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd
0709 13:07:37.606447 (+ 19190us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b1800465f40. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069cafc0a 00007f00733ef219 00007f0069d37a40 00007f0069d324e4 00007f0069d32455 00007f006ce1a060 00007f006ce2c716 00007f006ce3d287 00007f006ce3d208
0709 13:07:38.340893 (+734446us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.340984 (+    91us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:38.341053 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.341172 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.341383 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25487,"prepare.queue_time_us":659458,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":507166,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":43869,"spinlock_wait_cycles":50279552,"thread_start_us":1388538,"threads_started":3,"wal-append.queue_time_us":491531}
W20260709 13:07:38.411206 26203 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:07:38.414060 26197 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:07:38.401552 26103 log.cc:927] Time spent T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 2.744s	user 0.029s	sys 0.017s
I20260709 13:07:38.333578 26151 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:38.430979 26157 log.cc:927] Time spent T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:38.432204 26112 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:38.435285 26179 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:38.438448 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.440065 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2418) took 1199 ms. Trace:
I20260709 13:07:38.497125 22432 rpcz_store.cc:276] 0709 13:07:37.240782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.240964 (+   182us) service_pool.cc:224] Handling call
0709 13:07:37.321335 (+ 80371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.742489 (+421154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.742527 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.009579 (+267052us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.145575 (+135996us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:38.145610 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.145681 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.439833 (+294152us) raft_consensus.cc:1685] finished
0709 13:07:38.439858 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.440006 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":217619,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":440801,"threads_started":2,"wal-append.queue_time_us":428341}
I20260709 13:07:38.428684 26108 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.499361 26108 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:38.466984 26208 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:07:38.470048 26150 raft_consensus.cc:3055] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:38.471024 26119 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:38.471617 23077 leader_election.cc:336] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.581s (SENT)
I20260709 13:07:38.295519 26084 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.492803 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:38.526512 23106 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
W20260709 13:07:38.516494 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 482688us
I20260709 13:07:38.516952 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:38.519125 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 78589.3us
I20260709 13:07:38.528275 22576 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.528733 22473 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:38.531457 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.533432 22396 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:38.535696 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.525382 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 53794us
W20260709 13:07:38.537075 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.514519 26069 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.548609 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1697) took 1512 ms. Trace:
I20260709 13:07:38.549044 22505 rpcz_store.cc:276] 0709 13:07:37.036144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.571672 (+535528us) service_pool.cc:224] Handling call
0709 13:07:37.572060 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.572295 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:38.044064 (+471769us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.548222 (+504158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.548287 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:38.548334 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.548401 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.548547 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":360152,"thread_start_us":143589,"threads_started":1,"wal-append.queue_time_us":486603}
I20260709 13:07:38.515275 26076 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.570329 26181 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.570367 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 480) took 1969 ms. Trace:
I20260709 13:07:38.542601 26127 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.545578 26122 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.522989 26150 raft_consensus.cc:740] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:38.581398 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.584440 22576 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:38.584314 22507 rpcz_store.cc:276] 0709 13:07:36.600594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.029133 (+428539us) service_pool.cc:224] Handling call
0709 13:07:37.029460 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.143100 (+113640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.143130 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.143170 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:37.143209 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.570048 (+1426839us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400184cd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:38.570106 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.570286 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260880768}
I20260709 13:07:38.589185 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 481) took 1988 ms. Trace:
I20260709 13:07:38.538767 26193 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:38.543951 25972 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:38.592640 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 63981.1us
I20260709 13:07:38.602469 22473 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:38.525894 26112 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:07:38.594818 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.591733 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1684) took 2199 ms. Trace:
W20260709 13:07:38.604306 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.550877 26177 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:38.590553 22506 rpcz_store.cc:276] 0709 13:07:36.600974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.049612 (+448638us) service_pool.cc:224] Handling call
0709 13:07:37.049996 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:37.217732 (+167736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.217765 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:37.248115 (+ 30350us) log.cc:844] Serialized 52 byte log entry
0709 13:07:37.621542 (+373427us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:37.942043 (+320501us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.436286 (+494243us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b180039ae40. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069cafc0a 00007f00733ef219 00007f0070cf658f 00007f0069d35571 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd
0709 13:07:38.437601 (+  1315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.437673 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.582807 (+145134us) raft_consensus.cc:1685] finished
0709 13:07:38.588635 (+  5828us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.589108 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":801687,"prepare.queue_time_us":322154,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":3844,"raft.queue_time_us":1052558,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":10586,"spinlock_wait_cycles":34416384,"thread_start_us":455627,"threads_started":2,"wal-append.queue_time_us":957625}
I20260709 13:07:38.569954 26166 consensus_queue.cc:1059] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:07:38.270612 26144 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.588707 26181 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.597602 26149 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:38.597821 26120 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:07:38.598026 26029 consensus_queue.cc:1059] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:38.581348 26155 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:38.596144 22575 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:38.581913 26196 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:07:38.618924 26198 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:07:38.547039 26123 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:07:38.623773 23104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 450) took 2304 ms. Trace:
I20260709 13:07:38.531500 26119 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.613451 25922 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:38.631234 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 112226us
W20260709 13:07:38.658238 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 82084.1us
I20260709 13:07:38.593935 26067 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.594545 26188 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:38.640202 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.647670 23107 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:38.591552 26127 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.660882 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:38.654815 23079 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:38.665614 23079 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:38.625454 26149 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:38.669783 23079 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:38.666289 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:38.595330 26122 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.632767 26204 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:38.627161 26177 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.646035 23104 rpcz_store.cc:276] 0709 13:07:36.306454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.307471 (+  1017us) service_pool.cc:224] Handling call
0709 13:07:36.307793 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.308169 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.308197 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.308704 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.618003 (+309299us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:37.015297 (+397294us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.580961 (+565664us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b1800404c20. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d35522 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:07:38.473085 (+892124us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b1800404c20. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f006ce1a060 00007f006ce2c716 00007f006ce3d287 00007f006ce3d208
0709 13:07:38.547335 (+ 74250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.610278 (+ 62943us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.610354 (+    76us) raft_consensus.cc:1685] finished
0709 13:07:38.610372 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.610566 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73353,"prepare.queue_time_us":395137,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":45869,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":21400,"spinlock_wait_cycles":26124416,"thread_start_us":350638,"threads_started":2,"wal-append.queue_time_us":896100}
I20260709 13:07:38.620774 26193 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.641431 26155 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:38.632517 25887 raft_consensus.cc:3055] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.696524 26199 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.696460 26227 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.697082 26199 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.697407 26227 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.684811 25922 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:38.698879 25922 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:38.699033 26112 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:38.699597 26227 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:38.664341 26120 raft_consensus.cc:3055] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:38.699378 25922 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:38.703404 22474 leader_election.cc:336] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.089s (SENT)
I20260709 13:07:38.709115 22474 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:38.705207 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45703.3us
I20260709 13:07:38.696424 26155 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.686512 26149 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.672763 26216 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.718076 22474 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.150s (SENT)
I20260709 13:07:38.721117 22474 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:38.718782 26228 raft_consensus.cc:2764] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:38.723484 26143 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:38.723707 26181 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.724164 26143 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.726517 26220 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.727083 26220 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.729231 26190 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.729501 26220 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:38.729861 26190 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.730378 26031 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.733467 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 440) took 1195 ms. Trace:
I20260709 13:07:38.733906 22425 rpcz_store.cc:276] 0709 13:07:37.538017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.538188 (+   171us) service_pool.cc:224] Handling call
0709 13:07:37.605320 (+ 67132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.390564 (+785244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.733205 (+342641us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b540043bf54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:38.733389 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1801995520}
I20260709 13:07:38.734964 26193 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.737593 25999 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:38.740072 25999 consensus_queue.cc:1059] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:38.741727 26114 raft_consensus.cc:3055] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:38.742159 26114 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:38.743085 26227 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:38.742977 26114 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.744292 26114 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:38.745204 22474 leader_election.cc:336] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.166s (SENT)
I20260709 13:07:38.745651 22474 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:38.746531 26194 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:38.747241 26194 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.749076 26119 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:38.750025 26223 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:38.750656 22429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2419) took 1504 ms. Trace:
I20260709 13:07:38.650360 26150 consensus_queue.cc:260] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.751046 22429 rpcz_store.cc:276] 0709 13:07:37.247113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.247587 (+   474us) service_pool.cc:224] Handling call
0709 13:07:37.354081 (+106494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.632624 (+278543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.632657 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.633190 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.054785 (+421595us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:38.054845 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.750243 (+695398us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5400389fd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:38.750304 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.750345 (+    41us) raft_consensus.cc:1685] finished
0709 13:07:38.750358 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.750589 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":186544,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"spinlock_wait_cycles":59420032,"thread_start_us":673419,"threads_started":2,"wal-append.queue_time_us":627248}
W20260709 13:07:38.752264 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.753144 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.753755 22574 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:38.753944 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.754371 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.754542 22501 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:38.755484 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1756) took 1649 ms. Trace:
I20260709 13:07:38.755838 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.755851 22580 rpcz_store.cc:276] 0709 13:07:37.116821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.116976 (+   155us) service_pool.cc:224] Handling call
0709 13:07:37.128350 (+ 11374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:37.353856 (+225506us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:38.029766 (+675910us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.436249 (+406483us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.436467 (+   218us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:38.437172 (+   705us) log.cc:844] Serialized 52 byte log entry
0709 13:07:38.437309 (+   137us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:38.437342 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.755106 (+317764us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b5400375854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:38.755151 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.755269 (+   118us) raft_consensus.cc:1685] finished
0709 13:07:38.755286 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.755401 (+   115us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b48002601d8. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0071d4baa1 00007f0071d42b37 00007f0071d429ca 00007f0071e3a26f 00007f0071e39f37 00007f0071e4e55c 00007f0071e4e508 00007f0071e4e488 00007f0071e4e443 00007f0071e4d6ec 00007f0070d77a96
0709 13:07:38.755420 (+    19us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74052,"prepare.queue_time_us":250785,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":94,"raft.queue_time_us":35726,"raft.run_cpu_time_us":3783,"raft.run_wall_time_us":680755,"spinlock_wait_cycles":191676544,"thread_start_us":1098960,"threads_started":4,"wal-append.queue_time_us":264762}
I20260709 13:07:38.758541 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.758899 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.759495 22574 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
W20260709 13:07:38.760147 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.760303 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:38.761871 26122 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:38.762228 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.762473 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.762851 22503 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:38.756199 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.759943 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.764178 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.697513 26199 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.801927 22502 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:38.668874 26067 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.805019 22502 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:38.603854 22500 rpcz_store.cc:276] 0709 13:07:36.392580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.392683 (+   103us) service_pool.cc:224] Handling call
0709 13:07:36.396684 (+  4001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.396884 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:37.023591 (+626707us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.336354 (+1312763us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.591368 (+255014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.591424 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:38.591482 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.591549 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.591676 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":919592,"prepare.queue_time_us":836950,"prepare.run_cpu_time_us":182,"prepare.run_wall_time_us":18865,"raft.queue_time_us":1405209,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":26164,"thread_start_us":1244581,"threads_started":3,"wal-append.queue_time_us":979561}
I20260709 13:07:38.807019 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:38.814210 23107 raft_consensus.cc:2410] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:38.704697 26120 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:38.702984 25887 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:38.713156 26204 raft_consensus.cc:697] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:38.829414 26189 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:38.829628 26204 consensus_queue.cc:237] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.830312 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.819042 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.823756 22580 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:38.720309 26188 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.716262 26116 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:38.830116 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.832270 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.833009 22574 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:38.831159 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.732237 26190 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:38.818524 22474 leader_election.cc:336] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 2.247s (SENT)
I20260709 13:07:38.837584 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:38.836022 23076 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:38.838539 22504 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:38.853078 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.854803 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.855254 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.855638 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.856067 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.855453 22431 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:38.857627 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.858181 22431 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:38.859305 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.859470 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:38.860248 22430 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:38.841914 26198 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.862434 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 172716us
I20260709 13:07:38.863379 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.863345 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:38.865449 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.843892 26193 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.848537 26184 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:38.864250 22506 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
W20260709 13:07:38.863823 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 825517us
W20260709 13:07:38.881742 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63256.3us
I20260709 13:07:38.883600 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.882845 22424 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.882354 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.882123 22427 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:38.882262 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:38.804047 26216 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.850122 26195 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.890573 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:38.903293 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:38.897993 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:38.884006 26120 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.906436 22427 raft_consensus.cc:3055] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.906831 22427 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:38.906827 26127 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.908016 22427 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.908979 22427 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.917891 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.919162 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.920876 26188 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:38.920836 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:38.922222 22581 raft_consensus.cc:2376] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9. Re-sending same reply.
I20260709 13:07:38.923355 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:38.924098 22581 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:38.925127 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:38.925813 22582 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.927287 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.928601 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.932775 22474 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:38.933804 22577 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:38.897042 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.843978 26116 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:38.943269 26126 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:38.946369 26116 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:38.946514 22430 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:38.851903 26029 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:38.949806 22427 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:38.936287 22474 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:38.919080 26151 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.937184 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.939055 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.940750 26181 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.935288 26188 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:38.943248 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.968883 22499 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:38.906370 26120 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.966349 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:38.972811 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:38.980901 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.884171 26193 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:38.981199 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.005321 22581 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:38.886492 26227 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:39.001365 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 99825.5us
I20260709 13:07:38.982883 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:38.980974 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44916us
W20260709 13:07:38.986913 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.007524 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:38.965155 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 67378.6us
I20260709 13:07:39.001339 22507 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:38.981243 22582 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:39.011698 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:38.935038 26195 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.009255 22472 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:39.004215 22424 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:39.000950 22427 pending_rounds.cc:85] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 5
I20260709 13:07:39.008177 22579 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:39.013595 22582 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.014401 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.019958 22429 raft_consensus.cc:2410] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:39.016306 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.020936 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.021554 22579 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:39.018472 22427 pending_rounds.cc:107] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:39.022187 22427 raft_consensus.cc:2889] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.022532 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.023241 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.017547 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.024593 22575 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:39.014719 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:39.017271 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 76875.2us
I20260709 13:07:39.023090 22579 raft_consensus.cc:2376] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9. Re-sending same reply.
I20260709 13:07:38.907055 26069 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:07:39.014361 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.026026 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.027284 22426 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:39.028465 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:38.969719 26238 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:39.031225 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.026474 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.018947 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.008662 26193 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.005844 26122 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.033413 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.001226 26181 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:38.968065 26216 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:39.037454 22581 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:39.037611 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.068235 22399 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.068766 22575 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:38.881347 26198 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:39.048019 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.949056 26029 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:38.969470 26144 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:39.032187 26134 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:07:39.082314 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45444.1us
I20260709 13:07:39.025979 26173 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:39.096786 22472 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.028772 26127 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:39.092278 25972 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.098254 22425 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:39.085764 22582 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:39.014999 25771 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:39.089563 26067 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:38.887157 25887 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.103775 25887 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.104874 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 433) took 1797 ms. Trace:
I20260709 13:07:39.105436 22428 rpcz_store.cc:276] 0709 13:07:37.307628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.335876 (+ 28248us) service_pool.cc:224] Handling call
0709 13:07:37.336219 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.339184 (+  2965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.339215 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.515722 (+1176507us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b2c00000f48. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:38.516162 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.880743 (+364581us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:38.902962 (+ 22219us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.937232 (+ 34270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.937353 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.081960 (+144607us) raft_consensus.cc:1685] finished
0709 13:07:39.104587 (+ 22627us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.104791 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28543,"prepare.queue_time_us":22824,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":261673,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":183,"spinlock_wait_cycles":2427648,"thread_start_us":320909,"threads_started":1,"wal-append.queue_time_us":397434}
W20260709 13:07:39.109579 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.109706 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 88417.8us
W20260709 13:07:39.110345 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.110086 26108 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:39.108263 22430 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
W20260709 13:07:39.111912 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 81400.9us
I20260709 13:07:39.113317 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.017325 26227 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.090525 26029 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:39.090710 26200 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.091511 26152 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:39.091831 26230 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:39.112278 26195 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:39.060664 26238 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:39.112340 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:39.135710 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:39.073881 26143 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:39.117287 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:39.117467 22398 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:39.067312 22506 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:39.119745 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:39.139966 23104 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:39.124326 22581 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.074848 26181 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.074602 26031 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:39.027217 22507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:58706
I20260709 13:07:39.079100 26198 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:39.119234 26123 consensus_queue.cc:1175] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "10c2f471167442c0b75d8cd50ed8c40c" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 8 index: 5 } }
I20260709 13:07:39.240821 22427 raft_consensus.cc:2410] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:39.242944 22431 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:39.153276 22576 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:39.161847 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.194511 22502 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:39.153124 22506 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:39.141793 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45082.8us
I20260709 13:07:39.181241 23104 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:39.141568 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.246929 22428 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:39.243345 22507 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.121940 26228 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:39.153998 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.159588 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:39.202987 26240 log.cc:927] Time spent T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:39.198860 26146 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.246320 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.283264 22502 raft_consensus.cc:2410] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:39.160830 26227 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:39.275851 22582 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 5.
W20260709 13:07:39.271873 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.248687 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:39.244733 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 82947.3us
I20260709 13:07:39.298996 22506 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:39.300806 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.301723 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.233109 25771 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:39.193100 26232 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:07:39.162186 26194 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.153892 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.315809 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:39.162003 26067 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.161113 26216 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:39.246202 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 152797us
I20260709 13:07:39.162449 26143 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:39.284132 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.332721 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.247193 26122 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.248966 22507 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.310680 25999 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:39.187681 26127 raft_consensus.cc:697] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:39.301994 26146 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:39.294116 26034 consensus_queue.cc:1175] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "10c2f471167442c0b75d8cd50ed8c40c" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:39.152486 26245 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:39.142791 26230 raft_consensus.cc:697] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:39.139381 26238 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.187973 26124 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:39.199870 26152 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:07:39.202632 26155 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.189555 26182 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.192s
I20260709 13:07:39.310174 22396 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:39.312465 25444 consensus_queue.cc:1059] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:39.319034 26173 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.318137 25771 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.320811 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:39.324373 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 170545us
I20260709 13:07:39.330693 22399 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.241537 26189 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:39.337244 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.290280 26177 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:39.316299 26194 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:39.352392 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:07:39.405164 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 52834.6us
I20260709 13:07:39.347873 22507 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.328606 26227 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.362280 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:39.357241 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:39.365070 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63542.2us
I20260709 13:07:39.414580 22508 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:39.373996 22506 raft_consensus.cc:2410] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:39.408754 26189 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:39.385706 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 75617.6us
I20260709 13:07:39.415450 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.415899 22396 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:39.416078 22508 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:39.417012 22396 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:39.418293 26114 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.418665 26114 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.414770 22474 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.401305 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.404270 22502 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:39.420125 22500 raft_consensus.cc:2393] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:39.363083 26030 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:07:39.351285 25999 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.381336 26127 consensus_queue.cc:237] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.404034 26131 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:07:39.408335 26194 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:39.409477 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 78864.2us
I20260709 13:07:39.415236 22507 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:39.420766 23106 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:39.361368 26245 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.425880 22474 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.419365 22396 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:39.418779 26149 consensus_meta.cc:287] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.000s
I20260709 13:07:39.465281 22474 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.430325 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:39.430167 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.466995 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.337169 26143 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.403357 26200 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:39.470062 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 50753.6us
I20260709 13:07:39.419046 26114 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.476286 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.426819 25972 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.471694 22474 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:39.420374 26116 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.480410 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:39.483016 22432 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:39.482502 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.485381 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.386618 26124 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.459748 26076 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.465931 26245 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.492677 22426 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.498412 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:39.495698 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:39.520165 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.415365 26181 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.516363 22582 raft_consensus.cc:1217] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Deduplicated request from leader. Original: 7.8->[8.9-8.9]   Dedup: 8.9->[]
I20260709 13:07:39.528687 22582 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:39.530927 22581 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:07:39.499917 25922 consensus_meta.cc:287] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.776s	user 0.013s	sys 0.004s
I20260709 13:07:39.517146 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.492767 25887 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:39.518672 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.520244 22432 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:39.538285 22579 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:39.486881 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.539562 22428 raft_consensus.cc:2410] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:39.468972 26084 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:39.481552 26198 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.474166 26031 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:39.484243 26200 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.523872 26124 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:39.494189 25972 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:39.533635 22573 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:39.531394 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:39.562309 22581 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:39.562840 23106 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:39.517066 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.530076 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.564035 22473 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:39.514400 22474 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:39.535943 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.565897 22580 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:39.567369 22426 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
W20260709 13:07:39.535912 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.534895 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 133664us
W20260709 13:07:39.537633 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.459087 26173 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.494920 26116 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.512367 26106 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:39.498903 26227 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:39.543702 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.568325 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.545382 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.475761 26149 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.584679 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:39.555785 26242 log.cc:927] Time spent T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:07:39.537289 26155 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:39.515038 26067 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.573010 22573 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:39.595280 22430 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
W20260709 13:07:39.571990 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 71712.3us
I20260709 13:07:39.610313 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.610536 22474 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:39.574405 22432 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:39.567776 22580 raft_consensus.cc:2955] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 2 to 7, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:07:39.580328 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.585353 22426 raft_consensus.cc:2376] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9. Re-sending same reply.
I20260709 13:07:39.574062 22428 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:39.515115 26076 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.587889 22574 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:39.554390 26198 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.622047 26198 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.622263 26194 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.557940 26200 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.625331 25999 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:39.571307 25972 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.594569 22546 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:39.544906 25887 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.631177 25887 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:39.631901 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.632673 26256 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:39.633157 26256 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.633553 26256 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:39.596068 26249 log.cc:927] Time spent T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:07:39.533454 26230 consensus_queue.cc:237] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.596799 22501 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:39.598273 26181 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:39.599360 26189 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:39.542824 25922 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.553725 26084 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.607801 26067 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:39.637001 26067 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.638482 26084 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:39.607050 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.639884 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.570801 26116 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.640802 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.618244 26106 raft_consensus.cc:697] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:39.642715 25922 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:39.642627 26106 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.644424 22503 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:39.645404 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:39.646499 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.619320 26149 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:39.620036 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:39.620918 26248 log.cc:927] Time spent T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 13:07:39.621639 26250 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:07:39.649431 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:39.651134 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.657655 22503 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:07:39.632998 26193 consensus_meta.cc:287] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.520s	user 0.000s	sys 0.009s
I20260709 13:07:39.652441 22546 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:39.659323 26189 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:39.659711 26155 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:39.660127 26155 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.660527 26155 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.659116 26193 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.662545 26193 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:39.663152 23105 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.659078 26181 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:39.656562 26084 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.665936 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.659907 26189 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:39.671479 26189 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.674012 26200 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.674908 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.590302 26204 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.667425 22546 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:39.666290 26194 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:39.652999 26199 consensus_meta.cc:287] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.828s	user 0.005s	sys 0.005s
I20260709 13:07:39.677008 26199 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.677924 26084 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:39.679335 26084 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.679705 26084 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.678435 25972 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.678711 22546 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:39.696971 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:39.697676 22546 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:39.676218 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.695847 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.646626 26076 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.709158 22546 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.716392 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.673835 26114 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.735548 22396 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.676294 26204 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:39.651060 26227 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:07:39.732089 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:39.706350 26146 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:39.782267 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 44622.6us
I20260709 13:07:39.789671 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:39.718055 26152 raft_consensus.cc:2764] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:39.723119 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.784683 26029 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:39.786545 26254 log.cc:927] Time spent T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:07:39.786260 26067 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.786963 26204 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.708649 26131 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:39.800909 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.707922 26031 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:07:39.717665 26257 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:39.802882 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 151204us
I20260709 13:07:39.805437 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.815021 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:39.812208 22503 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:39.795272 26126 raft_consensus.cc:2764] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:07:39.829174 22433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.020s	sys 0.019s
W20260709 13:07:39.830778 22433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.021s	sys 0.020s
W20260709 13:07:39.832563 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 116252us
I20260709 13:07:39.833811 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:39.834389 22574 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.803952 26146 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.837793 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.839283 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.840689 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.845198 22474 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:39.862016 22424 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.863401 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.836732 26181 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:39.862341 22573 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:39.829466 26131 raft_consensus.cc:697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:39.873734 22574 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:39.848578 26127 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.891479 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53818.9us
I20260709 13:07:39.894273 22545 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:39.895776 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.897428 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.898536 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.899399 22574 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:39.900270 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.901467 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.902360 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.903573 26257 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:39.903910 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:39.904016 26257 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:39.906416 26257 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.912232 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:39.914788 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.919023 22545 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.853399 26143 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:39.920832 22545 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:39.927490 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:39.916924 26181 raft_consensus.cc:697] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:39.937253 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.939872 26143 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.940805 26143 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:39.941355 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 95163.4us
I20260709 13:07:39.857599 26106 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:07:39.956833 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.911655 26146 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.882360 26262 raft_consensus.cc:2764] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:39.973690 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:39.975594 26181 consensus_queue.cc:237] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:39.978699 26264 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:39.957516 26227 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.901810 26155 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:39.969687 26216 consensus_meta.cc:287] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.003s
I20260709 13:07:39.966918 26124 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.957109 26269 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:39.917228 26127 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.986023 25972 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:39.988687 26199 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:39.991613 26216 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.020923 26227 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.027559 26084 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.021430 26255 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:40.029606 26127 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:40.030296 26067 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:40.031064 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:40.031180 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:40.063592 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:40.064013 22573 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.034469 26199 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.035847 22547 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:40.036586 26266 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
W20260709 13:07:40.036839 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 564200us
W20260709 13:07:40.037709 26267 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:40.039312 26116 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:39.990414 26131 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:39.997992 26114 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:40.050007 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:40.051159 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:40.055444 22508 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
W20260709 13:07:40.058578 26263 log.cc:927] Time spent T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:07:40.059506 26238 consensus_meta.cc:287] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.002s
I20260709 13:07:40.063421 26155 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:40.064312 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.065927 23107 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:40.065809 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:40.067148 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:40.041852 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 225216us
I20260709 13:07:40.077631 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:40.059651 26257 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.092274 26198 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:40.054491 26227 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.071501 26269 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.100698 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:40.103683 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 67931.5us
I20260709 13:07:40.110226 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:40.113660 22573 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:40.113653 22582 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.061334 26255 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:40.076144 26199 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:40.101637 26193 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.121908 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.124675 22426 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.128950 26199 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:40.131067 26257 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:40.094910 26238 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:40.136770 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 216009us
I20260709 13:07:40.138408 22545 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.148864 22582 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:40.149974 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:40.150596 22582 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.126226 26198 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:40.154392 22504 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:40.126315 26193 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:40.141950 26257 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:40.160225 26257 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.162420 26257 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:40.144977 26275 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.165149 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2489) took 1342 ms. Trace:
I20260709 13:07:40.165892 22505 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:40.167815 26283 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:40.175056 22576 rpcz_store.cc:276] 0709 13:07:38.822662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.938826 (+116164us) service_pool.cc:224] Handling call
0709 13:07:40.164948 (+1226122us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540016d0d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:40.165087 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397939456}
I20260709 13:07:40.162606 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 492) took 1407 ms. Trace:
I20260709 13:07:40.158088 26084 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:40.176954 22501 rpcz_store.cc:276] 0709 13:07:38.755495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.755594 (+    99us) service_pool.cc:224] Handling call
0709 13:07:40.162356 (+1406762us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b540021b1d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:40.162515 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922471296}
I20260709 13:07:40.178310 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:40.180940 26195 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:40.181489 26195 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.183275 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1706) took 1361 ms. Trace:
I20260709 13:07:40.183702 22500 rpcz_store.cc:276] 0709 13:07:38.821530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.829848 (+  8318us) service_pool.cc:224] Handling call
0709 13:07:40.183067 (+1353219us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54003eb554. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:40.183214 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336135424}
I20260709 13:07:40.184845 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.186012 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.177119 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:40.190629 22396 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.191852 22426 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:40.193979 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.158018 26193 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.197844 22576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:07:40.198689 22576 raft_consensus.cc:606] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.199265 22582 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
W20260709 13:07:40.186118 26274 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.080s	user 0.000s	sys 0.003s
I20260709 13:07:40.200574 22582 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:40.226609 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.227811 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.224568 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.228967 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.168941 26076 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.233157 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.197861 26132 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.241712 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.243266 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.243999 23077 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:40.244258 26284 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:40.243372 22432 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:07:40.249250 26195 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:40.253063 26228 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:40.256421 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.258215 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1716) took 1130 ms. Trace:
I20260709 13:07:40.263387 22507 rpcz_store.cc:276] 0709 13:07:39.127904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.487999 (+360095us) service_pool.cc:224] Handling call
0709 13:07:39.488362 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.798686 (+310324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.798722 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.799228 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.940698 (+141470us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:39.940738 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.940815 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.257942 (+317127us) raft_consensus.cc:1685] finished
0709 13:07:40.257963 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.258119 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42810,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8586,"thread_start_us":400919,"threads_started":2,"wal-append.queue_time_us":252972}
I20260709 13:07:40.260344 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.265215 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.265856 22507 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:40.267022 22545 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:40.270170 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.273162 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.274570 22507 raft_consensus.cc:2410] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:40.276518 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.277205 22501 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:40.277319 22545 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.286708 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.288878 22546 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:40.269619 26256 consensus_meta.cc:287] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
I20260709 13:07:40.290949 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.258781 26200 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:40.292588 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.290970 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.296223 22430 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:40.297356 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.300154 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:40.300195 23076 leader_election.cc:336] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 2.050s (SENT)
I20260709 13:07:40.301862 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:40.304461 22545 leader_election.cc:336] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.613s (SENT)
I20260709 13:07:40.278347 26257 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:40.315178 22578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1767) took 2673 ms (client timeout 2299 ms). Trace:
I20260709 13:07:40.281206 26116 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:40.313088 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.317696 22507 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:40.291276 26146 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:40.304103 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.315208 22545 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:40.315650 22578 rpcz_store.cc:269] 0709 13:07:37.630638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.000631 (+369993us) service_pool.cc:224] Handling call
0709 13:07:40.303435 (+2302804us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400047754. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:40.303571 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411361024}
I20260709 13:07:40.322458 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.316516 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:40.292361 26189 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.332425 22501 raft_consensus.cc:2393] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:40.318624 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:40.286585 26238 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:40.335567 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:40.292568 26273 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.319769 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.331554 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:40.290026 26255 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:40.300848 26256 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:40.275046 26227 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:40.335567 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.359015 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.360143 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.361311 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.361390 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:40.362035 22578 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.362401 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.278144 26269 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:07:40.363305 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.363897 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.303643 26272 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.354562 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.364884 26255 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:40.365337 26255 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:40.333155 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.365711 26255 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.366717 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.366933 26195 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:40.367551 22430 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:40.336802 26116 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.368443 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.369828 22426 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:40.312850 26143 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:40.370967 26253 log.cc:927] Time spent T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.963s	user 0.004s	sys 0.000s
W20260709 13:07:40.323597 26245 consensus_meta.cc:287] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.786s	user 0.011s	sys 0.000s
I20260709 13:07:40.342132 26132 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.371842 26245 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:40.371848 22425 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1554) took 1517 ms (client timeout 1827 ms). Trace:
W20260709 13:07:40.373224 22425 rpcz_store.cc:269] 0709 13:07:38.854160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.854275 (+   115us) service_pool.cc:224] Handling call
0709 13:07:40.371683 (+1517408us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400275954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:40.371791 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495017856}
I20260709 13:07:40.370227 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:40.319239 26257 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:40.374143 26245 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:40.374500 26257 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.374975 22424 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:40.375622 22574 raft_consensus.cc:2368] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7.
I20260709 13:07:40.376003 26238 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:40.372850 26269 raft_consensus.cc:3055] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:40.374442 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.377483 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.376690 26269 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:40.376595 26238 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.378798 26269 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.380800 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.380934 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.381601 22426 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:40.355532 22399 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.381935 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.383033 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.383618 22432 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.384330 26124 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:40.384871 26124 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.384341 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.386883 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.387825 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.381765 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1702) took 1572 ms. Trace:
I20260709 13:07:40.389243 22505 rpcz_store.cc:276] 0709 13:07:38.809569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.809741 (+   172us) service_pool.cc:224] Handling call
0709 13:07:40.165717 (+1355976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.174768 (+  9051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.381598 (+206830us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540021b1d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce218ad 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:40.381709 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3117668224}
I20260709 13:07:40.398284 26076 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:40.400676 26269 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.402386 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1564) took 1544 ms. Trace:
I20260709 13:07:40.382929 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.402794 22433 rpcz_store.cc:276] 0709 13:07:38.858007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.882958 (+ 24951us) service_pool.cc:224] Handling call
0709 13:07:38.883298 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.083741 (+200443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.083770 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.112933 (+ 29163us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.831273 (+718340us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:39.903377 (+ 72104us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.903580 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.402001 (+498421us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54001e7dd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:40.402047 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.402094 (+    47us) raft_consensus.cc:1685] finished
0709 13:07:40.402189 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.402326 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2790,"prepare.queue_time_us":125540,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":10645,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":174,"spinlock_wait_cycles":453472512,"thread_start_us":746841,"threads_started":2,"wal-append.queue_time_us":860265}
I20260709 13:07:40.404512 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.407599 26230 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.406653 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:40.414091 22575 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.406924 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.377766 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.407781 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.407938 25771 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:40.408711 26256 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:40.420048 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1713) took 1524 ms. Trace:
I20260709 13:07:40.422878 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:40.423733 23111 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:40.409034 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.423805 22578 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:40.409981 26029 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:40.370652 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.421134 22499 rpcz_store.cc:276] 0709 13:07:38.895633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.111713 (+216080us) service_pool.cc:224] Handling call
0709 13:07:39.112110 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.154329 (+ 42219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.154363 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.332760 (+178397us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b2c0000e678. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:39.333194 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.390622 (+ 57428us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:39.456712 (+ 66090us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.683364 (+226652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.683439 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.026883 (+343444us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b180035c980. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d032a6 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db
0709 13:07:40.370405 (+343522us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:40.419834 (+ 49429us) raft_consensus.cc:1685] finished
0709 13:07:40.419857 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.419987 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77992,"prepare.queue_time_us":66614,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":121852,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":12844,"spinlock_wait_cycles":37970944,"thread_start_us":215418,"threads_started":2,"wal-append.queue_time_us":70274}
I20260709 13:07:40.427837 22579 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:40.431341 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:40.431989 23113 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:07:40.411656 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 56209.7us
I20260709 13:07:40.415784 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:40.419153 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:40.438436 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.409126 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.417150 22426 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:40.439416 22501 raft_consensus.cc:2393] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 6: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:40.425024 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:40.405436 26204 consensus_meta.cc:287] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.592s	user 0.012s	sys 0.000s
W20260709 13:07:40.441035 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 135532us
I20260709 13:07:40.442862 22575 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
W20260709 13:07:40.444067 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 198897us
I20260709 13:07:40.447188 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.450301 23077 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:40.441776 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.451779 22433 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:40.413452 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.452392 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.452598 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.456689 23077 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:40.459532 22433 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:40.457054 22431 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:40.465785 22431 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:40.467289 22431 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:40.468881 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:40.419965 26238 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:40.473378 22399 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.468981 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.470165 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:40.471208 22428 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12. Ops: [8.4-11.6]
I20260709 13:07:40.459159 22546 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.469682 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:40.475301 23107 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.473166 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:40.475975 22428 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:40.435999 26166 raft_consensus.cc:3055] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:40.485298 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:40.478847 22430 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:40.481182 22428 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:40.482959 22432 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:40.483942 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1571) took 1539 ms. Trace:
I20260709 13:07:40.485960 22499 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.486739 22427 rpcz_store.cc:276] 0709 13:07:38.944643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.023018 (+ 78375us) service_pool.cc:224] Handling call
0709 13:07:40.483700 (+1460682us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54001e78d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:40.483870 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498296064}
I20260709 13:07:40.451274 26228 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.494654 26273 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:40.413429 26193 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:40.421591 26120 consensus_queue.cc:1059] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:07:40.471094 26247 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.461513 26177 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.504463 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:40.472445 26243 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.008s	sys 0.010s
I20260709 13:07:40.494555 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:40.498503 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:40.513737 26243 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.404s	user 0.009s	sys 0.010s
I20260709 13:07:40.486132 22431 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:40.473225 26030 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.506132 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:40.485548 26166 raft_consensus.cc:740] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:40.527379 22499 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:40.528761 22582 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:40.542495 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:40.542848 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:40.543581 22396 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:40.544696 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:40.546042 22582 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:40.547140 22582 raft_consensus.cc:1240] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:40.457886 26204 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:40.486549 25444 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:07:40.487067 26140 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:07:40.565865 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:40.566577 22499 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.568056 22545 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.501022 25972 consensus_queue.cc:1059] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:07:40.591864 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.596120 22501 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:40.596345 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.505373 26152 consensus_queue.cc:1059] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:07:40.598727 22500 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:40.610638 22499 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:40.611755 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.612576 22499 raft_consensus.cc:2393] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:40.590524 26120 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.613868 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1563) took 1362 ms. Trace:
I20260709 13:07:40.614301 22506 rpcz_store.cc:276] 0709 13:07:39.251787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.300311 (+ 48524us) service_pool.cc:224] Handling call
0709 13:07:40.613663 (+1313352us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b54004263d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:40.613807 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165257600}
I20260709 13:07:40.615339 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:40.616015 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.559702 26273 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:40.616659 22545 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:40.625111 26189 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.625555 26189 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.625950 26189 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.625566 26120 raft_consensus.cc:697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:40.627079 26120 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.629907 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:40.631325 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:40.633538 26146 raft_consensus.cc:3055] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:40.633975 26146 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:40.634747 26146 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.635947 26146 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:40.637212 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.619696 26131 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.640499 26189 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.621289 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.643026 22506 raft_consensus.cc:2376] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7. Re-sending same reply.
I20260709 13:07:40.643481 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1579) took 1043 ms. Trace:
I20260709 13:07:40.643747 22506 rpcz_store.cc:276] 0709 13:07:39.600606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.621030 (+1020424us) service_pool.cc:224] Handling call
0709 13:07:40.643432 (+ 22402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.641175 26230 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.663309 26189 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:40.669970 23077 leader_election.cc:336] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.720s (SENT)
W20260709 13:07:40.671427 23077 leader_election.cc:336] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.948s (SENT)
I20260709 13:07:40.671881 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.672123 26150 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.677626 23105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 682) took 1438 ms. Trace:
I20260709 13:07:40.678102 23105 rpcz_store.cc:276] 0709 13:07:39.239410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.239571 (+   161us) service_pool.cc:224] Handling call
0709 13:07:39.239944 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.663547 (+423603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.677328 (+1013781us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54002062d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:40.677549 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972869376}
W20260709 13:07:40.678833 26252 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 1.158s	user 0.000s	sys 0.003s
I20260709 13:07:40.680171 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2474) took 2028 ms. Trace:
I20260709 13:07:40.680567 22577 rpcz_store.cc:276] 0709 13:07:38.652188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.029212 (+377024us) service_pool.cc:224] Handling call
0709 13:07:39.084263 (+ 55051us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.084621 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.084649 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.116018 (+ 31369us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.359442 (+243424us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:39.359480 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.360555 (+  1075us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.678260 (+1317705us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:40.679859 (+  1599us) raft_consensus.cc:1685] finished
0709 13:07:40.679879 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.680099 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4058,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4410,"spinlock_wait_cycles":33713408,"thread_start_us":193858,"threads_started":1,"wal-append.queue_time_us":265494}
I20260709 13:07:40.685017 23110 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:07:40.685858 26292 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:40.688525 26265 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:40.695004 26177 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:40.698539 23077 leader_election.cc:336] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.050s (SENT)
I20260709 13:07:40.699544 23077 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.700114 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:40.700758 22501 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.701891 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.600488 26227 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.725010 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:40.725673 22502 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.599495 22328 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 7 to 9, now has a pending config: VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1), VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2), VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3), VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 9 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:40.732904 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:40.733632 22545 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:40.739462 22499 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:40.740584 23077 leader_election.cc:336] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.016s (SENT)
I20260709 13:07:40.741104 23077 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:40.720726 25444 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.712868 26199 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.696241 26257 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.767391 22502 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:40.769102 22396 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:40.791659 22502 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:40.762765 26227 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.792419 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1720) took 1652 ms. Trace:
I20260709 13:07:40.794032 22499 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
W20260709 13:07:40.887358 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 392870us
I20260709 13:07:40.916054 26166 consensus_queue.cc:260] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.797003 22502 rpcz_store.cc:276] 0709 13:07:39.139765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.789887 (+1650122us) service_pool.cc:224] Handling call
0709 13:07:40.791487 (+  1600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.792159 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.792362 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.117480 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 504) took 1297 ms. Trace:
I20260709 13:07:41.143009 22500 rpcz_store.cc:276] 0709 13:07:39.820299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.185789 (+365490us) service_pool.cc:224] Handling call
0709 13:07:40.931763 (+745974us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540021c0d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:41.117419 (+185656us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943137664}
I20260709 13:07:41.144960 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1573) took 1733 ms. Trace:
I20260709 13:07:41.145428 22500 rpcz_store.cc:276] 0709 13:07:39.412013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.144016 (+1732003us) service_pool.cc:224] Handling call
0709 13:07:41.144344 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.144609 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.144636 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.144682 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:41.144715 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.144781 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.144901 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.787634 26273 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:40.770509 26304 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:41.157196 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.158389 22508 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.159006 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 459) took 1318 ms. Trace:
I20260709 13:07:41.159134 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1721) took 2016 ms. Trace:
I20260709 13:07:41.128798 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55062 (request call id 455) took 1289 ms. Trace:
I20260709 13:07:41.160032 22574 rpcz_store.cc:276] 0709 13:07:39.839181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.903285 (+ 64104us) service_pool.cc:224] Handling call
0709 13:07:40.910489 (+1007204us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400046854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:41.128740 (+218251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081346304}
I20260709 13:07:41.159409 22580 rpcz_store.cc:276] 0709 13:07:39.840144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.903921 (+ 63777us) service_pool.cc:224] Handling call
0709 13:07:39.904263 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.904463 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:39.961997 (+ 57534us) log.cc:844] Serialized 14 byte log entry
0709 13:07:40.912920 (+950923us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b18003619c0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f006c9ca4bc 00007f0069d1848b 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b 00007f006c9c1d23 00007f006c9c223a
0709 13:07:41.158628 (+245708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.158688 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:41.158737 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.158816 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.158943 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39883,"prepare.queue_time_us":32221,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"spinlock_wait_cycles":20490496,"thread_start_us":80650,"threads_started":2,"wal-append.queue_time_us":93836,"wal-append.run_cpu_time_us":1088,"wal-append.run_wall_time_us":1020351}
I20260709 13:07:41.120388 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:40.785650 26140 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:41.121343 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.121706 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:41.131527 22474 leader_election.cc:336] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.891s (SENT)
I20260709 13:07:41.131709 22499 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: [8.5-10.6]
W20260709 13:07:41.126554 23107 consensus_meta.cc:287] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.647s	user 0.005s	sys 0.005s
I20260709 13:07:41.124466 22501 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
W20260709 13:07:41.136703 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.119831 23077 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 2.391s (SENT)
I20260709 13:07:41.147354 22502 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:41.153898 22507 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:41.154554 23113 consensus_meta.cc:287] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.722s	user 0.017s	sys 0.000s
I20260709 13:07:41.163515 22505 raft_consensus.cc:2393] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:41.159555 22508 rpcz_store.cc:276] 0709 13:07:39.143012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.152905 (+2009893us) service_pool.cc:224] Handling call
0709 13:07:41.153261 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.158883 (+  5622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.159076 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.172068 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:41.172147 23107 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:41.149442 26149 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:41.172883 23077 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:41.136018 26132 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:41.156889 26255 consensus_meta.cc:287] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.010s
I20260709 13:07:41.188017 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1726) took 1451 ms. Trace:
I20260709 13:07:41.203264 22501 rpcz_store.cc:276] 0709 13:07:39.756090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.187201 (+1431111us) service_pool.cc:224] Handling call
0709 13:07:41.187522 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.187694 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.187719 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.187761 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:41.187801 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.187854 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.187960 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.204604 22501 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.205197 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1597) took 1410 ms. Trace:
I20260709 13:07:41.205497 22501 rpcz_store.cc:276] 0709 13:07:39.794401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.204175 (+1409774us) service_pool.cc:224] Handling call
0709 13:07:41.204432 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.204959 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.205138 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.206873 22501 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:41.207510 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 502) took 1387 ms. Trace:
I20260709 13:07:41.207815 22501 rpcz_store.cc:276] 0709 13:07:39.819776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.206275 (+1386499us) service_pool.cc:224] Handling call
0709 13:07:41.206629 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.207241 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.207449 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.189527 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1727) took 1433 ms. Trace:
I20260709 13:07:41.209197 22508 rpcz_store.cc:276] 0709 13:07:39.761577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.188718 (+1427141us) service_pool.cc:224] Handling call
0709 13:07:41.189020 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.189189 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.189217 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.189268 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:41.189301 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.189373 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.189476 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.210800 22508 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.211417 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 503) took 1391 ms. Trace:
I20260709 13:07:41.211730 22508 rpcz_store.cc:276] 0709 13:07:39.820051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.210299 (+1390248us) service_pool.cc:224] Handling call
0709 13:07:41.210617 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.211172 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.211358 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.174925 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1578) took 1614 ms. Trace:
I20260709 13:07:41.174003 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1722) took 2020 ms. Trace:
I20260709 13:07:41.173530 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:41.130146 26126 raft_consensus.cc:3055] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:41.156912 26124 consensus_meta.cc:287] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.004s
I20260709 13:07:41.182045 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1566) took 1854 ms. Trace:
I20260709 13:07:41.189555 23079 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:41.178449 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:41.216941 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 86467.7us
W20260709 13:07:41.187399 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 67609.3us
I20260709 13:07:41.174506 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1570) took 1821 ms. Trace:
I20260709 13:07:41.138049 26188 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.197599 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:41.219708 22427 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.198035 22431 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.194294 22545 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:41.137789 25771 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.224968 26257 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:41.225620 26084 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:41.226295 26084 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.227228 26243 consensus_queue.cc:1059] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:41.228307 26243 raft_consensus.cc:3055] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:41.228684 26243 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:41.228780 26188 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.229622 26243 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.230808 26243 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.231326 26188 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:41.232198 22500 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:41.232791 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2500) took 1221 ms. Trace:
I20260709 13:07:41.233249 22581 rpcz_store.cc:276] 0709 13:07:40.011127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.413588 (+402461us) service_pool.cc:224] Handling call
0709 13:07:40.413901 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.414238 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.414265 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.414715 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.117200 (+702485us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:41.117252 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.118536 (+  1284us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.232564 (+114028us) raft_consensus.cc:1685] finished
0709 13:07:41.232582 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.232724 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":400259,"threads_started":1,"wal-append.queue_time_us":810328}
I20260709 13:07:41.234350 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1718) took 2105 ms. Trace:
I20260709 13:07:41.226895 26304 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:41.235394 26304 raft_consensus.cc:697] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:41.236652 26189 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:41.237289 26189 raft_consensus.cc:697] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:41.238313 26189 consensus_queue.cc:237] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.202070 22574 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:41.202471 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:41.212574 22505 rpcz_store.cc:276] 0709 13:07:39.560648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.390202 (+829554us) service_pool.cc:224] Handling call
0709 13:07:40.909258 (+519056us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b5800002d98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071de80a0 00007f0071de7984 00007f006b3626d4 00007f006b362662
0709 13:07:41.174863 (+265605us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65924352}
I20260709 13:07:41.216225 26126 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.215632 26275 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:41.243152 26204 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:41.175388 23113 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:41.214838 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:41.170538 26146 consensus_meta.cc:287] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.008s
I20260709 13:07:41.215844 22580 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:41.216735 22501 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:41.246099 26311 log.cc:927] Time spent T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:07:41.246697 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 506) took 1059 ms. Trace:
W20260709 13:07:41.247396 22327 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43174 (request call id 254) took 18787 ms (client timeout 15000 ms). Trace:
I20260709 13:07:41.246605 23079 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:07:41.249284 26150 consensus_meta.cc:287] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 13:07:41.248909 22328 catalog_manager.cc:5697] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 6 to 7, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 7 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.249996 22429 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:41.250358 23079 leader_election.cc:400] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7.
I20260709 13:07:41.250705 22328 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:41.251981 22429 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1573) took 2306 ms (client timeout 2702 ms). Trace:
I20260709 13:07:41.212846 22507 rpcz_store.cc:276] 0709 13:07:39.153186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.153439 (+2000253us) service_pool.cc:224] Handling call
0709 13:07:41.153710 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.173763 (+ 20053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.173952 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.169716 26230 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.253587 26230 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.243178 26275 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.255774 26230 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:41.219038 22502 rpcz_store.cc:276] 0709 13:07:39.353428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.142151 (+1788723us) service_pool.cc:224] Handling call
0709 13:07:41.142655 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.174231 (+ 31576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.174454 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.193696 22547 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:41.247136 22501 rpcz_store.cc:276] 0709 13:07:40.186905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.213935 (+1027030us) service_pool.cc:224] Handling call
0709 13:07:41.216391 (+  2456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.246449 (+ 30058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.246638 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:41.257786 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 64185us
I20260709 13:07:41.258255 25771 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:41.223655 26255 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.236299 26304 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.258551 22547 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:41.260022 26257 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:41.260401 26255 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:41.199245 26166 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.214277 22433 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:41.256315 26275 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:41.249171 26199 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:41.223291 22508 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.132236 26280 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.262705 26280 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:41.262893 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1603) took 1113 ms. Trace:
I20260709 13:07:41.249233 26126 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.264077 26084 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:41.217211 22499 rpcz_store.cc:276] 0709 13:07:39.327556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.131057 (+1803501us) service_pool.cc:224] Handling call
0709 13:07:41.131448 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:41.181704 (+ 50256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.181981 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.263626 26280 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.234872 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1574) took 1778 ms. Trace:
I20260709 13:07:41.265031 26280 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:41.265337 26309 log.cc:927] Time spent T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:41.252326 22328 catalog_manager.cc:5697] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 4 to 7, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 7 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.171247 26281 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.263689 22508 rpcz_store.cc:276] 0709 13:07:40.149779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.222742 (+1072963us) service_pool.cc:224] Handling call
0709 13:07:41.223048 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.262634 (+ 39586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.262838 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.267431 26193 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:41.268436 22508 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:41.217818 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:41.275139 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:41.275293 22503 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:41.277153 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1576) took 1763 ms. Trace:
I20260709 13:07:41.277591 22503 rpcz_store.cc:276] 0709 13:07:39.513460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.171349 (+1657889us) service_pool.cc:224] Handling call
0709 13:07:41.218706 (+ 47357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.276823 (+ 58117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.277065 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.259771 26227 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:41.252377 22429 rpcz_store.cc:269] 0709 13:07:38.945164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.020578 (+ 75414us) service_pool.cc:224] Handling call
0709 13:07:41.251797 (+2231219us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b5400274f54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:41.251899 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4998497152}
I20260709 13:07:41.169930 26216 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:41.288494 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:41.288341 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 129950us
I20260709 13:07:41.234699 22506 rpcz_store.cc:276] 0709 13:07:39.129301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.690392 (+1561091us) service_pool.cc:224] Handling call
0709 13:07:40.690737 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.691099 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.691129 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.691612 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.804447 (+112835us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:40.804514 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.814789 (+ 10275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.234147 (+419358us) raft_consensus.cc:1685] finished
0709 13:07:41.234166 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.234295 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2811,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":112239,"threads_started":1,"wal-append.queue_time_us":540914}
I20260709 13:07:41.293898 22506 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.265002 22500 rpcz_store.cc:276] 0709 13:07:39.456941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.146592 (+1689651us) service_pool.cc:224] Handling call
0709 13:07:41.146897 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.232596 (+ 85699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.234603 (+  2007us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b5400426dd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:41.234809 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195257728}
I20260709 13:07:41.295374 22499 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.272439 22507 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 4. Current term is 6. Ops: []
I20260709 13:07:41.306172 22427 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:41.299010 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:41.309362 23111 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 7: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:41.193696 26132 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.262527 26199 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:41.216362 26143 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:41.181834 26152 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:41.320562 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:41.220597 26131 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:41.347527 26131 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.307263 25771 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:41.349046 25771 raft_consensus.cc:697] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:41.270788 25922 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:41.316901 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:41.350473 22580 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:41.321195 26256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.020s	sys 0.021s
I20260709 13:07:41.350031 25771 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.299918 26029 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.296725 26238 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:41.192852 26149 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.367251 22580 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:41.465883 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 462) took 1624 ms. Trace:
W20260709 13:07:41.247799 22327 rpcz_store.cc:269] 0709 13:07:22.459679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.459861 (+   182us) service_pool.cc:224] Handling call
0709 13:07:41.247323 (+18787462us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:34.531634 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:34.674311 (+142677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:34.674366 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:07:34.674384 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:34.680752 (+  6368us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:34.680857 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:34.680884 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:07:34.729007 (+ 48123us) tablet.cc:701] Row locks acquired
0709 13:07:34.729055 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:07:34.729231 (+   176us) write_op.cc:270] Start()
0709 13:07:34.729403 (+   172us) write_op.cc:276] Timestamp: P: 1783602454729156 usec, L: 0
0709 13:07:34.729419 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:07:34.730148 (+   729us) log.cc:844] Serialized 7430 byte log entry
0709 13:07:34.916389 (+186241us) op_driver.cc:464] REPLICATION: finished
0709 13:07:34.931511 (+ 15122us) write_op.cc:301] APPLY: starting
0709 13:07:34.931606 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:34.931962 (+   356us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:34.932091 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:34.975037 (+ 42946us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:34.975316 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:07:34.975360 (+    44us) write_op.cc:312] APPLY: finished
0709 13:07:34.975723 (+   363us) log.cc:844] Serialized 132 byte log entry
0709 13:07:34.986065 (+ 10342us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:34.986296 (+   231us) write_op.cc:454] Released schema lock
0709 13:07:34.986359 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:35.009141 (+ 22782us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:35.009172 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1893440,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":14861,"apply.run_cpu_time_us":4458,"apply.run_wall_time_us":77592,"num_ops":19,"prepare.queue_time_us":110779,"prepare.run_cpu_time_us":26795,"prepare.run_wall_time_us":311449,"raft.queue_time_us":6192,"raft.run_cpu_time_us":1267,"raft.run_wall_time_us":41628,"replication_time_us":186799,"thread_start_us":148818,"threads_started":4,"wal-append.queue_time_us":88778,"wal-append.run_cpu_time_us":4432,"wal-append.run_wall_time_us":1157565}]]}
W20260709 13:07:41.445188 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 313503us
I20260709 13:07:41.466511 22576 rpcz_store.cc:276] 0709 13:07:39.840919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.235327 (+394408us) service_pool.cc:224] Handling call
0709 13:07:40.235658 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.235987 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.236014 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.683334 (+447320us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b1800201dc0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d032a6 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a
0709 13:07:40.702398 (+ 19064us) spinlock_profiling.cc:243] Waited 6.56 ms on lock 0x7b2c000fc268. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:40.721409 (+ 19011us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.194481 (+473072us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:41.194550 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.194673 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.465072 (+270399us) raft_consensus.cc:1685] finished
0709 13:07:41.465110 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.465501 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3639,"spinlock_wait_cycles":55965440,"thread_start_us":472682,"threads_started":1,"wal-append.queue_time_us":674829}
W20260709 13:07:41.469305 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.446260 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 144919us
W20260709 13:07:41.447443 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 202057us
W20260709 13:07:41.477301 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.477566 22399 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:41.322345 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 52010.1us
I20260709 13:07:41.451002 22328 catalog_manager.cc:5697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 4 to 5, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 5 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.487066 22328 catalog_manager.cc:5697] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 6 to 9, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 9 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.491077 22328 catalog_manager.cc:5697] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.494076 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:41.480396 22399 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:41.462716 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 268377us
I20260709 13:07:41.281459 26124 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.360411 26126 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:41.382339 26269 consensus_meta.cc:287] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.981s	user 0.013s	sys 0.002s
I20260709 13:07:41.497366 25444 consensus_queue.cc:1059] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:41.376279 26132 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.352804 26143 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.518594 26143 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:41.499708 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:41.500067 26243 consensus_queue.cc:1059] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:41.500756 26076 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:41.309298 26216 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.503660 26238 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:41.503903 26230 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:41.341730 26199 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:41.359099 26256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.021s	sys 0.021s
I20260709 13:07:41.506003 25922 consensus_queue.cc:1059] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:41.511694 26149 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:41.359735 26152 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.561051 22474 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:41.562268 26152 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:41.410882 26310 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:07:41.494170 23110 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:41.329267 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.526755 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:41.527334 26076 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.528959 25444 raft_consensus.cc:3055] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.530038 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:41.530581 22432 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:41.521080 26319 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:41.538163 26230 raft_consensus.cc:697] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.611279 26230 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.612975 22501 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:41.538486 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:41.541005 22502 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.541882 26124 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:41.555912 26238 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.558964 25922 raft_consensus.cc:3055] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.565719 26181 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:41.494212 22328 catalog_manager.cc:5697] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 3 to 6, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 6 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.607482 26166 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:41.614605 26149 consensus_queue.cc:1059] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:41.624519 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49350.2us
I20260709 13:07:41.606256 25444 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.617347 25922 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:41.618451 26319 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:41.641983 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1719) took 2505 ms. Trace:
I20260709 13:07:41.647342 22328 catalog_manager.cc:5697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 3 to 6, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 6 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.660348 26238 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:41.642704 25444 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.663383 25444 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.664629 26181 raft_consensus.cc:697] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:41.664839 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 184694us
I20260709 13:07:41.666050 26181 consensus_queue.cc:237] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.669503 26216 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:41.642803 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:41.648525 22547 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:41.672221 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 115120us
W20260709 13:07:41.672995 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.673549 23077 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:41.673851 26256 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:41.674557 26256 raft_consensus.cc:697] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:41.659843 22328 catalog_manager.cc:5697] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.634660 26166 raft_consensus.cc:697] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.677965 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:41.677785 26256 consensus_queue.cc:237] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.646128 26076 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:41.652969 22504 rpcz_store.cc:276] 0709 13:07:39.129901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.675257 (+1545356us) service_pool.cc:224] Handling call
0709 13:07:40.675705 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.676056 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.676085 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.676570 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.754062 (+ 77492us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:40.754105 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.754179 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.410172 (+655993us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:41.607126 (+196954us) raft_consensus.cc:1685] finished
0709 13:07:41.616058 (+  8932us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.635175 (+ 19117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7603,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":31744384,"thread_start_us":77083,"threads_started":1,"wal-append.queue_time_us":523673}
I20260709 13:07:41.686118 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:41.686376 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:41.690619 22580 raft_consensus.cc:2410] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:07:41.693462 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.699775 22328 catalog_manager.cc:5697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:41.706324 22396 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:41.708798 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:41.710770 22427 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:41.685874 26273 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.713531 26273 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.714888 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1741) took 1308 ms. Trace:
I20260709 13:07:41.715394 22508 rpcz_store.cc:276] 0709 13:07:40.406401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.269480 (+863079us) service_pool.cc:224] Handling call
0709 13:07:41.269761 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.548370 (+278609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.548421 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.548500 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:41.548566 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.714456 (+165890us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54003d86d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:41.714503 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.714698 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626744576}
I20260709 13:07:41.716843 25922 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.718106 26122 raft_consensus.cc:3055] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:41.718429 25922 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:41.712174 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 178160us
I20260709 13:07:41.715509 22506 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:41.721342 26132 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.721616 26319 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.722376 26280 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:41.723837 26122 raft_consensus.cc:740] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:41.723960 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 153977us
I20260709 13:07:41.725111 26122 consensus_queue.cc:260] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.725914 26131 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:41.647650 26318 consensus_queue.cc:1059] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 13:07:41.727555 26318 raft_consensus.cc:3055] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:41.728048 26318 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:41.642315 26173 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
W20260709 13:07:41.688632 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47974.7us
I20260709 13:07:41.723428 26185 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:41.721630 26265 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.742244 26122 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.744037 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1610) took 1405 ms. Trace:
I20260709 13:07:41.744197 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:41.745160 22508 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:41.746053 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1739) took 1450 ms. Trace:
I20260709 13:07:41.746763 26029 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:41.749794 26120 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:41.742110 26265 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.729377 26318 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.754763 26304 raft_consensus.cc:3055] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:41.755230 26304 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:41.755781 26193 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:41.755967 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 82777.2us
I20260709 13:07:41.756763 26152 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:41.758219 26152 consensus_queue.cc:1059] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:41.759179 26152 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:41.760718 26143 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:41.761284 26143 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:41.761572 26189 raft_consensus.cc:3055] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:41.761961 26076 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.762490 26143 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.763563 26150 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.762701 26076 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.764542 26331 consensus_queue.cc:1059] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:41.765657 26331 raft_consensus.cc:3055] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.766021 26076 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:41.766103 26331 raft_consensus.cc:740] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.767048 26318 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.759196 26269 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:07:41.768172 26269 consensus_queue.cc:1243] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer e47a624c3ddb48c5a8947ac0b3e71f84 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:41.769526 26180 consensus_queue.cc:1059] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:41.771518 26307 raft_consensus.cc:3055] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:41.753628 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:41.772106 26307 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.774823 26307 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.776787 26307 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.762148 26189 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:41.780843 26304 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.780865 26193 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.746532 22502 rpcz_store.cc:276] 0709 13:07:40.295653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.256803 (+961150us) service_pool.cc:224] Handling call
0709 13:07:41.257076 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.629943 (+372867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.745758 (+115815us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54000cc6d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:41.745991 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631330560}
I20260709 13:07:41.764006 26150 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.784202 26030 consensus_queue.cc:1059] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:41.785982 26033 raft_consensus.cc:3055] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.786758 26033 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.789032 26033 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.791486 26033 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.750363 26166 consensus_queue.cc:237] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.793081 26120 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.744467 22501 rpcz_store.cc:276] 0709 13:07:40.338298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.257731 (+919433us) service_pool.cc:224] Handling call
0709 13:07:41.257992 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.613432 (+355440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.743754 (+130322us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400425ed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:41.743971 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814944128}
I20260709 13:07:41.782471 26189 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.730377 22328 catalog_manager.cc:5697] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 3 to 6, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 6 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.795499 26120 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.764047 26143 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.770272 26331 consensus_queue.cc:260] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:41.822827 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.824002 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.816570 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49792 (request call id 507) took 1621 ms. Trace:
I20260709 13:07:41.716034 26273 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:41.830286 26304 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:41.880739 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 97533.7us
I20260709 13:07:41.883040 26189 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.846240 22505 rpcz_store.cc:276] 0709 13:07:40.195269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.241500 (+1046231us) service_pool.cc:224] Handling call
0709 13:07:41.241817 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.242010 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:41.457218 (+215208us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.690514 (+233296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.738632 (+ 48118us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:41.815821 (+ 77189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.815986 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.816272 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52462,"prepare.queue_time_us":161603,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":60167,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9744,"thread_start_us":384486,"threads_started":2,"wal-append.queue_time_us":223030}
I20260709 13:07:41.799737 26150 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.899631 26150 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.900646 26257 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:41.901285 26257 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.903712 26257 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:41.905263 22580 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:41.908771 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:41.909689 22581 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:41.909878 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:41.911458 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:41.912200 22574 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.912810 26281 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:41.913385 26281 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.915693 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:41.915822 26281 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:41.917155 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:41.908931 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:41.919566 25444 consensus_queue.cc:1059] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:41.920450 26030 raft_consensus.cc:3055] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.920923 26030 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.921900 26030 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.923666 26030 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.846464 26140 raft_consensus.cc:697] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:41.953413 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:41.954387 26265 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:41.955757 22328 catalog_manager.cc:5697] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:41.953402 26140 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.957880 22328 catalog_manager.cc:5697] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 3 to 5, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 5 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
W20260709 13:07:41.939507 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.961591 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:41.963006 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:41.963987 22430 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:41.965821 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:41.966125 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:41.966529 22501 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:41.963078 22576 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.904279 26257 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.968858 26257 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.970072 26273 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:41.970750 26273 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:41.946602 26281 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:41.949908 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:41.971907 26281 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.972664 26033 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:41.974990 26257 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:41.981751 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 260010us
I20260709 13:07:41.986207 26294 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:41.988351 26152 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:41.991602 22427 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:41.959578 22328 catalog_manager.cc:5697] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 3 to 6, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 6 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.998291 22574 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
W20260709 13:07:42.021001 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.026472 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:41.988376 26294 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:42.002072 26273 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.049921 22576 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:42.053504 22580 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:42.054190 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.054536 26243 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:42.062062 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:07:42.062959 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 45931.6us
I20260709 13:07:42.064307 26228 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:42.057441 26243 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:41.973296 26033 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:42.069310 26199 consensus_meta.cc:287] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.010s
I20260709 13:07:42.069875 26199 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:42.070681 26195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.034s
W20260709 13:07:42.070871 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.071429 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:42.066612 22574 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:42.072029 26199 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:42.072317 22575 raft_consensus.cc:2410] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:07:42.072959 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.081104 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.081676 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.084848 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:42.084852 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.048782 26331 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.045161 26257 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:42.097108 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:42.086216 26195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.008s	sys 0.035s
I20260709 13:07:42.108701 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.090571 26033 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.118274 22505 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:42.119342 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 55703us
I20260709 13:07:42.118952 26228 raft_consensus.cc:697] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:42.124598 23113 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:42.110208 26193 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.132128 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.138276 22502 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:42.114852 26120 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.117254 26273 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:42.139400 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.145761 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.147264 23107 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:42.147478 22506 raft_consensus.cc:3055] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:42.147907 22506 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:42.106353 26294 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.156560 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:42.117513 26132 consensus_queue.cc:1059] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:42.151530 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.163748 22328 catalog_manager.cc:5697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 4 to 5, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 5 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.144012 26120 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:42.167589 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 57857.6us
I20260709 13:07:42.168994 22546 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:42.128216 26257 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.172369 26257 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.173107 26257 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.174355 26243 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.169936 26143 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:42.165370 26193 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.178045 26193 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.179533 22500 pending_rounds.cc:85] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 3
I20260709 13:07:42.179708 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.183180 26281 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.183598 26294 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.182703 22328 catalog_manager.cc:5697] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 1 to 3, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.151229 26273 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.186573 26273 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.171885 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.194360 22577 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:42.195217 26120 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.196609 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.197896 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.198421 22574 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [8.7-9.8]
I20260709 13:07:42.199071 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.162212 26166 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.201889 26166 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.205356 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.206718 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.207499 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.207857 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.165439 23110 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:42.167631 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.167666 26132 raft_consensus.cc:3055] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:42.209720 26132 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:42.210693 22580 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:07:42.209751 23106 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:42.211094 22580 pending_rounds.cc:85] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 4
I20260709 13:07:42.211825 22580 pending_rounds.cc:107] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:42.208312 22504 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:42.212082 22580 raft_consensus.cc:2889] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.179924 22500 pending_rounds.cc:107] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:42.123042 26228 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.204185 26166 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:42.200254 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.218642 22506 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.224797 22506 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.219635 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.212100 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:42.219906 26230 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.219954 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.212872 22500 raft_consensus.cc:2889] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:42.219627 25922 consensus_meta.cc:287] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.007s
I20260709 13:07:42.222749 22580 pending_rounds.cc:107] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:42.229104 22580 raft_consensus.cc:2889] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.180302 26193 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:42.233376 22508 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:42.241204 22501 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:42.227519 26256 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.252684 26076 consensus_queue.cc:1059] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:07:42.260923 26076 raft_consensus.cc:3055] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:42.261363 26076 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:42.262292 26076 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.263653 26076 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:42.264616 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.274845 22502 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:42.210786 26132 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.280561 26132 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.282596 22501 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:42.283016 22501 pending_rounds.cc:85] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 5
I20260709 13:07:42.284158 22501 pending_rounds.cc:107] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:42.284461 22501 raft_consensus.cc:2889] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.285353 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:42.233310 26281 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:07:42.289399 22506 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:42.293125 22396 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:42.256951 26166 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.299580 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 48514.1us
I20260709 13:07:42.309119 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:42.329025 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.254902 26230 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.331248 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:42.311646 26033 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.338215 23111 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:42.343072 23106 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:42.328341 26180 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.329406 26256 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:42.345750 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:42.336944 26033 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.325167 26140 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:07:42.365187 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 75237.1us
W20260709 13:07:42.370694 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 49729.8us
I20260709 13:07:42.325261 26166 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.356889 26152 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:42.383255 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.369165 26033 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.391692 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.398289 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.395936 22472 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.399034 22426 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:42.412783 22430 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:42.360345 26256 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.389164 26152 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:42.373889 26189 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:42.410737 22546 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:42.371826 26273 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:07:42.408790 26181 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.419384 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:42.423153 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.423943 22426 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:42.375620 22427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:42.426157 22427 raft_consensus.cc:606] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:42.426541 22427 raft_consensus.cc:614] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:42.426833 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:42.423049 23077 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.721s (SENT)
I20260709 13:07:42.429103 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.432081 22427 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:42.432246 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.417840 26152 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.440900 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.433256 23077 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:42.445029 23113 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:42.423790 26143 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.453563 26193 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.432734 26257 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.456681 22425 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:07:42.462456 22472 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:42.449455 26150 consensus_meta.cc:287] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.002s
I20260709 13:07:42.459900 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:42.460248 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.451385 26334 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:07:42.464243 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.462908 22425 pending_rounds.cc:85] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 4
I20260709 13:07:42.476603 22425 pending_rounds.cc:107] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:42.477057 22425 raft_consensus.cc:2889] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.470355 26257 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:42.479696 26257 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.480054 22472 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.480743 26230 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.482472 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.482780 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.483021 26319 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.483448 23113 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:42.482656 26181 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:42.484125 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 69544.9us
I20260709 13:07:42.482486 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:42.485241 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.485342 26181 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:42.456463 26339 log.cc:927] Time spent T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:07:42.486951 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.487931 26181 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.489441 22472 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.489981 26256 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.490248 26181 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.491658 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.492442 26181 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.493736 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.494017 22472 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.494606 22428 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:42.494870 26181 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.476382 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:42.454330 26143 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:42.498811 22427 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 5.
I20260709 13:07:42.500674 22429 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
W20260709 13:07:42.504864 23077 leader_election.cc:336] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.752s (SENT)
I20260709 13:07:42.505404 23077 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:42.508960 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.510218 22428 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:42.512957 22426 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:42.503786 26143 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.470794 26122 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:42.505168 26256 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:42.523478 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.524771 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.541250 22425 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:42.521777 26273 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.532737 26294 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.551011 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.533313 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:42.534479 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:42.535830 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:42.537693 26166 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:42.538817 25771 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.540098 26256 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.542351 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.544013 22428 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.549034 22433 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:42.549922 22430 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:42.554029 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.559422 22426 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:42.514364 26189 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.561821 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 67942.9us
I20260709 13:07:42.556612 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:42.563087 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.567358 22425 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:42.567579 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.568635 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.569447 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.544538 26228 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.514942 26120 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.576084 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:42.565696 26189 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.579770 26189 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.581599 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.583108 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.592906 22576 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:42.554994 26273 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:42.601665 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 101281us
I20260709 13:07:42.604539 26150 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.605182 26150 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.608949 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.609814 26150 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.602471 26273 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.611407 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.612167 23104 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:42.617599 22398 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:42.618585 26076 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:42.619143 26076 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.619863 26200 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.620039 26132 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.568106 25771 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.622278 22580 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:42.623404 25771 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.624850 26200 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.627562 26200 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.627764 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:42.562477 26294 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.571626 26166 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.645959 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.631603 26256 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:42.632429 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 61412.7us
I20260709 13:07:42.647302 22472 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.648145 26319 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:42.633836 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.634735 26076 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.637022 22428 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:42.632141 23077 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.644639 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.631229 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:42.646162 26166 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.670464 26166 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.670358 26152 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.671720 22582 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
W20260709 13:07:42.673079 26354 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.270s	user 0.000s	sys 0.004s
I20260709 13:07:42.675233 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:42.677843 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.679078 22574 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:42.681666 26199 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.648818 26294 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.649389 22472 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.651104 26120 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:42.684326 22472 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.632887 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:42.653472 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.654385 22431 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:42.686620 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.687608 22424 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:42.658416 22576 raft_consensus.cc:1275] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:42.660889 22433 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
W20260709 13:07:42.599323 26318 consensus_meta.cc:287] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.817s	user 0.009s	sys 0.006s
I20260709 13:07:42.620596 26132 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.667294 23077 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.679248 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:42.689740 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.691917 26122 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.692126 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.692953 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:42.695699 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:42.697180 22574 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:42.698796 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:42.699430 23104 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:42.699878 26181 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.696238 22581 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:42.702034 22429 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:42.704663 22399 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:42.706017 26319 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:07:42.706228 26181 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:42.706842 26181 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:42.707250 26181 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.709364 22398 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:42.713016 22503 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:07:42.713544 22503 pending_rounds.cc:85] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 5
I20260709 13:07:42.713810 22503 pending_rounds.cc:107] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:07:42.714021 22503 raft_consensus.cc:2889] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.713240 22472 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.722453 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:42.723704 26120 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.725385 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:42.726105 22575 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:42.716509 26150 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.721522 26193 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:42.693547 26033 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:42.734961 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 67780.4us
W20260709 13:07:42.738271 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 45401.3us
I20260709 13:07:42.739276 22474 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:42.727665 26122 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.741859 23077 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.717181 26143 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.743788 22575 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:42.741684 26318 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:42.735684 26150 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.744392 22575 pending_rounds.cc:85] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 4
I20260709 13:07:42.746970 22430 raft_consensus.cc:2368] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:07:42.732798 26257 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.747357 22575 pending_rounds.cc:107] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:42.749833 22575 raft_consensus.cc:2889] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.752418 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:42.755220 22474 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:42.756628 26318 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.758268 23104 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 7: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:42.740849 26152 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.757277 26318 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:42.761581 26318 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.759550 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:42.765151 22573 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
W20260709 13:07:42.765985 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.749042 26150 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.767798 26199 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:07:42.768433 26358 log.cc:927] Time spent T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.265s	user 0.000s	sys 0.002s
I20260709 13:07:42.754415 26193 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.770720 22472 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.774557 22399 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:42.782043 26120 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:42.783749 26355 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:07:42.788290 22432 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:42.790005 22399 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:42.791038 26120 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.794931 26030 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:42.795549 22546 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:42.796528 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:42.796592 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:42.797649 26030 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.798002 22546 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:42.798341 25771 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.798784 25771 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:42.799160 25771 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.801929 26120 consensus_queue.cc:1059] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:42.803138 26307 raft_consensus.cc:3055] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:42.803520 26307 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:42.804421 26307 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.805756 26033 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:42.806520 26152 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:42.806921 25771 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.809055 26307 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.809909 25771 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:42.796789 26356 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.371s	user 0.003s	sys 0.000s
W20260709 13:07:42.812747 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 71034.4us
I20260709 13:07:42.813613 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:42.814749 23077 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:42.804710 26294 raft_consensus.cc:2764] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:42.818563 26143 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.825320 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:42.827422 26193 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.828322 26193 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.828711 26193 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.828974 26132 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:42.830154 26340 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:42.833666 26257 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.829046 26193 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.836967 26120 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:42.838873 22399 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:42.839896 26120 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.840310 26120 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.840648 26120 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.774161 26166 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:07:42.845670 26132 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:42.846113 26132 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:42.846917 26132 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.847342 26256 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.847891 26256 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.848244 26256 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.848730 26152 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:42.849627 26076 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.848945 22399 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:42.848454 26294 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.851444 26294 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:42.851775 26076 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.852161 26294 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.851190 26033 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:42.853039 26033 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.853847 26033 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.848265 26132 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.851521 26166 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:42.856980 22546 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:42.858752 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 92188us
W20260709 13:07:42.859066 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.862213 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 67421.5us
W20260709 13:07:42.857218 26366 log.cc:927] Time spent T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:07:42.858572 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:42.867717 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 100519us
I20260709 13:07:42.863817 26122 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.871254 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:42.872284 22577 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:42.872365 23107 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.872390 23077 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:42.875289 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:42.876659 22429 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:42.878253 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:42.862526 26257 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.893926 23104 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:42.897953 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:42.899326 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:42.903653 22578 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.850093 26120 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.880357 26143 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.883427 26228 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:42.895653 26257 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:42.922325 26257 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.922102 26294 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:42.924561 26181 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.925035 26256 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.926740 26181 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.927835 26256 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.874343 26230 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:42.929143 26150 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.931422 26150 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.934824 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:42.916343 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:42.938038 26120 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:42.907608 26189 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.938884 26189 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:42.939316 26189 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.946013 26198 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:07:42.905232 26029 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:07:42.949770 26029 consensus_queue.cc:1243] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:07:42.965081 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 63632.3us
I20260709 13:07:42.922104 26193 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:42.981837 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:42.982508 23104 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.914033 26143 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.924458 26294 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:42.996865 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:43.002344 22505 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:42.998179 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:43.003736 22575 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:43.022861 22429 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:43.029415 22578 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:43.031212 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:43.031952 23110 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.024947 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:43.025573 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:43.036072 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:43.041880 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:43.033337 22508 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:43.036890 22507 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:43.046033 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:43.052874 23111 pending_rounds.cc:85] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting all ops after (but not including) 8
I20260709 13:07:43.053318 23111 pending_rounds.cc:107] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:43.053572 23111 raft_consensus.cc:2889] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:43.058327 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 194377us
I20260709 13:07:42.997361 26143 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.001554 26319 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.977396 25771 consensus_queue.cc:1059] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:07:43.073395 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:43.075553 22429 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.074543 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:43.088495 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.092739 22429 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:43.094558 23077 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:43.097744 23107 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:43.088658 22507 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
W20260709 13:07:43.108314 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 210656us
I20260709 13:07:43.045044 25922 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:07:43.102185 26199 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:43.104077 26228 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:43.170408 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:43.172224 22398 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:43.174311 22505 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:43.176246 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 193073us
I20260709 13:07:43.180099 26189 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.180871 22399 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:43.181620 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 121672us
I20260709 13:07:43.182906 22399 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:43.183974 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:43.184757 22501 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.180313 23110 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:43.186201 22500 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:07:43.186959 22398 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:43.145856 26256 raft_consensus.cc:3055] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:43.188725 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:43.164687 26199 raft_consensus.cc:697] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:43.159111 26228 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.122644 26319 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:07:43.202872 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:43.207389 22507 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.192540 23104 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:43.123363 26257 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.205744 22508 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.158394 26195 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.181689 26076 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:43.198231 26029 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:43.209368 22503 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:43.190444 26150 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.191942 26256 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:43.202041 26193 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:43.192660 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 175448us
I20260709 13:07:43.237708 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:43.219043 26375 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:07:43.285606 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 71839.1us
I20260709 13:07:43.287624 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:43.288434 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 81155.6us
W20260709 13:07:43.291169 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.220934 26195 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.295773 22503 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:43.298480 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:43.267951 26384 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:43.285215 26029 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:43.289849 26076 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:43.319006 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 110565us
W20260709 13:07:43.316169 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 287292us
W20260709 13:07:43.330494 26382 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:07:43.331869 26389 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:43.335366 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:43.330964 26195 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:43.333459 26189 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:43.316361 22545 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.550s (SENT) [suppressed 53 similar messages]
I20260709 13:07:43.330854 26381 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.300705 26143 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.295027 26319 consensus_queue.cc:1048] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:43.342118 22508 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:43.264427 26199 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.312590 26230 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:43.316674 26357 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:43.308269 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:43.367918 22499 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.320549 25922 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:07:43.376389 22472 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:43.377081 26384 raft_consensus.cc:697] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:43.352887 26195 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.330737 26029 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.400331 22499 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
W20260709 13:07:43.424039 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 111149us
W20260709 13:07:43.336748 22317 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4d35c45e33c4336b33461cdbe7f7b6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9cea93fb03e04e48a6dabc4094ee7c93 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:43.378439 26386 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.477134 26384 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.322060 26256 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.403115 25922 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:43.543109 22501 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:43.359045 26381 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.400741 26257 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:43.384886 26393 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.420022 26122 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.401872 26357 raft_consensus.cc:697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:43.548626 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 317946us
W20260709 13:07:43.553345 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 236995us
I20260709 13:07:43.461067 26076 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:43.409895 26390 log.cc:927] Time spent T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:07:43.389447 26198 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.403542 26392 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:07:43.451026 26382 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:07:43.419107 26033 consensus_meta.cc:287] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.000s
I20260709 13:07:43.560967 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:43.538015 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 161751us
W20260709 13:07:43.565634 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 140672us
I20260709 13:07:43.535573 26181 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:43.534403 26143 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:43.589859 22317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 272949us
I20260709 13:07:43.594600 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:43.599442 22507 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:43.600044 22582 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.602852 22578 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:43.613595 22575 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:07:43.615981 26396 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.196s	user 0.001s	sys 0.005s
I20260709 13:07:43.639106 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:43.613114 26403 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:43.621743 25922 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:43.656721 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:43.646426 22396 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:43.661305 22582 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
W20260709 13:07:43.665763 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 69527.9us
I20260709 13:07:43.613669 26386 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.642066 26388 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:43.635898 26122 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.644915 26404 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:43.629317 26393 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.644691 26198 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.698149 26395 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.676862 26029 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.653604 26033 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.704602 26029 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.705567 26033 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:43.698673 26198 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:43.704792 26378 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.434s	user 0.003s	sys 0.004s
I20260709 13:07:43.664382 26403 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.725761 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:43.728711 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 82291.1us
W20260709 13:07:43.789232 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.789525 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 93099us
W20260709 13:07:43.792742 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 145898us
I20260709 13:07:43.687093 26388 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.709424 26397 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:07:43.817502 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:43.818202 22501 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.819979 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:43.820624 22499 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:43.821753 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:43.822417 22430 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.822659 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:43.823901 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:43.824514 22427 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.825155 26386 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:43.828900 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:43.835217 22501 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:43.836710 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:43.837399 22507 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:43.823251 22506 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:43.844659 22427 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:43.845430 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:43.847702 22430 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:43.849575 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:43.850243 22427 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.853148 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:43.793531 26166 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:43.853353 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:43.706229 26357 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.789491 26406 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:43.724233 25922 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.876925 25922 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.877519 26381 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:43.838932 26395 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.880779 26395 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.843514 26394 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:43.863260 26400 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.272s	user 0.000s	sys 0.003s
I20260709 13:07:43.889205 26388 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:43.866814 22472 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:43.867383 26029 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:43.867980 26418 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:43.871941 26393 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:43.873541 26122 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:43.847122 26404 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:43.856841 22424 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:43.881834 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:43.885608 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:43.924379 26404 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:43.929643 26425 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.924278 26393 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:43.930272 26425 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:43.886852 22426 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:43.932946 26425 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:43.859556 26403 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:43.939837 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:43.909056 22431 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:43.858023 26386 raft_consensus.cc:2764] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 13:07:43.923727 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 57004.2us
I20260709 13:07:43.944499 22428 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:43.942957 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:43.953771 22427 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:43.963176 22546 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:43.966221 22472 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:43.966390 22546 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:43.963858 26180 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.016s	sys 0.013s
W20260709 13:07:43.983737 26180 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.016s	sys 0.013s
I20260709 13:07:43.983829 26433 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.984342 26433 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.984727 26433 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:43.989895 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 67381.2us
I20260709 13:07:43.991503 22396 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:43.964197 26403 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:43.975265 26273 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.976078 26386 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.997022 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:43.975490 26388 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.998025 22472 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:44.004565 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:44.017571 22472 leader_election.cc:400] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:07:44.018047 22472 leader_election.cc:403] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:43.993848 26384 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.002825 26424 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:44.029256 26376 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.029799 26411 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:44.027029 26384 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.015615 26273 raft_consensus.cc:697] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:44.034145 26273 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.034977 26384 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:43.996218 26418 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:07:44.041882 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 85132.3us
I20260709 13:07:44.017349 26388 raft_consensus.cc:697] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:44.003327 26403 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:44.051409 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 52140.9us
I20260709 13:07:44.029456 26386 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:07:44.042037 26424 raft_consensus.cc:697] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:44.048316 26439 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:44.064527 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 50024.2us
W20260709 13:07:44.067005 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 65217us
I20260709 13:07:44.074740 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.075418 22505 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:44.077459 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:44.078210 22428 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:44.085031 22396 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:44.095181 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:44.063428 26439 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:44.095224 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.102674 22503 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:44.104746 22432 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
W20260709 13:07:44.113607 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 60897.6us
W20260709 13:07:44.116986 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 71876.8us
I20260709 13:07:44.103981 26439 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.118134 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.103509 26122 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.123504 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.125864 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.145789 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:44.131785 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:44.147642 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 57739.4us
I20260709 13:07:44.181980 22505 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:44.149871 22396 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:44.191397 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:44.193205 22504 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:44.127558 26443 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.120748 26418 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:44.200845 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:44.202987 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.183473 26376 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.210511 22505 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:44.219218 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.132227 26122 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.110497 26388 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:44.247097 26445 log.cc:927] Time spent T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:07:44.271926 26256 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.275859 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:44.277681 26120 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:44.282227 26403 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:44.205171 26443 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:44.212984 26418 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.204166 26423 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:44.311826 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.313082 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:44.324967 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:44.358542 23104 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:44.341264 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:44.130892 26424 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.292649 26152 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:44.345454 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:44.357585 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:44.215348 26376 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.362843 22503 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.336772 26076 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.362083 26425 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.346755 26273 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:44.293221 25922 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:07:44.370957 26122 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:44.371745 26152 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.371795 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:44.375967 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:44.340683 26120 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.287834 26377 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:07:44.369251 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.402822 22546 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:44.348713 26443 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:44.399760 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 279802us
I20260709 13:07:44.388993 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:44.343643 26433 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.408550 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:44.387485 26281 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.420449 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:44.418331 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:44.420673 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:44.422592 22580 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.421947 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:44.424065 22508 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:44.425137 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:44.406059 26120 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.427205 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:44.431490 22581 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.407781 26410 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.386487 26076 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.436100 22578 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:44.415760 26413 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:44.439635 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:44.374688 26423 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.387770 26425 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.424911 26384 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:44.433856 26257 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:44.454650 22428 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:44.438385 26403 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.461058 22579 raft_consensus.cc:3055] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:44.461615 22579 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:44.470021 22432 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:44.462281 26434 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.240s	user 0.003s	sys 0.008s
I20260709 13:07:44.451889 26377 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:44.464764 26446 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.068s	user 0.006s	sys 0.004s
I20260709 13:07:44.456053 26257 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:44.459975 26413 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:44.485328 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 56325.6us
I20260709 13:07:44.470463 22579 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.465145 26403 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:44.487531 22579 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.464771 26384 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:44.501197 26376 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:44.505551 26423 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:44.508841 26450 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:07:44.510200 26152 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:44.510442 26076 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:44.510239 22579 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:44.511353 22579 pending_rounds.cc:85] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 7
I20260709 13:07:44.511658 26076 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:44.512207 26076 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.514389 26076 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:44.515491 26076 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.515949 26076 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.517664 26425 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:44.517808 26455 log.cc:927] Time spent T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:07:44.518005 26076 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:44.520358 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:44.521032 26439 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.523265 26439 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:44.511639 22579 pending_rounds.cc:107] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:44.524446 22579 raft_consensus.cc:2889] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.525838 26433 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:44.464844 26422 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.177s
I20260709 13:07:44.526584 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:44.527019 26422 raft_consensus.cc:3055] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:44.527338 22574 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:44.527431 26422 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:44.528545 26422 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.529803 23079 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:44.534957 22580 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:44.532536 22547 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:07:44.543797 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 136232us
I20260709 13:07:44.553910 22581 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:44.481932 26377 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:44.487974 26257 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.532933 26403 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:44.556366 26378 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:44.534541 26410 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:44.556125 26152 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:44.523293 26418 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:43.701944 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:44.568368 26425 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:44.574893 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 117768us
I20260709 13:07:44.555594 26423 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:07:44.598686 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 61646.4us
I20260709 13:07:44.598966 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:44.599596 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:44.600144 22425 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:44.600383 22426 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:44.600828 22547 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:44.602278 22424 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.602514 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:44.604820 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:44.606284 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:44.606901 22426 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:44.607471 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:44.607771 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:44.608178 22580 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:44.609038 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:44.609620 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:44.610347 22580 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 10: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:44.585700 26152 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.612111 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:44.520349 26384 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.588258 26425 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.620419 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:44.613857 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:44.610234 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:44.621749 22426 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:44.635172 26469 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:07:44.636636 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 48343.1us
I20260709 13:07:44.601028 26120 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.588511 26410 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.644327 22503 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:44.624403 26425 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:44.647665 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49749.1us
I20260709 13:07:44.829881 22432 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:44.692785 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:44.647266 26459 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.840162 26459 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.640002 22424 raft_consensus.cc:1275] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:44.809614 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.724701 26386 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:44.638724 22425 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:44.842638 26386 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.844168 22425 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:44.845734 22425 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:44.822057 26443 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.893226 26466 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:44.894151 26443 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:44.895771 26459 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:44.895908 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:44.846256 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:44.896983 22574 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.705145 22573 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:44.897344 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:44.725257 22430 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:44.624450 26377 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.657357 22428 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:44.841387 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:44.864818 26376 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:44.636822 26469 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:44.851011 26423 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:44.867347 26395 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:44.640969 26470 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:44.904704 26418 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:44.618904 26152 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.912566 26418 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.915920 26418 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:44.871107 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.871850 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.916855 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:44.878140 26386 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:44.916975 22507 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
W20260709 13:07:44.884097 26444 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.769s	user 0.001s	sys 0.000s
W20260709 13:07:44.884964 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.885826 26403 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:44.922585 26403 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:44.887693 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.887844 26120 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:44.891736 26421 log.cc:927] Time spent T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.172s	user 0.007s	sys 0.004s
I20260709 13:07:44.893810 26466 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.854802 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.900996 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:44.902624 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:44.946412 22502 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:44.903729 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.909806 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:44.936793 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 107401us
W20260709 13:07:44.937845 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 342362us
I20260709 13:07:44.897601 26122 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:44.912366 26470 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:44.621136 26413 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:45.054634 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:44.923933 26423 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:45.083122 26122 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:45.086683 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:44.986037 22430 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:45.000938 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.911353 26469 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:45.688231 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.688778 26469 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:45.689397 26469 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.690071 26494 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:45.690667 26494 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:45.004681 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:45.009055 26466 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:44.923589 26376 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:45.087103 26423 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:44.909294 26393 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:45.090937 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:44.986899 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:45.019979 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:45.055959 22500 raft_consensus.cc:3055] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:45.020902 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:45.747103 22501 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:45.054342 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:45.748622 22506 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:45.018990 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:45.055073 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:45.255385 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 353736us
W20260709 13:07:45.554018 22502 consensus_meta.cc:287] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.000s
I20260709 13:07:46.946168 22502 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
W20260709 13:07:46.946870 22502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1654) took 2092 ms (client timeout 2006 ms). Trace:
W20260709 13:07:46.947245 22502 rpcz_store.cc:269] 0709 13:07:44.854329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.855584 (+  1255us) service_pool.cc:224] Handling call
0709 13:07:46.946752 (+2091168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.610456 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1637) took 1493 ms. Trace:
I20260709 13:07:46.948310 22503 rpcz_store.cc:276] 0709 13:07:44.116650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.117783 (+  1133us) service_pool.cc:224] Handling call
0709 13:07:44.120546 (+  2763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.833147 (+712601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.610117 (+776970us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400184cd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:45.610342 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556872064}
I20260709 13:07:45.617376 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 484) took 1025 ms. Trace:
I20260709 13:07:46.949644 22424 rpcz_store.cc:276] 0709 13:07:44.591774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.841982 (+250208us) service_pool.cc:224] Handling call
0709 13:07:44.842279 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.081397 (+239118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.081428 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.081472 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:45.081502 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.617080 (+535578us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540043ab54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:45.617136 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.617304 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549394816}
W20260709 13:07:45.627846 22433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.015s	sys 0.019s
W20260709 13:07:46.951169 22433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.082s	user 0.016s	sys 0.020s
W20260709 13:07:45.660662 22428 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.006s	sys 0.019s
W20260709 13:07:46.952252 22428 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.858s	user 0.006s	sys 0.020s
I20260709 13:07:46.953358 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1666) took 2003 ms. Trace:
I20260709 13:07:46.953706 22428 rpcz_store.cc:276] 0709 13:07:44.950295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.950503 (+   208us) service_pool.cc:224] Handling call
0709 13:07:44.951101 (+   598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.011022 (+ 59921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.011060 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.092750 (+ 81690us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.952959 (+1860209us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:46.953009 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.953101 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.953146 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:46.953157 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.953301 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":631636,"raft.queue_time_us":105905,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":133,"spinlock_wait_cycles":1603968,"thread_start_us":1859003,"threads_started":1,"wal-append.queue_time_us":124095,"wal-append.run_cpu_time_us":2117,"wal-append.run_wall_time_us":1051300}
I20260709 13:07:45.706281 22508 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:45.718986 22432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.023s	sys 0.053s
W20260709 13:07:46.956773 22432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.013s	user 0.024s	sys 0.055s
W20260709 13:07:45.721328 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 633085us
W20260709 13:07:46.959474 22529 debug-util.cc:398] Leaking SignalData structure 0x7b0800162a20 after lost signal to thread 21315
I20260709 13:07:45.746384 22500 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:45.750082 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 669614us
W20260709 13:07:46.960745 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08001624c0 after lost signal to thread 22365
I20260709 13:07:46.961138 22500 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:46.962002 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08001eeac0 after lost signal to thread 22457
W20260709 13:07:46.962316 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08001dc6a0 after lost signal to thread 22458
I20260709 13:07:45.763005 26507 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:46.963742 26507 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:46.964893 22500 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.966048 26507 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:45.771529 26509 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:46.967433 26509 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:46.969785 26509 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:45.773197 26508 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:46.970520 26508 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:46.972851 26508 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:45.779601 26512 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:46.973649 26512 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:46.975824 26512 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:45.793608 22472 leader_election.cc:336] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.701s (SENT)
W20260709 13:07:46.976826 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 1.18319e+06us
W20260709 13:07:46.979393 22472 leader_election.cc:336] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.761s (SENT)
I20260709 13:07:46.979838 22472 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:45.806798 26513 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:46.980809 26513 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:45.807026 26514 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:46.983477 22508 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:46.983911 26514 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:45.427834 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.527427 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1853) took 1100 ms. Trace:
I20260709 13:07:45.631096 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1858) took 1024 ms. Trace:
I20260709 13:07:47.257983 22581 rpcz_store.cc:276] 0709 13:07:44.606284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.606398 (+   114us) service_pool.cc:224] Handling call
0709 13:07:44.606677 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.829978 (+223301us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:44.830289 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.896442 (+ 66153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.896527 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:44.896571 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.630818 (+734247us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54001cd9d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:45.630869 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.631022 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":189,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":32401,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":513264896,"thread_start_us":65680,"threads_started":2,"wal-append.queue_time_us":2869,"wal-append.run_cpu_time_us":1220,"wal-append.run_wall_time_us":1001243}
W20260709 13:07:45.140779 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 265214us
W20260709 13:07:45.368629 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.126893 22574 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
W20260709 13:07:47.265913 22574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1864) took 2643 ms (client timeout 1923 ms). Trace:
W20260709 13:07:47.266353 22574 rpcz_store.cc:269] 0709 13:07:44.622035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.622863 (+   828us) service_pool.cc:224] Handling call
0709 13:07:47.265788 (+2642925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7552}
I20260709 13:07:45.782778 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 489) took 1144 ms. Trace:
W20260709 13:07:45.554368 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.269369 22579 rpcz_store.cc:276] 0709 13:07:44.638027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.704933 (+ 66906us) service_pool.cc:224] Handling call
0709 13:07:45.747952 (+1043019us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b5800090398. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:07:45.748147 (+   195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.748554 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:45.748583 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.749038 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.782142 (+ 33104us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:45.782201 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.782307 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.782370 (+    63us) raft_consensus.cc:1685] finished
0709 13:07:45.782382 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.782690 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2059,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":12748160,"thread_start_us":32724,"threads_started":1,"wal-append.queue_time_us":4527,"wal-append.run_cpu_time_us":1601,"wal-append.run_wall_time_us":1021234}
I20260709 13:07:45.792296 25922 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:47.274744 25922 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:45.200608 26152 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:47.280059 26152 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:45.766362 26200 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.284670 26200 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.285676 22546 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:47.286964 26200 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:45.764400 26230 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:44.998457 26256 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:47.288378 26230 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:47.289209 26256 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:45.208786 26257 consensus_meta.cc:287] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.003s
I20260709 13:07:47.291671 26257 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:45.180106 26281 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:47.288365 26527 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.295235 26281 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.295671 26281 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:45.684197 26377 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.142153 26381 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:47.300156 26381 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:45.706947 26376 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:45.596697 26380 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:45.596205 26386 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:47.680382 26386 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.682542 26386 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:46.923965 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 240253us
I20260709 13:07:46.961822 22399 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:47.686844 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 725024us
I20260709 13:07:45.760615 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2482) took 1169 ms. Trace:
W20260709 13:07:45.677881 22431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1648) took 1854 ms (client timeout 1550 ms). Trace:
W20260709 13:07:47.693434 22431 rpcz_store.cc:269] 0709 13:07:43.823824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.828623 (+  4799us) service_pool.cc:224] Handling call
0709 13:07:45.677657 (+1849034us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b54003ac5d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:45.677770 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144940288}
I20260709 13:07:47.056834 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2476) took 2469 ms. Trace:
I20260709 13:07:47.063962 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2485) took 2472 ms. Trace:
I20260709 13:07:47.292692 26533 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:47.297624 26535 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:47.298671 26531 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:47.303383 26532 consensus_queue.cc:1059] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:47.302296 26527 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:47.695844 22432 rpcz_store.cc:276] 0709 13:07:44.591492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.837586 (+246094us) service_pool.cc:224] Handling call
0709 13:07:44.837938 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.937036 (+ 99098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.937078 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.943466 (+  6388us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.957195 (+2013729us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:47.041277 (+ 84082us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.063628 (+ 22351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.063702 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.063741 (+    39us) raft_consensus.cc:1685] finished
0709 13:07:47.063754 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.063902 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98574,"prepare.queue_time_us":81405,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":101104,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":1013,"thread_start_us":2118945,"threads_started":3,"wal-append.queue_time_us":356517,"wal-append.run_cpu_time_us":1575,"wal-append.run_wall_time_us":1001588}
I20260709 13:07:47.697863 26532 raft_consensus.cc:3055] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:47.698292 26532 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:47.699106 26527 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:45.929575 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 126117us
I20260709 13:07:47.701203 26535 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:46.343547 22471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.004s	sys 0.008s
W20260709 13:07:47.706634 22471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.944s	user 0.006s	sys 0.008s
I20260709 13:07:47.707878 26376 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:47.708441 26376 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:47.709360 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:47.710306 26307 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:47.710675 26376 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:47.711279 26376 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.991842 22472 leader_election.cc:336] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.780s (SENT)
W20260709 13:07:47.713239 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 721370us
W20260709 13:07:47.040756 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 95226us
W20260709 13:07:47.142904 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0860 after lost signal to thread 22532
W20260709 13:07:47.716997 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0b40 after lost signal to thread 22533
I20260709 13:07:47.717108 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:47.309203 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:47.018412 22500 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:47.721515 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1661) took 2666 ms. Trace:
I20260709 13:07:47.721891 22500 rpcz_store.cc:276] 0709 13:07:45.055012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.055214 (+   202us) service_pool.cc:224] Handling call
0709 13:07:45.055821 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.721241 (+2665420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.721436 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:46.986847 22505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1660) took 1932 ms (client timeout 1833 ms). Trace:
W20260709 13:07:47.723166 22505 rpcz_store.cc:269] 0709 13:07:45.054506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.054820 (+   314us) service_pool.cc:224] Handling call
0709 13:07:46.986747 (+1931927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.527452 22507 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:47.710688 26307 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.182540 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:47.724998 26507 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.725910 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 2.54325e+06us
I20260709 13:07:47.319819 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:47.318841 22580 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:47.317219 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:47.311193 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:46.921969 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.239655 22508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1653) took 2385 ms (client timeout 1781 ms). Trace:
W20260709 13:07:47.866024 22508 rpcz_store.cc:269] 0709 13:07:44.854036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.897195 (+ 43159us) service_pool.cc:224] Handling call
0709 13:07:47.239408 (+2342213us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54001824d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:47.239545 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813504896}
I20260709 13:07:47.867362 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:47.311060 22574 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:47.867743 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:46.531625 26029 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.054538 26076 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:47.878897 26029 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:47.879498 26076 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:47.282583 25922 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:45.098717 26122 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:47.063766 26198 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:47.887890 26198 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.290948 26230 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:47.901464 22473 connection.cc:256] RPC call timeout handler was delayed by -1.2999491450000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
I20260709 13:07:47.302196 26257 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:47.313208 26281 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:47.025817 26357 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:47.320887 26377 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:47.924666 26357 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.925143 26377 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:47.927085 26377 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:47.926959 26357 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:47.308764 26380 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.302345 26381 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:45.105171 26388 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.946306 26388 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.261715 26384 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.949383 26384 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.951733 26384 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:45.715551 26393 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:47.954324 26393 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:45.595680 26394 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:47.957367 26394 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.959797 26394 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:45.514025 26401 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.881s	user 0.008s	sys 0.000s
I20260709 13:07:47.963367 22429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 483) took 4787 ms. Trace:
I20260709 13:07:47.963745 22429 rpcz_store.cc:276] 0709 13:07:43.175469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.175627 (+   158us) service_pool.cc:224] Handling call
0709 13:07:43.191657 (+ 16030us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.211845 (+ 20188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.211881 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.216938 (+  5057us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.306616 (+ 89678us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:43.306660 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.306739 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.513340 (+2206601us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:47.963002 (+2449662us) raft_consensus.cc:1685] finished
0709 13:07:47.963029 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.963270 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6532,"raft.queue_time_us":8206,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5801,"spinlock_wait_cycles":17142528,"thread_start_us":52948,"threads_started":1,"wal-append.queue_time_us":217717}
I20260709 13:07:47.965489 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:47.966238 22506 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:47.967314 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:45.124989 26403 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.969507 26403 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.971853 26403 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:45.501322 26404 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:45.585233 26410 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:45.662623 26422 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.207360 26425 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:47.978201 23111 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:47.979288 26425 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:47.024760 26426 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.982996 26426 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:45.759666 26448 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.770925 26454 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:45.781934 26466 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:47.988705 26466 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:47.990553 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:47.990975 26466 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:45.689898 26469 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:45.093775 26470 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:45.566411 26477 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.905s	user 0.000s	sys 0.021s
W20260709 13:07:45.708988 26479 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.055s	user 0.000s	sys 0.012s
I20260709 13:07:45.223342 26482 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.784651 26471 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:48.023571 26482 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.024215 26471 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.026480 26471 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:45.212695 26483 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:45.158546 26484 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:47.027554 26478 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.028611 26393 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.028576 26484 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.029156 26478 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.111052 26487 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:45.597321 26493 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:45.694825 26494 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:46.988545 26508 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.987764 26512 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:48.046175 26512 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:46.983419 26513 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:46.986215 26514 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:47.320804 26524 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.091426 26520 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:47.055589 26522 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:47.538058 26537 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.551353 26540 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:47.622457 26526 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:47.622756 26530 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:47.622313 26152 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.622347 26529 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.629518 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.645445 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:47.657181 26528 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:47.153416 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:47.688390 26468 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:47.688964 22331 catalog_manager.cc:5697] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 10, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:47.699431 26533 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:47.695336 22433 rpcz_store.cc:276] 0709 13:07:44.586091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.586213 (+   122us) service_pool.cc:224] Handling call
0709 13:07:44.599083 (+ 12870us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:44.647919 (+ 48836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.647955 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:44.869217 (+221262us) log.cc:844] Serialized 52 byte log entry
0709 13:07:46.951581 (+2082364us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:47.052998 (+101417us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.054216 (+  1218us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.054403 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.055063 (+   660us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.055122 (+    59us) raft_consensus.cc:1685] finished
0709 13:07:47.055132 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.055297 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49183,"prepare.queue_time_us":88388,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":52458,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":1211,"spinlock_wait_cycles":15488,"thread_start_us":2182931,"threads_started":2,"wal-append.queue_time_us":311775}
I20260709 13:07:47.703596 26535 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:47.705323 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:47.691059 22426 rpcz_store.cc:276] 0709 13:07:44.590742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.627434 (+ 36692us) service_pool.cc:224] Handling call
0709 13:07:44.627845 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.725708 (+ 97863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.725740 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.829010 (+103270us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.258074 (+429064us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:45.258472 (+   398us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.760238 (+501766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.760325 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.760366 (+    41us) raft_consensus.cc:1685] finished
0709 13:07:45.760377 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.760531 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":598771,"prepare.queue_time_us":221,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":56,"raft.queue_time_us":628752,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":33202,"thread_start_us":392402,"threads_started":1,"wal-append.queue_time_us":300102,"wal-append.run_cpu_time_us":18456,"wal-append.run_wall_time_us":1778986}
I20260709 13:07:47.714872 26546 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.716004 22503 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:07:47.717434 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08000a7e80 after lost signal to thread 22545
I20260709 13:07:47.103896 22577 rpcz_store.cc:276] 0709 13:07:44.427252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.427727 (+   475us) service_pool.cc:224] Handling call
0709 13:07:44.438160 (+ 10433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.438393 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:44.452959 (+ 14566us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.510997 (+1058038us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18001041a0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b 00007f006c9c1d23 00007f006c9c223a 00007f006ce2ca2a
0709 13:07:45.526908 (+ 15911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.526974 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:45.527021 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.527091 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.527358 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13013,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":367,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"spinlock_wait_cycles":3109632,"thread_start_us":15349,"threads_started":1,"wal-append.queue_time_us":1076850,"wal-append.run_cpu_time_us":1005,"wal-append.run_wall_time_us":1001383}
I20260709 13:07:47.699142 26532 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.725364 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:47.727737 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:47.725107 22507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1657) took 2706 ms (client timeout 2059 ms). Trace:
W20260709 13:07:47.748450 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 62051.5us
I20260709 13:07:47.725622 26507 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:47.759141 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46742.9us
I20260709 13:07:47.725004 26307 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.729794 26386 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.731253 26542 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:47.711709 26376 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:47.749797 26531 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:47.795467 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:47.798190 26545 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.816138 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 89090.6us
W20260709 13:07:47.817668 22328 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33176 (request call id 264) took 25134 ms (client timeout 15000 ms). Trace:
I20260709 13:07:47.824306 26548 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.846767 26551 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.857060 22576 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:47.858073 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:47.858235 26557 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:07:47.860220 26552 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:07:47.867720 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 87849.5us
W20260709 13:07:47.868044 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.867374 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:47.873332 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:47.877627 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:47.311604 26256 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:47.915616 26029 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:47.901438 26076 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:47.917608 26198 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:47.918790 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:47.928859 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 61799us
W20260709 13:07:47.929070 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 94645.3us
W20260709 13:07:47.979628 23111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59008 (request call id 849) took 3089 ms (client timeout 3292 ms). Trace:
I20260709 13:07:47.985380 26448 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.008261 26447 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:07:48.009294 26469 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:47.996927 26380 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.020422 26423 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.027021 26482 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:48.027963 26483 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.019824 26388 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:48.031328 26478 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.040058 26426 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.099813 26540 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.100749 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:48.101933 26470 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:48.102528 26470 raft_consensus.cc:697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:48.102586 26520 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.103713 26470 consensus_queue.cc:237] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.105682 26520 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.106383 26507 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.107291 26529 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.109687 22504 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:48.110122 22529 debug-util.cc:398] Leaking SignalData structure 0x7b0800372120 after lost signal to thread 22606
W20260709 13:07:48.110497 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0940 after lost signal to thread 22607
I20260709 13:07:48.111423 23113 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:48.106959 22575 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:48.101624 26522 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.112169 22499 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
W20260709 13:07:48.114557 21317 debug-util.cc:398] Leaking SignalData structure 0x7b080000f680 after lost signal to thread 22545
I20260709 13:07:48.100063 22474 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:48.111758 22529 debug-util.cc:398] Leaking SignalData structure 0x7b0800353d40 after lost signal to thread 23137
W20260709 13:07:48.127928 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2e00 after lost signal to thread 23138
I20260709 13:07:48.116331 26448 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.114653 26552 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.119632 26423 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.120864 22429 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:48.120767 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:48.136766 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:48.143358 22432 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.122054 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:48.144767 22431 raft_consensus.cc:2368] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:07:48.124161 26483 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.144629 22545 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:48.122920 26540 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.108964 26376 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:48.099768 23111 rpcz_store.cc:269] 0709 13:07:44.890608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.902393 (+ 11785us) service_pool.cc:224] Handling call
0709 13:07:47.979407 (+3077014us) spinlock_profiling.cc:243] Waited 3.03 s on lock 0x7b5400205654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:47.979544 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6975650176}
I20260709 13:07:48.048413 26512 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.140251 26528 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.156920 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.157927 22573 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:48.159338 26528 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:48.124584 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:48.159844 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.124657 23104 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:48.161677 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.162438 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.162786 26076 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.152760 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.163968 23107 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:48.151892 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:48.161731 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.106405 26524 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.110639 22502 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.129087 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.129778 22428 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.165786 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:48.166541 22433 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.041699 26487 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.130755 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.112082 22500 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.128422 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:48.135910 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:48.038628 26484 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.128082 23106 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:48.115965 26533 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.137310 22331 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 10, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.146489 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:48.151892 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.151695 26508 consensus_queue.cc:1048] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:48.152766 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.177487 23110 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:48.177227 22331 catalog_manager.cc:5697] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:48.154606 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.179311 22580 raft_consensus.cc:2393] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 10: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:48.140187 26513 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:48.155527 26469 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:48.100010 26537 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.165056 22508 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.125113 26152 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.166052 22574 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.187685 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.123950 26530 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.162330 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.197660 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.198294 23112 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:48.112869 22473 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:48.111202 22507 rpcz_store.cc:269] 0709 13:07:45.018397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.018675 (+   278us) service_pool.cc:224] Handling call
0709 13:07:47.725033 (+2706358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.168612 23109 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
W20260709 13:07:48.199316 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 86525us
I20260709 13:07:48.161149 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.159348 26423 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.172509 23113 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:07:48.173264 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44911.5us
I20260709 13:07:48.176126 22432 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
W20260709 13:07:48.179826 23104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59008 (request call id 851) took 3232 ms (client timeout 1638 ms). Trace:
I20260709 13:07:48.178506 22331 catalog_manager.cc:5697] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.140735 26546 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.148638 26198 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.184876 22429 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:48.217883 26198 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.219931 26198 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.147541 26388 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:48.207650 26530 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.220674 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.221140 22424 raft_consensus.cc:2410] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:48.221311 22425 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:48.147929 26448 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.150190 26256 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:48.222069 26487 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:48.221949 26448 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.194998 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.223284 22575 raft_consensus.cc:2393] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:48.107003 22328 rpcz_store.cc:269] 0709 13:07:22.663429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.705888 (+ 42459us) service_pool.cc:224] Handling call
0709 13:07:47.797357 (+25091469us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:42.585306 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:42.585992 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:42.586050 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:07:42.586070 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:42.662308 (+ 76238us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:42.662406 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:42.662442 (+    36us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:07:42.663951 (+  1509us) tablet.cc:701] Row locks acquired
0709 13:07:42.664003 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:07:42.664180 (+   177us) write_op.cc:270] Start()
0709 13:07:42.664343 (+   163us) write_op.cc:276] Timestamp: P: 1783602462664111 usec, L: 0
0709 13:07:42.664368 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:07:42.707381 (+ 43013us) log.cc:844] Serialized 6984 byte log entry
0709 13:07:42.952700 (+245319us) op_driver.cc:464] REPLICATION: finished
0709 13:07:43.335365 (+382665us) write_op.cc:301] APPLY: starting
0709 13:07:43.335503 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:43.335873 (+   370us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:43.336019 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:43.403759 (+ 67740us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:43.404151 (+   392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:07:43.404209 (+    58us) write_op.cc:312] APPLY: finished
0709 13:07:43.404698 (+   489us) log.cc:844] Serialized 119 byte log entry
0709 13:07:43.404922 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:43.405120 (+   198us) write_op.cc:454] Released schema lock
0709 13:07:43.405196 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:43.450975 (+ 45779us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:43.451010 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1739558,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":366676,"apply.run_cpu_time_us":5564,"apply.run_wall_time_us":102903,"num_ops":17,"prepare.queue_time_us":162259,"prepare.run_cpu_time_us":21818,"prepare.run_wall_time_us":160243,"raft.queue_time_us":165066,"raft.run_cpu_time_us":30985,"raft.run_wall_time_us":266158,"replication_time_us":288176,"spinlock_wait_cycles":781184,"thread_start_us":500497,"threads_started":4,"wal-append.queue_time_us":38872,"wal-append.run_cpu_time_us":13167,"wal-append.run_wall_time_us":1669206}]]}
I20260709 13:07:48.223944 26448 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.142845 26514 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:07:48.106676 26386 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.226112 26386 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.203644 26531 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:48.200126 23111 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:48.200145 26532 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.205183 26152 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:48.205502 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.229089 22580 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:48.136787 26548 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.221542 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.230031 26546 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.231122 26548 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.206480 22581 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:48.149293 26542 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:07:48.232846 22506 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:48.233142 26549 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:48.155627 26558 consensus_queue.cc:1059] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:07:48.234866 26558 raft_consensus.cc:3055] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:48.235208 26558 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:48.176379 26076 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.236793 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.237310 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.237636 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.207485 26552 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.207986 26393 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.238528 26393 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:48.238952 26393 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.239557 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.231153 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.242633 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.243757 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.106566 26551 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.138128 26493 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.224494 26357 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.124868 26526 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.137169 26380 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:07:48.163455 26507 consensus_queue.cc:1059] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:07:48.212298 23104 rpcz_store.cc:269] 0709 13:07:44.947160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.950081 (+  2921us) service_pool.cc:224] Handling call
0709 13:07:48.179648 (+3229567us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54005b27d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:48.179760 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5590835072}
I20260709 13:07:48.215853 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.216256 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:48.216768 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.212976 22331 catalog_manager.cc:5697] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.320420 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:48.220271 26029 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:48.191028 22431 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:48.171864 23107 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:48.136930 26545 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.207437 26522 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.280999 26537 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.345633 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.282225 22473 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:48.252457 26198 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.235986 26558 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.249778 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:48.284756 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 138339us
I20260709 13:07:48.353346 22424 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:48.353569 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.355723 22545 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:48.358642 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:48.351877 22398 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:48.284756 26551 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.286444 22502 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:48.364998 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.365376 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.287161 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.277894 26524 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.276633 26357 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.288692 22425 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:48.291610 22433 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:48.276324 26493 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.383814 22574 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:48.311996 22508 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:48.280014 26526 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.321363 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.330029 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.385418 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.385799 22428 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:48.318635 23113 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:48.386076 22573 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
W20260709 13:07:48.331298 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 115124us
I20260709 13:07:48.320333 22331 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 9, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 9 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.334719 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.338594 22500 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:48.341291 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.344390 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.389001 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.390376 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.346539 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.348565 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:48.349268 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 67146.2us
I20260709 13:07:48.349418 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.350088 22504 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:48.360420 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:48.366115 22578 raft_consensus.cc:2410] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:48.366478 23112 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:48.375730 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:48.443534 22575 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:48.361892 26507 consensus_queue.cc:1243] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer 10c2f471167442c0b75d8cd50ed8c40c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:48.444221 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.374399 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.376405 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.377102 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.445315 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.363893 26542 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.437652 22507 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:48.448884 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:48.449548 22499 raft_consensus.cc:2376] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9. Re-sending same reply.
I20260709 13:07:48.361186 26076 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.437592 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.353780 26552 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.439337 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.439457 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.361342 26546 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:48.439188 22331 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 11, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 11 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.440062 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.455265 22505 raft_consensus.cc:2410] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:48.463618 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:48.468248 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 75805us
I20260709 13:07:48.453953 22582 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:48.474917 22331 catalog_manager.cc:5697] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 10, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 10 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:48.474973 22508 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:48.474483 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.440593 22501 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
W20260709 13:07:48.437803 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 60874.5us
I20260709 13:07:48.474095 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.440389 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:48.476406 22331 catalog_manager.cc:5697] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 4 to 6, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 6 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.478163 22504 raft_consensus.cc:2376] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12. Re-sending same reply.
I20260709 13:07:48.377648 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:48.373301 26522 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:48.446076 22428 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:48.485260 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:48.378124 23079 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.685s (SENT) [suppressed 35 similar messages]
I20260709 13:07:48.389169 26152 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.459125 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.372185 26512 consensus_queue.cc:1059] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:07:48.473260 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.477649 22547 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:48.441874 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.478866 22331 catalog_manager.cc:5697] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:48.478808 22507 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:48.475978 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.462352 22574 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:48.461869 22396 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:48.480890 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:48.481877 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 104294us
I20260709 13:07:48.542364 22582 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:48.482389 26531 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.477661 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:48.544341 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 82545.9us
W20260709 13:07:48.494163 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 133817us
I20260709 13:07:48.484086 22473 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:48.495050 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.544616 22331 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.495734 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:48.545488 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 61488.9us
I20260709 13:07:48.341179 26029 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.549540 22429 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:48.551292 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:48.552136 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.498674 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.499897 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.553485 22581 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:48.498674 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.370069 26198 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:48.523567 26570 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:07:48.524224 22454 debug-util.cc:398] Leaking SignalData structure 0x7b0800165fe0 after lost signal to thread 21315
W20260709 13:07:48.573348 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08000bad40 after lost signal to thread 22365
W20260709 13:07:48.574632 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2e60 after lost signal to thread 22457
W20260709 13:07:48.574962 22454 debug-util.cc:398] Leaking SignalData structure 0x7b080017e180 after lost signal to thread 22458
W20260709 13:07:48.576035 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003d63e0 after lost signal to thread 22532
W20260709 13:07:48.576321 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6400 after lost signal to thread 22533
I20260709 13:07:48.524302 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:48.579679 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6740 after lost signal to thread 22545
I20260709 13:07:48.528786 26512 consensus_queue.cc:1243] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Peer 10c2f471167442c0b75d8cd50ed8c40c log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:48.459421 26394 consensus_queue.cc:1059] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:07:48.530087 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.472584 26307 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.532109 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.522269 22573 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:07:48.536609 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.441058 26529 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.537998 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.600966 22501 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:48.595162 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:48.540409 22546 leader_election.cc:400] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:07:48.601938 22546 leader_election.cc:403] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:48.483429 26546 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:48.455051 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.546161 22331 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.497151 26522 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:48.544921 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 67328.8us
I20260709 13:07:48.558480 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.537199 26448 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:48.543970 26152 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:07:48.560963 26470 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:48.561277 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.554834 26388 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:48.563330 26357 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.565022 26554 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:48.565804 26198 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.567358 26548 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:48.568888 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.560984 26029 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.570096 26545 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.571213 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:48.524977 26569 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.385s	user 0.000s	sys 0.001s
I20260709 13:07:48.647442 26448 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:48.582796 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.586870 22576 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:07:48.589329 22472 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.611s (SENT)
I20260709 13:07:48.678754 22472 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:48.679648 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 90384us
I20260709 13:07:48.584137 22398 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:48.681183 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 97130.6us
W20260709 13:07:48.592651 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.592994 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.595142 22424 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:48.595326 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.685789 22428 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:48.593925 22506 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
W20260709 13:07:48.597245 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 219153us
I20260709 13:07:48.559432 26076 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:48.543339 22545 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:48.603550 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 63271us
I20260709 13:07:48.617318 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.655959 26388 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:48.691026 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 147750us
I20260709 13:07:48.691823 22545 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:48.547839 26393 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:48.615597 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.641534 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.649108 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.604040 26454 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:48.654834 23112 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:07:48.666949 26548 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:48.697633 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:48.623684 26546 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.616005 26257 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:07:48.649995 26522 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.674625 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:48.581825 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003bdd40 after lost signal to thread 22606
I20260709 13:07:48.676152 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:48.710171 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3600 after lost signal to thread 22607
I20260709 13:07:48.687885 22430 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:48.624051 22331 catalog_manager.cc:5697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 7, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 7 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:48.687964 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:48.680850 22472 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Timed out: RequestConsensusVote RPC to 127.20.208.1:43859 timed out after 1.699s (SENT)
I20260709 13:07:48.680850 26448 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.667361 26554 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.693310 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.694454 22425 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:48.694427 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 92477.9us
I20260709 13:07:48.657563 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.701416 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.600775 26468 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:07:48.693020 23105 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:48.695875 22546 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:48.695147 23079 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:48.707341 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.738981 22433 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:48.695271 26545 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:48.738992 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 43912.4us
I20260709 13:07:48.696199 26454 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.708506 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.689291 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:48.712296 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.711720 22331 catalog_manager.cc:5697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:48.714672 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08002f59a0 after lost signal to thread 23137
I20260709 13:07:48.744073 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:48.744542 22454 debug-util.cc:398] Leaking SignalData structure 0x7b080032af60 after lost signal to thread 23138
W20260709 13:07:48.744894 22454 debug-util.cc:398] Leaking SignalData structure 0x7b080018aea0 after lost signal to thread 26122
W20260709 13:07:48.745383 22454 debug-util.cc:398] Leaking SignalData structure 0x7b0800310d60 after lost signal to thread 26388
I20260709 13:07:48.688398 26357 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:48.748049 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.694947 26388 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.715796 22428 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:48.738420 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.707592 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.706377 26529 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:48.753986 23076 leader_election.cc:336] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.600s (SENT)
W20260709 13:07:48.745617 22454 debug-util.cc:398] Leaking SignalData structure 0x7b080039e7a0 after lost signal to thread 26393
W20260709 13:07:48.745592 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 49810.9us
I20260709 13:07:48.744805 22331 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.741756 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:48.735153 22473 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:48.705892 26256 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:48.750718 22425 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:07:48.758280 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003f70c0 after lost signal to thread 26394
I20260709 13:07:48.757826 22331 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 9, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 9 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.759047 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:48.758636 22454 debug-util.cc:398] Leaking SignalData structure 0x7b0800221000 after lost signal to thread 26401
W20260709 13:07:48.760033 22454 debug-util.cc:398] Leaking SignalData structure 0x7b0800382780 after lost signal to thread 26403
W20260709 13:07:48.760389 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003540e0 after lost signal to thread 26404
I20260709 13:07:48.749384 26377 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:48.715967 26554 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:48.760995 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003aeee0 after lost signal to thread 26410
W20260709 13:07:48.761382 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003fa660 after lost signal to thread 26422
W20260709 13:07:48.761656 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6700 after lost signal to thread 26425
W20260709 13:07:48.756383 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 58845.5us
I20260709 13:07:48.757623 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:48.756800 22426 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:48.760516 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:48.761884 22454 debug-util.cc:398] Leaking SignalData structure 0x7b080033c7c0 after lost signal to thread 26448
W20260709 13:07:48.762941 22454 debug-util.cc:398] Leaking SignalData structure 0x7b0800333de0 after lost signal to thread 26454
I20260709 13:07:48.762987 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.762957 23106 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:48.705368 26531 consensus_queue.cc:1059] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 13:07:48.766785 22454 debug-util.cc:398] Leaking SignalData structure 0x7b080032aa80 after lost signal to thread 26466
W20260709 13:07:48.767386 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003aec40 after lost signal to thread 26469
W20260709 13:07:48.767904 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003f6860 after lost signal to thread 26470
I20260709 13:07:48.749830 26454 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.784063 26393 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.762768 26552 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:48.789047 26576 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:07:48.765517 26548 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.790243 26548 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.753013 26529 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:48.792989 26529 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.795076 22500 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:07:48.742990 26530 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:48.768997 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.809603 22501 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
W20260709 13:07:48.768172 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6a80 after lost signal to thread 26471
I20260709 13:07:48.777051 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.747936 26542 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:48.748385 26357 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:48.799234 23077 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:48.831406 23077 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:48.831653 22472 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:48.799651 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:48.755765 26578 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:48.804754 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.806169 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.767308 26545 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:48.775033 26307 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:48.810642 22454 debug-util.cc:398] Leaking SignalData structure 0x7b0800139560 after lost signal to thread 26477
I20260709 13:07:48.759361 22331 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 2 to 7, term changed from 9 to 10, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1), VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2), VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3), VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.811270 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.813201 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.750798 26404 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:07:48.814677 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.819806 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.765431 26535 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:48.841444 26552 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:48.858772 26393 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:07:48.822082 26527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.014s	sys 0.026s
W20260709 13:07:48.863426 26527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.014s	sys 0.026s
I20260709 13:07:48.863355 26393 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:48.822590 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:48.809944 26532 consensus_meta.cc:287] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.005s
I20260709 13:07:48.808494 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:48.864861 22501 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:48.865818 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.866920 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.867456 22501 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:48.871049 22575 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:48.858121 22399 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:48.859036 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.850275 22576 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:48.859457 22331 catalog_manager.cc:5697] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 6, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 6 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.875479 22331 catalog_manager.cc:5697] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 9 to 11, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:48.860047 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.860670 22508 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:48.861166 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.879699 22579 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:48.879511 22331 catalog_manager.cc:5697] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 7, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 7 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:48.839901 22472 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:48.841320 23113 raft_consensus.cc:2410] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:48.841780 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:48.764250 26377 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:48.763917 26256 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:48.881197 22331 catalog_manager.cc:5697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:48.849787 22454 debug-util.cc:398] Leaking SignalData structure 0x7b0800387220 after lost signal to thread 26479
I20260709 13:07:48.813938 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:48.884742 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08004037c0 after lost signal to thread 26482
I20260709 13:07:48.881815 22472 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:48.885067 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca3e0 after lost signal to thread 26483
I20260709 13:07:48.868229 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.883724 22430 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:48.886381 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:48.886983 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6040 after lost signal to thread 26484
W20260709 13:07:48.887624 22454 debug-util.cc:398] Leaking SignalData structure 0x7b0800044280 after lost signal to thread 26493
I20260709 13:07:48.884542 22331 catalog_manager.cc:5697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 9, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 9 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
W20260709 13:07:48.887985 22454 debug-util.cc:398] Leaking SignalData structure 0x7b08003dec80 after lost signal to thread 26494
I20260709 13:07:48.837291 26357 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.888717 22472 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:48.884307 22506 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:07:48.889046 22331 catalog_manager.cc:5697] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 9, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 9 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:48.847730 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:48.845577 26545 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.903544 22472 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:48.845747 26537 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:48.836620 26587 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:48.909112 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:48.862221 26535 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.905727 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.902743 22331 catalog_manager.cc:5697] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 5 to 6, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 6 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.907081 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.924166 22576 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:48.852619 26530 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:48.920910 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:48.925990 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.926884 22331 catalog_manager.cc:5697] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 11, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:48.886287 26076 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:48.888993 26256 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.883116 26377 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.907359 26380 raft_consensus.cc:2764] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:48.888363 26542 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:48.907560 26551 raft_consensus.cc:2764] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:48.976516 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.848666 26526 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:07:48.980626 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.908638 26545 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.918089 26388 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.094676 26388 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:49.097337 26393 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:48.933549 26535 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.904063 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:48.909361 26507 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:48.990571 22331 catalog_manager.cc:5697] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 9 to 10, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
W20260709 13:07:49.116261 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 212255us
I20260709 13:07:48.966763 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:48.828339 26448 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:49.081110 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.909541 26537 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:49.081552 22575 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
W20260709 13:07:48.985096 26589 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
I20260709 13:07:49.133399 22424 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:49.134284 26448 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:49.098341 26545 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.135552 22503 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:49.137878 26545 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:48.887792 26549 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.105268 22398 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:49.107676 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:49.141577 26584 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:49.141855 26468 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.142334 26468 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.142959 26468 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.914573 26546 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.147415 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:49.148033 26546 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:49.148674 22505 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:49.111426 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:49.117161 22331 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 4 to 9, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 9 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.078025 26076 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.131282 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:49.132643 26537 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.127859 26426 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:07:49.154927 22331 catalog_manager.cc:5697] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 9, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 9 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:49.162931 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 418899us
I20260709 13:07:48.920372 26454 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.163239 22331 catalog_manager.cc:5697] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 8, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 8 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:49.156205 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 393824us
I20260709 13:07:49.166365 22396 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.166698 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.167068 22331 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 9, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 9 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.170297 22331 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 10, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 10 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.172112 22331 catalog_manager.cc:5697] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 3 to 6, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 6 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:49.125787 26542 raft_consensus.cc:697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:49.174356 22545 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:49.128897 26587 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:49.174778 26152 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:49.162220 26076 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.177691 22396 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.184317 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.191210 26454 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:49.173213 26388 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:49.198566 26558 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.204591 26257 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:49.205353 26257 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:49.206300 26257 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.181236 26198 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:49.221551 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47278.8us
I20260709 13:07:49.226480 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.227315 22504 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:49.227146 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:49.228309 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.229611 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.232151 22501 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:49.233640 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:49.238788 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:49.240720 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.243464 22502 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:49.200021 26256 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.247458 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.248276 22500 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:49.248911 26256 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:49.237061 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.241416 22506 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:49.219300 26200 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.253172 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.254779 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 1869) took 1123 ms. Trace:
I20260709 13:07:49.255210 22579 rpcz_store.cc:276] 0709 13:07:48.131446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.131565 (+   119us) service_pool.cc:224] Handling call
0709 13:07:49.254567 (+1123002us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540016add4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:49.254683 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599718272}
I20260709 13:07:49.258752 22504 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:49.263329 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.264154 22499 raft_consensus.cc:2368] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13.
I20260709 13:07:49.264686 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:49.265641 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:49.246061 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 61830.5us
I20260709 13:07:49.212023 26554 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.242435 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.224907 26587 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:49.266719 22396 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.269517 22508 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:49.270480 26554 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:49.272522 26577 log.cc:927] Time spent T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.630s	user 0.001s	sys 0.004s
I20260709 13:07:49.269245 26448 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:07:49.283898 26542 consensus_queue.cc:237] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.295220 26468 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.252816 26530 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.300036 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.299924 22399 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:49.236495 26393 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:49.328109 22501 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:49.301673 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:49.297848 26522 consensus_meta.cc:287] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.000s
I20260709 13:07:49.251595 26426 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:49.304751 22471 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.011s	sys 0.051s
I20260709 13:07:49.302601 26200 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.312220 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:49.328946 22503 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:49.331252 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:49.304780 26478 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.356176 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:49.342769 22501 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:49.360013 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:49.344460 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:49.301030 26307 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:49.348615 22471 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.011s	sys 0.051s
I20260709 13:07:49.297925 26377 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:49.313561 22427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.020s	sys 0.028s
I20260709 13:07:49.348872 22398 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:49.350381 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.356441 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:49.376798 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:49.377269 22433 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.360325 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:49.363126 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:49.353533 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:49.370029 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:49.323673 26531 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.017s	sys 0.032s
W20260709 13:07:49.334395 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 482712us
W20260709 13:07:49.380229 23076 leader_election.cc:336] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.814s (SENT)
W20260709 13:07:49.371373 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 59244.4us
W20260709 13:07:49.381865 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 534188us
W20260709 13:07:49.375638 22427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.020s	sys 0.029s
I20260709 13:07:49.391609 23077 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:49.382043 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:49.371843 22431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.005s	sys 0.047s
I20260709 13:07:49.344086 26230 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:49.382995 22429 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:49.379371 22546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.019s	sys 0.030s
W20260709 13:07:49.392496 22431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.006s	sys 0.047s
W20260709 13:07:49.398102 22546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.019s	sys 0.030s
W20260709 13:07:49.398718 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 641157us
I20260709 13:07:49.370723 26200 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.407687 23109 raft_consensus.cc:1240] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:49.403110 23079 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:07:49.379817 26531 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.017s	sys 0.032s
I20260709 13:07:49.403831 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.405198 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.378058 26454 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:49.384011 26426 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:49.445888 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 63915.1us
I20260709 13:07:49.349429 26393 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.351966 26522 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.394716 26230 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.457671 22545 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.463613 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:49.394268 26551 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:49.463152 22500 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:49.413164 26200 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.464323 22503 raft_consensus.cc:2368] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13.
I20260709 13:07:49.462960 26198 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.442444 26532 raft_consensus.cc:3055] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:49.470503 26426 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:49.470909 26426 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.471498 26478 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:49.471951 26478 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.407096 26587 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:49.450305 26357 consensus_meta.cc:287] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 13:07:49.478760 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:49.479399 22508 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.410929 26152 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:07:49.481454 22545 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.483292 22432 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:49.487123 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.488642 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.491101 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.493858 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.495237 22575 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:49.498270 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:49.461602 26404 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.502671 22545 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:49.503684 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.504364 22573 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:07:49.470305 26256 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.506093 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.506290 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:49.506474 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:49.509819 26527 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:49.510192 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:49.510871 26529 consensus_meta.cc:287] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.717s	user 0.006s	sys 0.006s
I20260709 13:07:49.511513 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:49.511323 26529 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.507539 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:49.508395 26599 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:07:49.507970 26076 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.508018 26595 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.513994 22582 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.505219 26537 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.470294 26532 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:49.507930 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.519011 22545 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.441252 26590 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.466662 26454 raft_consensus.cc:697] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:49.466683 26230 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.526175 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34614 (request call id 505) took 1294 ms. Trace:
I20260709 13:07:49.536278 22432 rpcz_store.cc:276] 0709 13:07:48.231970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.441646 (+209676us) service_pool.cc:224] Handling call
0709 13:07:49.526000 (+1084354us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54000d7d54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:49.526097 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167034240}
I20260709 13:07:49.537519 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:49.538679 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.539331 22502 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:49.540366 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.540939 22502 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:49.541777 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:49.543521 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.417117 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.545609 22499 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:49.546504 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:49.548240 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:49.549014 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:49.549448 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:49.492501 26554 consensus_queue.cc:1059] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:07:49.550431 22500 raft_consensus.cc:1240] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.526371 22545 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:49.554348 22545 leader_election.cc:400] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13.
I20260709 13:07:49.556066 22545 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:49.559535 22508 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:49.510263 26527 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:49.562191 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.478186 26551 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.569909 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:49.573789 22503 raft_consensus.cc:2376] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9. Re-sending same reply.
I20260709 13:07:49.534502 26599 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.533090 26531 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.572829 22545 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.572321 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.574914 26256 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.576063 26512 raft_consensus.cc:3055] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:49.584672 22320 maintenance_manager.cc:419] P 71b24ec4eeaf4affa54fd8c740a7795b: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033379
I20260709 13:07:49.585860 26200 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.564998 26595 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:49.587153 26426 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.590966 22574 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.591040 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.591701 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.484318 26357 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.595093 26599 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.522351 26447 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:07:49.550849 26377 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:49.548563 26454 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.593878 22499 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:49.670612 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 289726us
I20260709 13:07:49.683139 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.693775 22424 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
W20260709 13:07:49.697762 26600 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.259s	user 0.003s	sys 0.000s
I20260709 13:07:49.698346 26537 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:49.702090 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.704849 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 506) took 1472 ms. Trace:
I20260709 13:07:49.705302 22431 rpcz_store.cc:276] 0709 13:07:48.232258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.717008 (+484750us) service_pool.cc:224] Handling call
0709 13:07:48.750610 (+ 33602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.750943 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.750971 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.765599 (+ 14628us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.397698 (+632099us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:49.417751 (+ 20053us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.461057 (+ 43306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.461142 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.704555 (+243413us) raft_consensus.cc:1685] finished
0709 13:07:49.704576 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.704767 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92423,"prepare.queue_time_us":63485,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":63091,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":4964,"spinlock_wait_cycles":127104,"thread_start_us":626278,"threads_started":1,"wal-append.queue_time_us":793387}
I20260709 13:07:49.707572 26551 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:49.707913 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.708755 22578 raft_consensus.cc:2393] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:49.709204 26200 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:49.709368 26426 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:49.710000 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.710723 22578 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:49.687103 26599 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.665542 26524 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:49.691337 26535 consensus_meta.cc:287] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.003s
I20260709 13:07:49.711953 23076 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:49.692967 26468 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:49.568491 26527 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.631487 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:49.744652 22503 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.603479 26256 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.747761 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:49.729429 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 380655us
W20260709 13:07:49.733821 23110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.004s	sys 0.020s
W20260709 13:07:49.749109 23110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.004s	sys 0.020s
I20260709 13:07:49.604307 26601 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.736238 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.737064 23076 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.764009 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:49.764923 22574 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:49.671089 26595 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:49.765973 23104 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:49.766552 22398 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:49.739430 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:49.766644 22472 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:49.718941 26357 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:49.752753 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.754684 22502 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:49.602234 26529 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:49.615672 26152 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.603781 26512 raft_consensus.cc:740] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:49.805101 22573 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:49.603945 22545 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:49.807242 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 203362us
I20260709 13:07:49.809690 26388 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:49.810266 26552 consensus_queue.cc:1059] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:49.810559 26592 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:49.811226 26552 raft_consensus.cc:3055] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:49.811647 26552 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:49.794211 26597 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:49.770583 23076 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:49.771247 22428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2517) took 1017 ms. Trace:
I20260709 13:07:49.695717 26076 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:49.767350 22499 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:07:49.818679 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48185.1us
I20260709 13:07:49.746196 26604 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.794538 26522 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:49.698917 26377 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:49.815932 22577 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:49.814214 22428 rpcz_store.cc:276] 0709 13:07:48.753977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.754257 (+   280us) service_pool.cc:224] Handling call
0709 13:07:48.754548 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.767881 (+ 13333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.767923 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.794608 (+ 26685us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.302681 (+508073us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:49.302741 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.304227 (+  1486us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.697449 (+393222us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b2400130508. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069bbb9c4 00007f0069bb9acb 00007f0069d74dc9 00007f0069d74a55 00007f0069d7409d 00007f006c9a610e 00007f006c9bd88c 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221
0709 13:07:49.751271 (+ 53822us) raft_consensus.cc:1685] finished
0709 13:07:49.751291 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.771168 (+ 19877us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12967,"raft.queue_time_us":74298,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":45,"spinlock_wait_cycles":67088640,"thread_start_us":430175,"threads_started":1,"wal-append.queue_time_us":604761}
I20260709 13:07:49.819043 22503 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:49.755699 26256 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.821291 23076 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:49.841697 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 438638us
I20260709 13:07:49.604516 26532 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.768450 26554 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.842365 23076 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.852130 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:49.823041 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.743762 26535 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:49.804806 26448 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.862140 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.804306 26380 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.804589 26393 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:49.855244 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.866802 22499 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:49.822280 26604 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.827065 26603 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.872776 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:49.857259 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 465668us
I20260709 13:07:49.839165 26377 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:49.874239 23077 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:49.846038 26537 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.877067 22427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2511) took 1319 ms. Trace:
I20260709 13:07:49.819309 26552 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:49.804121 26602 consensus_queue.cc:1059] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:07:49.879431 23077 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:49.881436 23107 raft_consensus.cc:2368] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13.
I20260709 13:07:49.855509 26597 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.883059 22427 rpcz_store.cc:276] 0709 13:07:48.557994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.753658 (+195664us) service_pool.cc:224] Handling call
0709 13:07:48.754059 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.391849 (+637790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.391878 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.495624 (+103746us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b2c00000f48. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:49.507308 (+ 11684us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.689513 (+182205us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:49.701943 (+ 12430us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.702160 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.702230 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.868996 (+166766us) raft_consensus.cc:1685] finished
0709 13:07:49.876817 (+  7821us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.876999 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":532,"prepare.queue_time_us":13145,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":74622,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":8293,"spinlock_wait_cycles":4411776,"thread_start_us":809842,"threads_started":2,"wal-append.queue_time_us":243530}
I20260709 13:07:49.854110 26545 consensus_queue.cc:1059] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:07:49.872797 26604 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.882545 26377 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.876403 26603 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:49.897923 26470 raft_consensus.cc:3055] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:49.874469 26076 consensus_queue.cc:1059] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:49.913496 26552 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.915230 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.941283 22573 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
W20260709 13:07:49.920657 26622 log.cc:927] Time spent T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:49.909842 26603 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.917418 26470 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:49.952785 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 143957us
I20260709 13:07:49.956977 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:49.958124 22573 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:49.959952 22545 leader_election.cc:400] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13.
I20260709 13:07:49.960507 22545 leader_election.cc:403] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:07:49.886009 26595 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:49.962597 26617 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:07:49.952947 26611 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.964754 26470 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:49.967166 26605 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.128s	user 0.003s	sys 0.000s
I20260709 13:07:49.968034 26388 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.969560 26478 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:49.856674 26596 consensus_queue.cc:1175] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" responder_term: 10 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: [9.5-9.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:49.947829 26602 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:49.980362 26388 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13.
I20260709 13:07:49.966909 26470 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.981750 22545 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:49.944033 26612 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.998977 22545 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:50.006425 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 127080us
I20260709 13:07:50.007159 23077 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:50.001756 26626 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:07:50.011780 26529 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:50.016961 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.017868 26478 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:49.968104 26606 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:50.035399 22396 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:50.037704 26478 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:50.038161 26478 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.038609 26478 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.038756 22506 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:50.039422 22503 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:50.041338 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:50.040244 22506 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:50.041962 22507 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.046672 26478 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.038067 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:50.049264 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:50.049705 22396 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:50.051154 22431 raft_consensus.cc:1240] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.052573 26404 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.053967 22396 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:50.054288 26404 consensus_queue.cc:1059] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:50.055925 26029 raft_consensus.cc:3055] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:50.056296 26426 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.056416 26029 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:50.057531 26029 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.059015 26426 consensus_queue.cc:1059] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:50.060185 26307 raft_consensus.cc:3055] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:50.060599 26307 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:50.061690 26029 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.061436 26307 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.062319 26603 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.062983 26307 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.065806 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:50.003770 26596 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:50.066888 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:50.072913 22580 raft_consensus.cc:2393] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 10: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:49.982625 26530 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:49.980268 26602 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.107987 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:50.108830 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.109408 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:50.080988 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:50.081563 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:50.084227 22507 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
W20260709 13:07:50.121891 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 70472.7us
I20260709 13:07:50.016026 26527 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.126281 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:50.104882 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:50.027601 26529 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:50.129421 22578 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 10: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:50.133262 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 126173us
W20260709 13:07:50.135677 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.083292 26596 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.134812 23077 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:50.144889 22431 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:50.104183 26609 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:50.136433 22574 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:50.141718 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:50.142477 22425 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:50.143410 22428 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:50.113793 26597 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.149878 23077 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:50.107314 26454 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:50.125164 26610 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:50.156703 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:50.103343 26076 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:50.159286 23111 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:50.102952 26468 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:50.103199 26198 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:07:50.148847 26633 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:07:50.102768 26587 consensus_queue.cc:1059] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:07:50.193634 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:50.199447 22506 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.152122 26596 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.203105 22580 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:07:50.126130 26591 consensus_queue.cc:1059] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:07:50.189285 26230 consensus_meta.cc:287] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.000s
I20260709 13:07:50.159551 26609 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:50.129639 26152 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:07:50.202093 26468 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:50.218245 26627 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:07:50.133435 26512 consensus_queue.cc:260] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.176301 26478 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:50.203586 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 132927us
W20260709 13:07:50.231685 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.204914 26597 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.165323 26542 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:50.166965 26632 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:07:50.193018 26076 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.226935 26609 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.181762 26454 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.266084 26638 consensus_queue.cc:1059] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:50.266916 26631 log.cc:927] Time spent T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:07:50.267910 26645 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:50.268257 26640 raft_consensus.cc:3055] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:50.257303 26597 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.182018 26610 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.273041 23110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 761) took 1083 ms. Trace:
I20260709 13:07:50.273433 26448 raft_consensus.cc:3055] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:50.273918 26448 raft_consensus.cc:740] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:50.273519 23110 rpcz_store.cc:276] 0709 13:07:49.189840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.190009 (+   169us) service_pool.cc:224] Handling call
0709 13:07:49.190416 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.749535 (+559119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.749568 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.750063 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.961054 (+210991us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:49.961115 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.961199 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.272767 (+311568us) raft_consensus.cc:1685] finished
0709 13:07:50.272787 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.272946 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":399569,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":56,"thread_start_us":706116,"threads_started":2,"wal-append.queue_time_us":184203}
W20260709 13:07:50.278961 26639 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:50.280663 26597 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.274901 26448 consensus_queue.cc:260] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.283104 26448 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.237125 26529 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.267781 26527 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:50.286562 26618 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:07:50.224287 22506 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:50.289713 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:50.290446 22506 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:50.268900 26637 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:07:50.298792 26377 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.300359 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:50.304191 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:50.344372 22505 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:50.305876 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:50.307855 26532 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.310827 26643 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:50.314831 26380 raft_consensus.cc:3055] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:50.310770 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.254760 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.401201 22427 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:50.402406 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.355924 22506 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:50.268726 26640 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:50.374627 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:50.377693 23113 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:50.405742 22502 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:50.405153 23112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 756) took 1318 ms. Trace:
W20260709 13:07:50.407424 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 152729us
I20260709 13:07:50.408663 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1680) took 1076 ms. Trace:
I20260709 13:07:50.409529 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.378773 26377 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.379221 26542 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:50.379823 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:50.411903 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 257344us
I20260709 13:07:50.258896 26512 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:50.412683 23077 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:50.370983 26256 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.382134 26609 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.418139 26609 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.418365 26256 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:50.419305 22576 raft_consensus.cc:2368] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:07:50.385682 22430 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:50.371085 26526 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:50.420888 26526 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.423064 26526 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:50.389590 23079 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:50.389755 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1682) took 1011 ms. Trace:
I20260709 13:07:50.390551 26468 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:50.391472 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:50.370771 26595 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:50.227087 26230 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.383332 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:50.425285 26609 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:50.426915 23110 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:50.428036 23110 raft_consensus.cc:1240] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:50.428706 26595 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.411866 26542 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.431413 26542 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:50.432696 26230 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:50.433485 22426 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 12: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:50.424638 22501 rpcz_store.cc:276] 0709 13:07:49.378544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.378775 (+   231us) service_pool.cc:224] Handling call
0709 13:07:49.379064 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.391093 (+ 12029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.391123 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.412174 (+ 21051us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.819798 (+407624us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:49.947409 (+127611us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.948369 (+   960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.948456 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.389533 (+441077us) raft_consensus.cc:1685] finished
0709 13:07:50.389551 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.389692 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12243,"prepare.queue_time_us":103778,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":16782,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":11842,"spinlock_wait_cycles":4650368,"thread_start_us":423625,"threads_started":2,"wal-append.queue_time_us":505494}
I20260709 13:07:50.434653 22474 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:50.437804 23079 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:50.446398 26651 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.447255 26651 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.406914 23112 rpcz_store.cc:276] 0709 13:07:49.086418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.114413 (+ 27995us) service_pool.cc:224] Handling call
0709 13:07:49.143530 (+ 29117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.594044 (+450514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.594074 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.604550 (+ 10476us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.863502 (+258952us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:49.863545 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.863616 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.404948 (+541332us) raft_consensus.cc:1685] finished
0709 13:07:50.404967 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.405097 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":446303,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":614875,"threads_started":2,"wal-append.queue_time_us":338780}
I20260709 13:07:50.409142 22504 rpcz_store.cc:276] 0709 13:07:49.332010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.332375 (+   365us) service_pool.cc:224] Handling call
0709 13:07:49.334090 (+  1715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.334462 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:49.771580 (+437118us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.408199 (+636619us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.408323 (+   124us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:50.408370 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.408442 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.408589 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":551019,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":152269,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":1055106,"threads_started":3,"wal-append.queue_time_us":374417}
I20260709 13:07:50.453812 23105 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:50.457614 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:50.458578 23110 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:50.371174 26257 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:50.461341 22504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:07:50.462224 22504 raft_consensus.cc:606] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:50.449170 26637 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:50.398301 26380 raft_consensus.cc:740] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:50.462572 22504 raft_consensus.cc:614] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:50.475931 26380 consensus_queue.cc:260] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.477187 26380 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.444945 26552 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.485299 26596 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.488093 26596 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:50.470325 26604 consensus_meta.cc:287] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.000s
I20260709 13:07:50.473450 26257 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.406486 26548 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:07:50.489380 26602 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:50.490928 26595 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:50.406404 26551 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.469152 26657 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:50.457911 26601 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:50.463356 23109 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:50.505910 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:50.512769 23110 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.512378 22508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:07:50.514577 22508 raft_consensus.cc:606] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.514943 22508 raft_consensus.cc:614] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:50.511170 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 101717us
W20260709 13:07:50.520804 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 187720us
I20260709 13:07:50.522897 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:50.522004 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:50.527276 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.529454 22430 raft_consensus.cc:1240] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:50.530220 22504 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:50.405436 26643 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.531945 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:50.532586 22504 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.533241 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:50.535105 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:50.535773 22501 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:07:50.511989 26609 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.537904 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:50.512620 26601 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:50.544814 22504 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:50.522966 26640 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.546698 22507 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:07:50.547153 26640 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.538911 26609 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.548864 26606 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:50.549433 26606 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.549944 26643 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.550872 26610 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.506989 26604 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:50.553328 26470 consensus_meta.cc:287] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.001s
I20260709 13:07:50.554174 26604 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:50.555418 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:50.556021 22508 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:50.558769 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 124222us
I20260709 13:07:50.558642 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.559661 22474 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:50.568302 26658 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:07:50.538352 26632 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 13:07:50.599901 26599 consensus_meta.cc:287] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.857s	user 0.009s	sys 0.000s
I20260709 13:07:50.600358 26599 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.601473 22581 raft_consensus.cc:1240] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:50.556034 26601 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.561789 23110 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:50.531378 26256 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.578241 26257 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:50.582520 22398 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:50.614686 22398 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:50.567276 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:50.562474 23104 raft_consensus.cc:2393] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:50.615304 22508 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:50.566218 26532 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:50.565836 26152 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.565290 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.561592 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:50.609761 22501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:07:50.619978 22501 raft_consensus.cc:606] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.620376 22501 raft_consensus.cc:614] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:50.621002 23112 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:50.621281 26599 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:50.622622 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63027.2us
I20260709 13:07:50.623410 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.624217 26648 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.619037 26426 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:50.624732 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.625700 26426 raft_consensus.cc:697] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:50.625941 26659 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.626677 26426 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.621261 26643 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:50.624886 26198 consensus_queue.cc:1059] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:07:50.624732 26601 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:50.621414 26652 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:07:50.630074 26076 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.622397 26448 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:50.631378 26448 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:50.632239 26448 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.628741 26535 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.634997 26601 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.635250 26454 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.638267 26522 raft_consensus.cc:3055] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:50.638728 26522 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:50.639595 26522 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.638666 22501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:07:50.641330 22501 raft_consensus.cc:606] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.628604 22474 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.641692 22501 raft_consensus.cc:614] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:50.642818 26522 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.643154 26659 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.650321 26530 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:50.650810 26530 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:50.651638 26530 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.655260 23111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 869) took 1125 ms. Trace:
I20260709 13:07:50.655864 22474 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.656276 26200 raft_consensus.cc:3055] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:50.656723 26200 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:50.657146 26599 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:50.655699 23111 rpcz_store.cc:276] 0709 13:07:49.529884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.530035 (+   151us) service_pool.cc:224] Handling call
0709 13:07:49.530353 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.180253 (+649900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.655024 (+474771us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b5400543654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:50.655196 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445826304}
W20260709 13:07:50.658264 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 96651.7us
W20260709 13:07:50.665534 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.677403 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.682227 22474 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.659132 22545 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:50.703645 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 44609.2us
I20260709 13:07:50.705049 22545 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:50.707175 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:50.707540 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 142341us
I20260709 13:07:50.707947 22474 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.708370 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:50.710707 22474 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.742019 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 2561) took 1040 ms. Trace:
I20260709 13:07:50.742728 22576 rpcz_store.cc:276] 0709 13:07:49.701625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.701836 (+   211us) service_pool.cc:224] Handling call
0709 13:07:50.710760 (+1008924us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54002d14d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:50.741919 (+ 31159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647496960}
W20260709 13:07:50.742295 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 328719us
I20260709 13:07:50.745357 22474 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.739993 26648 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.710357 26393 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:07:50.771149 26602 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:50.771557 26602 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:50.774115 26602 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.657610 26599 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:50.777494 26388 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.747946 26552 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.778112 26599 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.779520 26599 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:50.780630 26646 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:50.781257 26646 raft_consensus.cc:697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:50.782168 26646 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.703577 26609 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:50.776937 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 68675.5us
I20260709 13:07:50.788641 26660 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.789176 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.790432 26529 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.791888 22546 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:50.792184 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 46736.3us
I20260709 13:07:50.793236 26529 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.793877 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:50.794428 23111 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:50.747125 22474 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.802465 22427 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
I20260709 13:07:50.813066 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:50.814252 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:50.815150 22428 raft_consensus.cc:2393] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:50.821244 22426 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34614 (request call id 510) took 1467 ms (client timeout 1931 ms). Trace:
W20260709 13:07:50.824165 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 77147.4us
I20260709 13:07:50.825098 22474 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.827068 22474 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.828619 22474 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.821336 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:50.821635 22426 rpcz_store.cc:269] 0709 13:07:49.353768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.376534 (+ 22766us) service_pool.cc:224] Handling call
0709 13:07:50.821054 (+1444520us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540021ff54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:50.821190 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428256512}
I20260709 13:07:50.830811 23113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 876) took 1015 ms. Trace:
I20260709 13:07:50.829960 22427 raft_consensus.cc:2393] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:50.831640 26660 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.851274 26542 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.851929 26542 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.746752 26530 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.854205 26542 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:50.854808 26648 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.855635 26545 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.746616 26596 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.711151 26643 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.856640 26547 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.743909 26592 consensus_queue.cc:1059] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:07:50.857522 26592 raft_consensus.cc:3055] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:50.857914 26592 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:50.702734 26548 consensus_queue.cc:1059] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 13:07:50.858105 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:50.858745 26548 raft_consensus.cc:3055] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:50.859086 26548 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:50.831349 23113 rpcz_store.cc:276] 0709 13:07:49.815287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.815440 (+   153us) service_pool.cc:224] Handling call
0709 13:07:49.842979 (+ 27539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.405315 (+562336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.830503 (+425188us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54006982d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:50.830745 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229245312}
I20260709 13:07:50.702971 26532 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:50.857198 26547 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.866492 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:50.867168 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:50.868394 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:50.859894 26548 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.746416 26551 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.746501 26531 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:50.858155 26636 log.cc:927] Time spent T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.555s	user 0.032s	sys 0.047s
I20260709 13:07:50.890805 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.878930 22582 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:50.797689 26606 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.881943 23077 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:50.897650 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:50.657578 26200 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.860800 26532 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:50.900573 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.903810 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:50.866135 26660 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:50.902348 23077 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.913806 23077 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:50.916608 22499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:07:50.917367 22499 raft_consensus.cc:606] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:50.917989 22499 raft_consensus.cc:614] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:50.826133 26659 consensus_queue.cc:1059] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:07:50.922241 23110 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:50.897149 26653 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.898521 26545 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.914814 26535 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.918042 26604 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.909117 26532 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.907390 26512 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.909657 26640 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:50.923770 26596 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:50.908733 26531 raft_consensus.cc:697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:50.915278 26548 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.918344 26595 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.930318 26592 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.924492 26651 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.945523 26606 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:50.955847 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:50.956384 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:50.956027 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:50.956738 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:50.960693 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:50.955319 26426 consensus_queue.cc:1059] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:07:50.962854 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:50.963546 26609 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.935065 26653 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.966053 26531 consensus_queue.cc:237] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.967211 26653 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.920861 26660 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.973764 26547 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.908403 26552 consensus_queue.cc:1059] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:07:50.974627 26660 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:50.975332 26660 raft_consensus.cc:3055] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:50.975711 26660 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:50.980780 26595 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.983213 26595 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:50.984997 26596 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:50.987581 26596 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:50.989926 26357 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.990592 26357 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:50.957517 23111 raft_consensus.cc:2393] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:51.016148 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:51.020135 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:51.014344 26620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.015s	sys 0.009s
I20260709 13:07:50.999799 26640 raft_consensus.cc:697] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:51.023900 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.029250 22502 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:51.026607 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.030771 26657 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.031117 22501 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:51.031944 22427 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:51.031263 26657 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:51.033886 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 133439us
I20260709 13:07:51.038260 23079 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:51.025480 26620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.016s	sys 0.010s
I20260709 13:07:51.027942 26599 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:07:51.041404 26152 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:51.042035 26152 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.044330 26152 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.044965 26377 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.052851 22545 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.058851 22474 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:51.059521 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.069793 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:51.070601 22582 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.071952 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.072325 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:51.073310 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.074527 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:51.075197 22504 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.078441 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.079198 22507 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:51.081879 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:51.017623 26660 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.080117 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.087894 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.055442 26357 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:51.087950 22504 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:51.091498 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.094179 22503 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:51.096436 22546 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.059821 26599 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:51.100181 22499 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:51.098913 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:51.099073 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.104169 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.056401 26152 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:07:51.102643 22396 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.104823 22502 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:51.109258 22474 leader_election.cc:400] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:07:51.109632 22474 leader_election.cc:403] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:51.110427 26671 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:51.110754 26426 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:51.111321 26426 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:51.103654 26307 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:51.111636 22396 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:51.115851 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:51.116686 26650 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:51.117329 26650 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:51.118261 26650 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:51.119787 26666 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:51.111992 26076 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:51.121170 26076 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:51.122120 26076 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.127508 26532 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.084039 26669 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.097784 26647 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:51.128957 26454 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.103724 26632 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.130030 26632 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.130553 26673 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.130762 26640 consensus_queue.cc:237] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.131084 26673 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.131734 22396 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:51.132633 26357 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:51.133294 26357 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:51.101871 26596 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:51.134188 26357 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.089967 26256 consensus_queue.cc:1059] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:07:51.099560 26542 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:07:51.132680 26603 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:51.136773 26542 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.137679 26542 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:51.138624 26542 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.080449 26530 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:51.146278 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.142396 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:07:51.149950 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 53601.9us
I20260709 13:07:51.151278 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:51.153741 22396 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.153776 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.155619 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:51.152660 26547 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.151903 26671 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.129266 26647 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:51.159006 26647 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.159552 26671 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:51.151701 26669 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.156991 26542 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.157629 26673 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:51.161412 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:51.152355 26530 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.102523 26599 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.164042 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:51.167320 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.170404 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:51.180358 22575 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.171389 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.171525 22396 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.179947 22500 raft_consensus.cc:2393] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:51.181391 22499 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:51.148090 26548 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:07:51.179888 22576 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:51.185253 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.187650 22577 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 14: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:51.187922 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.160619 26596 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:51.190264 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.191233 23076 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:51.129276 26653 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:07:51.196280 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.197535 22576 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:51.170109 26393 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:51.179316 26404 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:51.112239 26307 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.112239 26426 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.184975 26599 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.198678 26393 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.203033 26596 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:51.205399 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:51.180521 26669 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.206338 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:51.173336 26547 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.216399 22547 leader_election.cc:400] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13.
I20260709 13:07:51.217020 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.199393 26609 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:51.204499 26404 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:51.221973 22503 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:51.255376 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 57705.6us
I20260709 13:07:51.226735 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:51.227368 26661 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.441s	user 0.004s	sys 0.000s
I20260709 13:07:51.229581 22575 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:51.229869 26530 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.230412 22508 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:51.231597 26669 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:51.231766 26547 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.233393 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.233433 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.265622 23111 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:51.265947 22426 raft_consensus.cc:2410] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:51.215677 26454 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:51.235558 26646 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:51.236714 26256 consensus_queue.cc:1059] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:51.238116 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.238471 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.241508 26660 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.245544 22399 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:51.274981 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.275590 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.249089 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.250742 26448 raft_consensus.cc:3055] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:51.252401 22576 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:51.256188 22474 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:51.262101 22575 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:51.256880 22577 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:51.266399 22582 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:51.270318 23113 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:51.255455 26404 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.280567 22581 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: [8.7-10.9]
I20260709 13:07:51.282019 22399 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:51.282716 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:51.296763 22399 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:51.300817 22503 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:07:51.303897 23076 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:51.278862 26454 raft_consensus.cc:697] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:51.278851 26669 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:51.284765 26522 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.279168 26448 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:51.316869 23113 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:51.289717 26670 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.294734 26554 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.301538 26547 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.330873 22580 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:07:51.325327 26674 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:07:51.327044 26670 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:51.341411 26670 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.343457 26257 raft_consensus.cc:3055] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:51.343930 26257 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:51.328823 26669 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.349347 26669 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.351197 26602 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.352824 26548 consensus_queue.cc:1059] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:51.326731 26537 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.357196 26592 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.330271 26532 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.362134 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:51.363500 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:51.364060 22582 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.329147 26522 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.365835 26454 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.369274 26393 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:51.320729 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 149762us
I20260709 13:07:51.325323 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1701) took 1071 ms. Trace:
I20260709 13:07:51.384289 23079 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:51.388940 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.390065 22574 raft_consensus.cc:2410] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:51.381561 22396 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:51.390960 26257 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.381402 22505 rpcz_store.cc:276] 0709 13:07:50.253956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.346826 (+ 92870us) service_pool.cc:224] Handling call
0709 13:07:50.347097 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.397684 (+ 50587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.397726 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.398172 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.622252 (+224080us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:50.622294 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.622357 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.226783 (+604426us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:51.318439 (+ 91656us) raft_consensus.cc:1685] finished
0709 13:07:51.318464 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.325240 (+  6776us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47124,"raft.queue_time_us":49805,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":44122,"spinlock_wait_cycles":91511168,"thread_start_us":159674,"threads_started":1,"wal-append.queue_time_us":337659}
I20260709 13:07:51.395016 26604 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:51.399518 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 72677.2us
I20260709 13:07:51.408955 26632 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:51.409875 26307 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.410722 26357 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.417223 22582 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:51.430063 23079 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:51.411157 26653 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:51.420871 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:51.424346 22474 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:51.433609 22396 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.419157 22506 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:07:51.434849 22396 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.413146 26404 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:51.445463 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 131398us
I20260709 13:07:51.451403 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:51.452075 22428 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.452744 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.453045 22427 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:51.453938 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.448515 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:51.455051 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:51.456851 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:51.457799 22547 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:51.453385 22433 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:51.461890 22398 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:51.462884 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.317782 26596 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.445113 26609 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:51.465096 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.466377 22427 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:51.444783 26404 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:51.467228 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.447387 26669 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.485486 26669 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.487731 26669 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.448328 26660 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.463732 26683 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:51.489156 26683 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.420825 26448 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.489527 26683 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.490173 26448 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.490561 22579 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:51.492830 23076 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:51.493728 26377 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.495033 26609 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:51.496042 26609 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.468554 26682 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:51.497094 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.497457 26682 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.467151 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:51.449224 26307 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.498946 26307 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.473897 26657 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.499325 26307 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.500998 26657 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:51.476794 26649 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.501713 26649 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.502085 26649 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.476821 26256 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:51.444579 26547 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:07:51.507447 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.508375 23113 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 13: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:51.509512 26673 raft_consensus.cc:3055] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.465597 26659 raft_consensus.cc:3055] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.510557 26659 raft_consensus.cc:740] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:51.511480 26659 consensus_queue.cc:260] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.509840 26670 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.517424 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.509413 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.518402 26257 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.521746 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.522406 22501 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
W20260709 13:07:51.523442 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 64622.1us
I20260709 13:07:51.469614 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.484661 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.524785 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:51.484935 26152 raft_consensus.cc:3055] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:51.525300 22505 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:51.497855 22507 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:51.484041 26200 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.524981 22547 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:51.527632 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:51.530189 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:51.531243 22579 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.532274 22428 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:51.532050 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:51.533790 22545 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.532858 26152 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:51.544579 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.544737 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.549188 26529 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.549700 26529 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:51.550078 26529 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.524545 26426 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:07:51.550742 26426 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:51.529420 22473 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:51.492709 26599 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.554224 26599 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:51.554811 22432 raft_consensus.cc:2410] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:51.557750 22578 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:51.563342 22579 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:51.509953 26673 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:51.567368 23076 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:51.567277 23106 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:51.566146 22545 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.573964 23079 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:51.574487 22428 raft_consensus.cc:1240] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:51.576614 22506 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:51.576941 22501 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:51.572347 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.580159 26604 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:51.575722 26647 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:51.533605 26670 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:51.580610 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:51.581014 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.557737 26659 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.565896 26595 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.591264 22428 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:51.589253 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:51.599869 22499 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.551090 26426 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:51.572243 26640 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:51.585323 26603 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:51.580781 26592 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:51.589663 26599 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:51.609186 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.610049 22428 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:51.580448 26682 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.607592 26673 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.617975 26673 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.573117 26537 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:07:51.596422 26648 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.598667 26595 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.661595 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.607944 26592 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:51.675278 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 213476us
I20260709 13:07:51.599150 26671 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:07:51.600147 26687 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:07:51.607846 26599 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.593891 26641 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.625422 26377 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.661743 26595 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.651360 22499 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:07:51.657570 26388 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:51.684966 22502 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:07:51.673856 26554 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.664736 26648 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.690061 26660 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.730005 22545 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.691707 26592 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.670715 26426 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.740324 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.710172 26599 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:51.727843 26542 consensus_meta.cc:287] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.004s
I20260709 13:07:51.762269 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:51.769989 23104 raft_consensus.cc:2393] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:51.775487 22573 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:51.749266 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:51.778697 23110 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.765391 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.691425 26307 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.764047 23106 raft_consensus.cc:2393] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 10: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:51.788578 23110 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:51.730574 26377 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.773875 26426 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.775271 26603 raft_consensus.cc:697] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:51.762328 26596 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:07:51.734771 26388 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.800522 26603 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.801159 26648 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.780789 26640 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:51.766414 26660 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.790547 26529 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.811986 26649 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.816267 26649 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.813561 26640 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.793103 26604 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:51.820600 26604 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.824514 26599 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.826607 26683 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.828275 26683 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:51.829591 26660 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:51.689932 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 231580us
I20260709 13:07:51.874643 22399 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:51.877795 22427 raft_consensus.cc:3055] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.878504 22427 raft_consensus.cc:740] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:51.673723 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:51.890867 22426 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:51.893886 22503 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
W20260709 13:07:51.895036 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.894879 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:51.901320 22429 raft_consensus.cc:2368] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:07:51.903940 26377 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:51.887943 22430 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:51.911950 26307 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:51.915650 26357 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:51.917517 26522 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.918982 26595 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.925900 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:51.929222 22505 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:51.931871 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.955777 26547 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:51.933125 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:51.941377 23108 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:51.944698 26537 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:51.945688 22427 consensus_queue.cc:260] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:51.951062 26388 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:51.933087 26673 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:51.963506 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.963819 23111 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:51.964664 23107 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:51.957667 26357 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.978794 26660 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:51.979064 22473 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.980491 22473 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:51.981087 26660 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.981632 26660 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.981942 26648 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.982538 26648 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.982908 26648 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.988109 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:51.930271 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 200206us
I20260709 13:07:51.982066 26660 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.968088 26522 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:51.999411 26522 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.010656 22427 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.004436 26673 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:52.012727 22500 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:07:52.012880 26529 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.017932 26659 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.017791 26537 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.018905 26659 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.023411 26659 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.021106 26599 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.025274 26650 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:52.025830 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:52.026423 26537 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.026891 23113 raft_consensus.cc:2410] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:07:52.028306 26595 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.026158 26650 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.017087 26357 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.044917 23076 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:52.046615 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 80717.7us
I20260709 13:07:52.037690 26673 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.048278 26648 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.049394 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.050338 22503 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:52.050854 26377 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:52.051424 26377 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:52.052539 26640 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:52.057098 26650 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:52.057747 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.060405 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:52.061064 23113 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.064705 26657 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:52.065274 26657 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:52.066550 26657 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.068085 26657 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.069607 22425 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:52.060192 22505 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.072154 23113 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:52.073959 22473 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:52.074354 22424 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:52.074921 26659 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.075516 26659 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:51.940292 26152 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.076867 26659 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:52.078112 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.076792 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:52.082548 26669 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.083058 26669 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:52.083575 26669 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.084391 26648 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.084054 26377 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.087258 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.088377 22507 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:52.093062 23113 raft_consensus.cc:1240] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.094146 23111 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.050410 22504 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:07:52.034441 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 156011us
I20260709 13:07:52.095558 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:52.105014 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:52.106000 26669 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.108521 26669 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.111747 26152 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.117226 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:52.118520 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:52.119766 26526 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.082965 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:52.120433 26526 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:51.977381 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:52.132310 23108 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:52.134493 22427 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:52.129248 26526 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.135041 22427 pending_rounds.cc:85] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 5
I20260709 13:07:52.150818 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:52.153128 23106 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:52.153254 26670 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.154968 26670 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.159065 26670 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.161402 22502 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:52.161593 26595 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.165591 26595 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:52.166152 26595 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.162287 22504 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:52.162209 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:52.163753 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:52.173321 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:52.173559 26650 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:52.175181 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:52.175333 26678 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.173374 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:52.176292 26678 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.178390 26678 consensus_queue.cc:1059] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:52.178804 22547 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:52.179664 26604 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.179831 26530 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:52.180560 26530 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:52.181690 26530 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.191095 23111 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:52.197319 26596 raft_consensus.cc:3055] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:52.198544 26537 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.100270 26592 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.204052 26595 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.184821 22427 pending_rounds.cc:107] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:52.197544 26640 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.222533 22427 raft_consensus.cc:2889] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.205291 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:52.225286 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 142530us
I20260709 13:07:52.225636 23108 raft_consensus.cc:2410] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:52.211194 26670 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.210470 26596 raft_consensus.cc:740] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:52.234726 22502 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:52.237262 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:52.237026 26678 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:07:52.256801 26670 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.261713 22502 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:52.264787 26256 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.244750 26650 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.260183 26670 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.229274 26537 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.275619 22507 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.230669 26604 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:52.284987 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 111742us
I20260709 13:07:52.285986 22501 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:52.288414 26537 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.296025 26592 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.299449 23111 raft_consensus.cc:1240] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.245920 26640 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:52.301138 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.307591 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.312948 22501 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:52.313128 26711 consensus_queue.cc:1059] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:52.314756 26596 consensus_queue.cc:260] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.315938 26710 raft_consensus.cc:3055] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:52.316357 26710 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:52.313503 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.310086 22504 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:52.307080 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.318655 26710 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.321234 22500 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
W20260709 13:07:52.321694 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49637.7us
I20260709 13:07:52.265854 26256 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.330996 26307 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.330730 22329 catalog_manager.cc:5697] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 4 to 5, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 5 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:07:52.331643 26307 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.332844 26632 consensus_queue.cc:1059] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:52.334093 26307 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.335150 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:52.291082 26650 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:52.356511 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:52.357538 26650 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.346707 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:52.358433 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:52.359081 23113 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:52.360877 22398 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:52.361274 23076 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:52.361685 26522 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.362241 26522 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.362655 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:52.363557 26256 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.363860 26609 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:52.364379 26522 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.365655 22499 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:52.310730 26595 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.307852 26670 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.367668 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.368108 26670 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.368561 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:52.369163 22504 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.365762 26522 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.369966 26357 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.372941 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:52.373333 22500 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:52.367717 26526 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.377781 26526 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.308122 26659 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.352783 26648 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:52.354811 22578 raft_consensus.cc:1240] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.353453 22329 catalog_manager.cc:5697] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 4 to 5, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 5 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.370499 26522 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.369870 23110 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.371025 26670 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.372203 26609 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.378971 26710 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.380832 23111 raft_consensus.cc:2393] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:52.361837 26604 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.364152 26256 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.383725 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:07:52.385457 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 165329us
W20260709 13:07:52.356372 26426 consensus_meta.cc:287] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.006s
I20260709 13:07:52.390463 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.392340 23106 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.349650 26596 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.302342 26640 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.392751 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:52.355242 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:52.401638 26659 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.402459 26648 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.392253 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:52.405818 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:52.408578 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.423848 22500 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:52.404964 26522 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.497411 22504 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
W20260709 13:07:52.427001 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.482499 26711 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:52.483297 26307 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:52.472404 26670 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.494957 26648 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.392952 26537 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:07:52.518283 26711 consensus_queue.cc:1243] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:52.519032 26711 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.519418 26711 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:52.520337 26307 consensus_queue.cc:1243] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer 9cea93fb03e04e48a6dabc4094ee7c93 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:52.514320 22545 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:52.522073 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 51879.7us
I20260709 13:07:52.453966 22501 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:52.507436 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:52.504680 22573 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:52.416255 26609 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.496155 26357 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.417976 26526 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.106s
W20260709 13:07:52.573043 26660 consensus_meta.cc:287] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.576s	user 0.013s	sys 0.000s
I20260709 13:07:52.573589 26660 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.575825 26660 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.576710 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:52.577610 26710 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:52.578389 26710 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.427342 26599 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:07:52.520421 26711 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:52.580906 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.582489 26710 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.584491 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:52.577479 26357 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.585968 26357 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.587338 26599 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.588133 26357 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.588006 26599 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.589877 26687 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.637068 26687 raft_consensus.cc:697] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:52.637718 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:52.638346 23107 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.638660 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:52.639376 23110 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:52.590732 26426 raft_consensus.cc:3055] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.640990 26426 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:52.641551 22574 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:52.642014 26426 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.643435 26426 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.643298 26522 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.591642 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:52.638204 26687 consensus_queue.cc:237] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.596750 26526 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.645799 26526 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.636704 26599 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.647274 26599 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.520654 26604 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:07:52.564342 26670 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.650580 26670 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.651952 26256 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.653146 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:52.654846 22573 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:52.656131 22573 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:07:52.648121 26526 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.610946 22329 catalog_manager.cc:5697] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:07:52.613612 26659 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.620823 22545 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:52.624778 22581 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:07:52.577498 22579 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.596192 22331 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43174 (request call id 255) took 9783 ms. Trace:
I20260709 13:07:52.632688 22507 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:52.634500 22576 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:07:52.635062 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:52.636662 22582 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
W20260709 13:07:52.645303 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 53801.4us
I20260709 13:07:52.660820 22581 pending_rounds.cc:85] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 6
I20260709 13:07:52.628580 26660 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.669507 22546 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:52.669451 26660 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.671200 26592 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.671833 26660 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.665052 22581 pending_rounds.cc:107] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:52.662725 22582 pending_rounds.cc:85] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:07:52.673044 22582 pending_rounds.cc:107] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:52.673334 22582 raft_consensus.cc:2889] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.665997 22503 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
W20260709 13:07:52.643678 26257 consensus_meta.cc:287] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 1.125s	user 0.003s	sys 0.016s
I20260709 13:07:52.637329 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:52.672686 22581 raft_consensus.cc:2889] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.662066 22576 pending_rounds.cc:85] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:07:52.676400 22576 pending_rounds.cc:107] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:07:52.676738 22576 raft_consensus.cc:2889] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.679219 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.665747 22473 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:52.680830 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.686908 22507 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:52.679291 26711 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.693238 22579 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:52.690950 22545 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:52.678259 26357 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.690531 26599 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.696522 26669 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.702374 23110 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:52.702139 26669 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.701316 22329 catalog_manager.cc:5697] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 4 to 5, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 5 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.705502 26669 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.708070 26388 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.712757 26388 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.713690 26537 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.714226 26537 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.714982 26388 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.715596 26592 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.716007 26592 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.717708 22505 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:52.717721 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.723922 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:52.727020 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:52.727547 23110 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:07:52.729326 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.729537 26388 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.708272 26257 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.716375 26592 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.710608 26256 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.718231 26659 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.716334 26537 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.710121 26152 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.712177 26522 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.732920 26388 raft_consensus.cc:697] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:52.711268 26357 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.726037 26670 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:52.735234 26603 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:07:52.792793 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 213784us
I20260709 13:07:52.768299 26256 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.769850 26669 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.758764 26257 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.831854 23107 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:52.783051 26659 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.782142 26152 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.824823 26530 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.661355 22331 rpcz_store.cc:276] 0709 13:07:42.812606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.812855 (+   249us) service_pool.cc:224] Handling call
0709 13:07:52.595952 (+9783097us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:50.234114 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:50.244662 (+ 10548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:50.244706 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:07:50.244724 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:50.381814 (+137090us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:50.381877 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:50.381904 (+    27us) tablet.cc:685] Acquiring locks for 32 operations
0709 13:07:50.384126 (+  2222us) tablet.cc:701] Row locks acquired
0709 13:07:50.384142 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:07:50.384296 (+   154us) write_op.cc:270] Start()
0709 13:07:50.384448 (+   152us) write_op.cc:276] Timestamp: P: 1783602470384245 usec, L: 0
0709 13:07:50.424513 (+ 40065us) op_driver.cc:348] REPLICATION: starting
0709 13:07:50.425427 (+   914us) log.cc:844] Serialized 12524 byte log entry
0709 13:07:50.910143 (+484716us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f0069d180ac 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b
0709 13:07:51.326771 (+416628us) op_driver.cc:464] REPLICATION: finished
0709 13:07:51.391336 (+ 64565us) write_op.cc:301] APPLY: starting
0709 13:07:51.391430 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:51.412694 (+ 21264us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:51.412718 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:51.443827 (+ 31109us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:51.444218 (+   391us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=64
0709 13:07:51.444270 (+    52us) write_op.cc:312] APPLY: finished
0709 13:07:51.543979 (+ 99709us) log.cc:844] Serialized 212 byte log entry
0709 13:07:51.544177 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:51.544431 (+   254us) write_op.cc:454] Released schema lock
0709 13:07:51.544519 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:51.544939 (+   420us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:51.544969 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":453865,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":62484,"apply.run_cpu_time_us":7625,"apply.run_wall_time_us":153563,"num_ops":32,"prepare.queue_time_us":689618,"prepare.run_cpu_time_us":33042,"prepare.run_wall_time_us":835418,"raft.queue_time_us":237350,"raft.run_cpu_time_us":10766,"raft.run_wall_time_us":106542,"replication_time_us":880583,"spinlock_wait_cycles":3731584,"thread_start_us":1145007,"threads_started":4,"wal-append.queue_time_us":599706,"wal-append.run_cpu_time_us":63230,"wal-append.run_wall_time_us":1542138}]]}
W20260709 13:07:52.860524 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 154661us
I20260709 13:07:52.867550 22507 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:52.869807 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:52.869978 22473 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:52.837536 26727 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:52.857805 26522 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:52.867704 26660 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:52.885099 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 51877.2us
I20260709 13:07:52.886782 26599 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.887367 26599 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:52.889103 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.893159 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:52.893545 26526 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:52.894400 22424 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:52.861519 26530 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.899036 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:52.899580 26152 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.899910 22425 raft_consensus.cc:2393] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:52.900792 26733 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.902642 26669 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.881449 26729 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.904779 26357 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.911726 22430 raft_consensus.cc:2410] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:52.879949 26670 raft_consensus.cc:2804] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.920256 26670 raft_consensus.cc:697] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:52.921452 26659 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.921305 26670 consensus_queue.cc:237] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.897679 26727 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.925195 26256 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.910521 26660 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.874804 26388 consensus_queue.cc:237] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.928349 26660 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.929884 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:52.930493 23106 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.904722 26729 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:52.924225 26727 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.926462 26257 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.933187 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:52.936812 23110 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:52.921476 26530 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:52.939939 22575 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:52.926486 26609 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.951185 22396 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:52.954860 22546 leader_election.cc:400] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:07:52.955204 22546 leader_election.cc:403] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.958109 26737 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:52.951927 26522 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:07:52.948298 26731 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.959935 26731 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:52.960369 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.961938 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:52.962309 26731 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:52.962783 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:52.963114 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.963441 22427 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:52.963825 22500 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:52.964298 22428 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.964924 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:52.965649 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:52.966008 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.965058 22431 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:52.953821 26710 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:07:52.967325 22424 raft_consensus.cc:2368] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 11. Current term is 12.
I20260709 13:07:52.968055 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:52.968863 22500 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:52.968959 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:52.970649 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.970924 26426 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:52.971442 22500 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 12: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:52.973289 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.974148 22500 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:52.975018 23106 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:52.975373 26729 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:52.976287 22473 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:52.977425 26729 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.977535 22500 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.978180 26729 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:52.979902 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:52.980298 22580 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:52.980625 22501 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.980893 22425 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:07:52.981223 22425 pending_rounds.cc:85] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 9
I20260709 13:07:52.981474 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:52.982108 22582 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:52.982795 22573 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:52.981448 22425 pending_rounds.cc:107] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:07:52.982978 22581 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.983481 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:52.983628 22425 raft_consensus.cc:2889] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.966513 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:52.991206 22426 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:07:52.993975 22428 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:52.994660 23108 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 11: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:52.990916 26678 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:07:53.000025 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.000712 22574 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:53.005725 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.007931 22577 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:53.009104 22426 raft_consensus.cc:2393] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:53.011237 22580 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:53.013698 26599 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.015991 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:52.947144 26733 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:07:53.025187 26727 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:53.025337 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.026046 22578 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:53.025929 26727 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.028868 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:53.029320 26727 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:53.031129 26732 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.158s	user 0.001s	sys 0.001s
I20260709 13:07:53.031505 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.032095 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.031172 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.033139 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.033689 22424 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:53.032897 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.034796 22427 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:53.034718 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.035058 22433 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:07:53.033679 22432 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:53.035697 22433 pending_rounds.cc:85] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 9
I20260709 13:07:53.036131 22433 pending_rounds.cc:107] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:07:52.979413 26729 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.032375 22431 raft_consensus.cc:2410] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:07:53.032897 22429 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:53.036365 22433 raft_consensus.cc:2889] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.036384 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.035493 22424 raft_consensus.cc:2393] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:53.039592 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.035632 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.041105 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.041724 22502 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:53.036548 22582 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:53.042706 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.046458 26526 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:53.046718 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.047333 22503 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:53.047128 26526 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.049472 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:53.050309 23106 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:53.049500 26526 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:53.052980 26740 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:53.054482 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.054937 22503 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:53.057096 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:53.035133 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.061543 22430 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:53.062739 22581 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:53.063684 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:52.971539 26426 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.078564 22501 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:53.080987 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.081981 22431 raft_consensus.cc:3060] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.081064 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.093916 22432 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:53.097299 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:53.097635 22433 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:53.098030 22431 raft_consensus.cc:2468] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:53.093048 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.099681 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:53.100402 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.053578 26740 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.101078 22545 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:53.105086 22545 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:53.108901 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.111617 22575 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:53.077924 26733 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:53.076668 26526 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.113929 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.112816 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.083598 26711 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.082875 26687 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.117101 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.082909 26737 raft_consensus.cc:697] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:53.093070 26547 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:53.088467 26599 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:53.041896 26592 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.098794 26650 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.122166 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.127456 22580 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:53.124992 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.128942 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.135195 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.131058 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.109263 26632 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.119499 26529 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:53.114786 26733 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.110167 26710 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:53.139891 22576 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:53.139351 22501 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:53.091048 26448 consensus_queue.cc:1059] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:07:53.142789 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.184181 22581 raft_consensus.cc:1240] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:53.186582 26737 consensus_queue.cc:237] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.185751 26746 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:53.128777 26256 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:53.137405 26307 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.233979 26733 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.243341 26307 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.248854 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.251466 26733 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.256430 26733 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:53.256834 26592 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:53.257140 26733 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.258951 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.259333 26733 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.135730 26257 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:53.260862 26257 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.263289 26257 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:53.264020 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.264866 22427 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:53.265213 26733 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:53.268379 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:53.121722 26526 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.269105 22504 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.142048 26632 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.141978 26529 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.283697 22396 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:53.129045 26687 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:53.291292 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 55840.6us
I20260709 13:07:53.298439 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.235003 26609 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:53.264053 26657 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.362361 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 61422.6us
I20260709 13:07:53.292421 26632 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.294370 26529 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.372941 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:53.377151 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.377938 22504 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:53.194458 26650 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.269441 26547 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.369313 23077 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:53.371865 26751 log.cc:927] Time spent T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:07:53.290824 26522 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:07:53.384014 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.293300 26710 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.389652 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:53.374363 26609 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.288514 26746 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.382196 26357 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:53.406634 22575 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:07:53.411293 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.414696 26357 raft_consensus.cc:697] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:53.415359 26752 log.cc:927] Time spent T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:07:53.415829 26357 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.370759 26657 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.375108 26604 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:07:53.401042 26640 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.404546 26426 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:53.447389 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45234.7us
I20260709 13:07:53.449553 23077 leader_election.cc:400] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 11. Current term is 12.
I20260709 13:07:53.451445 23077 leader_election.cc:403] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:53.451871 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:53.454447 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 160208us
I20260709 13:07:53.409147 26609 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.444909 26740 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:53.470396 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.477545 23110 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:53.456733 26537 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:53.463990 26763 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 11. Current term is 12.
I20260709 13:07:53.479383 22398 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:53.480168 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:53.483165 26757 consensus_queue.cc:1059] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:07:53.483844 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 293742us
W20260709 13:07:53.485889 26750 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:53.489283 23106 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 11: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:53.490161 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.493455 22581 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:53.497365 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:53.498034 23108 raft_consensus.cc:2393] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:53.498733 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:53.459829 26640 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:07:53.486496 26307 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:53.504797 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:53.500905 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:53.516103 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 66702.2us
I20260709 13:07:53.517498 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.517779 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:53.518195 22581 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:53.533444 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:53.534245 22581 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:53.536038 26609 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:53.536541 26357 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.537949 26357 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:53.538399 26357 raft_consensus.cc:697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:53.539376 26357 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.540163 26547 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:53.522964 26603 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:07:53.546245 26657 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:53.549160 26526 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:53.529556 26727 raft_consensus.cc:2764] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:53.543087 26650 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:53.553485 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 53955.3us
I20260709 13:07:53.554342 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:53.556329 26670 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.518328 26687 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:53.521523 26757 consensus_queue.cc:1243] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer e47a624c3ddb48c5a8947ac0b3e71f84 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:53.558910 26256 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:53.559201 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:53.560000 22500 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:53.561053 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:53.564888 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.565546 22505 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:53.572320 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.572989 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:53.573165 22502 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:07:53.573654 23108 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:53.572889 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:53.575235 23076 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:53.575631 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:53.577728 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:53.577885 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 45482.6us
I20260709 13:07:53.578433 26727 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:53.581291 26727 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.583745 26632 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.579038 26768 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:53.584839 26768 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.585304 26768 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:53.587385 26749 log.cc:927] Time spent T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:07:53.580031 26529 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.574867 26256 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.590636 26529 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:53.592422 26729 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.573376 26710 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:53.592825 22580 raft_consensus.cc:2368] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:07:53.594022 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:53.593372 26670 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:07:53.593039 26729 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:53.584383 26727 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:53.594794 26426 consensus_queue.cc:1059] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:07:53.597159 26729 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.601333 26762 consensus_queue.cc:1059] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:07:53.601661 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:53.606684 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:53.612910 23104 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:07:53.596072 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 95231.5us
W20260709 13:07:53.607414 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 76355.6us
I20260709 13:07:53.612147 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:53.627553 23106 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:53.597761 26670 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.604880 26727 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.607026 26710 raft_consensus.cc:3055] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:53.661059 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.665319 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63739.9us
I20260709 13:07:53.627059 26426 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.666229 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:53.628538 26603 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:07:53.731424 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.736948 23079 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:53.678287 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:53.818792 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 197895us
W20260709 13:07:53.853996 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 117270us
I20260709 13:07:53.803316 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:53.731141 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.680624 22399 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:53.832160 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 238216us
I20260709 13:07:53.679394 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:53.669111 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 93529.5us
I20260709 13:07:53.715372 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:53.780846 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 63771us
W20260709 13:07:53.857260 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 176729us
I20260709 13:07:53.679024 22427 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:53.609763 26256 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.732066 22426 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:53.815451 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.669669 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.860582 22433 raft_consensus.cc:2393] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 7: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:53.861085 26711 consensus_queue.cc:1059] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:53.746080 26771 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:07:53.873770 22399 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:53.865398 26657 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.865083 26670 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:53.859813 22546 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:53.730228 26748 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.460s	user 0.000s	sys 0.002s
I20260709 13:07:53.860885 26731 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:53.857923 26604 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:53.669582 26766 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:53.887244 26357 raft_consensus.cc:3055] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:53.887995 26357 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:53.890486 23079 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:53.890136 26357 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.891443 26764 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:53.891932 26764 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.874743 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:53.875116 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.685745 26768 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.893891 26777 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.875901 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.894886 22424 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:53.895733 22472 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:53.857197 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:53.667539 26710 raft_consensus.cc:740] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:53.635149 26529 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.223s
I20260709 13:07:53.892319 26764 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.727689 26687 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.686261 26448 raft_consensus.cc:3055] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:53.724743 26733 raft_consensus.cc:3055] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:53.898198 26772 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:53.898617 26711 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:53.930092 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.711660 26727 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:07:53.900816 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.902052 26256 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:53.685832 26746 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:53.902474 26609 consensus_queue.cc:1059] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:07:53.785457 26530 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:07:53.900247 26775 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.820978 26632 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:53.926980 26448 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:53.900906 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:53.911100 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 51356.9us
I20260709 13:07:53.717510 26526 consensus_queue.cc:1059] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
W20260709 13:07:53.916447 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.680789 26650 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:53.917598 22424 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
W20260709 13:07:53.917783 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44109.4us
I20260709 13:07:53.920864 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:53.922363 22428 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:53.923767 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:53.962854 22424 pending_rounds.cc:85] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 6
I20260709 13:07:53.686450 26729 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.892174 26357 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.912636 26670 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.917157 26678 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.909947 26640 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:07:53.938725 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.904681 26657 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:53.906718 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49582us
I20260709 13:07:53.917348 26763 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:07:53.937433 26780 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.944585 26782 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:53.947629 22504 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:53.948604 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.948817 26710 consensus_queue.cc:260] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.949736 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.896418 26768 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:53.963409 22424 pending_rounds.cc:107] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:07:53.967415 22546 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:53.968612 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.983060 22424 raft_consensus.cc:2889] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.927685 26687 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.970443 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:53.926841 26733 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:53.980262 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:53.983904 22499 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:53.962764 26650 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:53.989951 26782 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.991006 26758 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:53.987619 26529 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:53.992648 22505 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:53.966908 26604 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:07:53.993116 26529 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:53.993943 26687 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:53.994524 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:53.995285 26529 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:53.966028 26603 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:07:53.997570 26448 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:53.998950 26448 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.941982 26775 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.000947 26727 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.002638 26775 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:53.990494 26650 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.989534 26733 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.010468 22399 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:53.983469 22501 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:54.013389 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:54.058053 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44752.1us
I20260709 13:07:54.059369 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:54.061044 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46055.1us
I20260709 13:07:54.061761 22474 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:53.973171 26632 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:07:54.073680 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 87919.2us
I20260709 13:07:53.972404 26711 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:07:54.015348 26791 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:53.989548 26766 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.062547 22474 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:54.080111 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:54.081028 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:54.088246 23106 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:07:54.054090 26526 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.066329 26710 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:54.125422 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 62936.7us
I20260709 13:07:54.018604 26757 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:07:54.129136 23076 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:54.073402 26687 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:54.130098 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 50066.3us
I20260709 13:07:54.080838 26522 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:54.081014 26733 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.017942 26746 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:07:54.084196 26530 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.084682 26775 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:54.055612 26529 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:07:54.141902 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 228644us
W20260709 13:07:54.151012 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 140635us
I20260709 13:07:54.132715 26599 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.127883 26678 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.141723 26768 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:54.176193 23110 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:54.197494 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:54.198235 22500 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:54.197494 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 48548.9us
I20260709 13:07:54.197923 23106 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:54.147815 26687 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:54.152072 26775 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:54.125373 26791 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.191731 26780 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:54.194298 26782 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:54.193231 26768 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.266492 26789 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:54.267304 26794 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:54.227836 26678 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.269855 26796 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:54.232077 26775 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.262795 26780 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:54.321642 26794 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.281947 26792 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.322737 26792 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.323971 26794 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:54.284228 26791 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:54.200556 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:54.232504 26777 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.321552 26678 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:54.328276 26796 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.322355 26780 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.332805 26789 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.311283 26768 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.311033 26782 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:54.333933 26775 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.232897 26687 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:54.341655 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 141209us
I20260709 13:07:54.413314 22500 raft_consensus.cc:2468] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:54.413920 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:54.416550 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:54.419361 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:54.422823 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:54.424005 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:54.424733 22500 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:54.378916 26777 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.450670 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:54.411600 26632 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:54.467746 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:54.471529 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:54.472283 22506 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.456405 23104 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:07:54.473997 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:54.476229 23110 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:54.487042 22545 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:54.489373 22508 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:54.500363 26529 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:54.500947 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:54.501497 26529 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.501401 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:54.502048 26529 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.501401 26595 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:54.502737 26687 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:54.503095 26595 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.503854 22502 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:54.505266 26595 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:54.502444 22580 raft_consensus.cc:2393] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:54.509958 26529 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.511988 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:54.518935 22581 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:07:54.496094 22545 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:54.473441 26777 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:54.514194 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 335650us
I20260709 13:07:54.550976 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:54.551502 22547 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:54.500797 26786 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.553467 22547 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:54.549665 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:54.549939 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53958.3us
I20260709 13:07:54.517241 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:54.560389 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:54.441071 26764 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.555478 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:54.552440 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:54.562448 22580 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:54.564143 26530 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:54.564599 26806 consensus_queue.cc:1059] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:54.561043 22503 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:07:54.565655 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:54.569598 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:54.470192 26782 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:54.566140 22474 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.566s (SENT) [suppressed 6 similar messages]
I20260709 13:07:54.569306 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:54.563517 26595 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.583768 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:54.557173 26678 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.587946 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:54.589829 22576 raft_consensus.cc:2393] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 13: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:54.570363 26530 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.595976 22508 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:54.596967 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:54.581732 26792 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:54.589548 26657 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:54.607628 26782 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:54.609432 26529 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:54.612787 26595 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.613353 26595 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.615530 22473 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:54.616977 26799 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:54.617405 26799 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.617790 26799 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:54.597795 26530 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:54.619958 23106 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:54.615432 26595 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:54.567605 26786 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.632109 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:54.644429 26782 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:07:54.646030 26796 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:54.647346 26789 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:54.660789 26804 log.cc:927] Time spent T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.104s	user 0.000s	sys 0.003s
W20260709 13:07:54.666075 26810 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:07:54.672909 26775 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:54.674520 26764 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:54.690338 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 615799us
I20260709 13:07:54.695092 26522 raft_consensus.cc:697] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:54.696431 26522 consensus_queue.cc:237] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:54.701622 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 526473us
I20260709 13:07:54.702283 26786 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:54.702486 22399 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:54.704437 26650 consensus_meta.cc:287] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.001s
I20260709 13:07:54.704919 26650 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.705963 26426 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.706815 26426 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.707175 26650 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:54.707319 26426 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.709784 26765 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:54.710103 26426 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:54.704337 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:54.712363 26757 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.713104 26256 raft_consensus.cc:3055] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.713510 26256 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:54.713658 26757 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:54.713868 22396 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:54.714423 26256 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.715381 26448 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.715901 26448 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:54.716312 26448 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.719244 26731 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:54.721562 26711 consensus_queue.cc:1059] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:54.722523 22396 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:54.722812 26733 raft_consensus.cc:3055] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:54.723306 26733 raft_consensus.cc:740] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:54.724258 26733 consensus_queue.cc:260] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:54.725967 26783 log.cc:927] Time spent T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.743s	user 0.005s	sys 0.007s
I20260709 13:07:54.728701 26710 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.729212 26710 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:54.729679 26710 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:54.731878 26785 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.786s	user 0.000s	sys 0.009s
I20260709 13:07:54.735937 22506 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:54.742934 22472 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:54.744377 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:54.744974 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:54.745430 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:54.746877 23106 raft_consensus.cc:2368] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11.
I20260709 13:07:54.715703 26256 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.752168 26779 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:54.796139 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 230009us
I20260709 13:07:54.744580 26711 consensus_queue.cc:1059] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:07:54.750422 26786 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:07:54.750051 26791 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:07:54.722950 26729 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:54.746634 26775 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.758358 26768 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.770927 26650 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:54.775475 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:54.826416 22579 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.760154 26780 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.776332 26763 raft_consensus.cc:3055] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.773367 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:54.786530 23076 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:54.778445 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:54.840214 22431 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.764931 22500 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:54.785943 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:54.793341 22398 leader_election.cc:400] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11.
I20260709 13:07:54.843021 22398 leader_election.cc:403] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:07:54.843538 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 50391.6us
I20260709 13:07:54.773382 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:54.843866 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 70602.5us
I20260709 13:07:54.798151 22506 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:54.821353 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:54.778872 26599 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.797119 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:54.835875 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:54.849568 22576 raft_consensus.cc:2410] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 13 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:54.770488 26757 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.842435 22424 raft_consensus.cc:1275] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:54.849048 26529 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.850028 26753 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.828411 26731 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.828030 26737 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.782085 26526 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:54.847286 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:54.847803 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 61371.7us
I20260709 13:07:54.837008 26763 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:54.847985 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:54.844710 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:54.770278 26733 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.836133 26766 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.848801 26765 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.907315 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:54.882318 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:54.854668 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:54.852744 26777 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.875526 26757 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.875542 22503 raft_consensus.cc:1240] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.877419 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:54.851857 26604 raft_consensus.cc:2804] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:54.875950 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:54.897550 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 52934.6us
I20260709 13:07:54.853771 22433 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:54.912653 22433 pending_rounds.cc:85] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 8
I20260709 13:07:54.912928 22433 pending_rounds.cc:107] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:54.913180 22433 raft_consensus.cc:2889] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.913517 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:54.863970 22431 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:54.902761 22579 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:54.908128 22432 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:07:54.917279 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:54.854805 26775 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.923302 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:54.849472 26650 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.925634 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:54.853647 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 56636.4us
I20260709 13:07:54.926623 22430 raft_consensus.cc:1240] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:07:54.929128 26802 log.cc:927] Time spent T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.346s	user 0.000s	sys 0.002s
I20260709 13:07:54.909750 26766 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.938846 26766 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:54.881671 26603 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.942778 22507 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:54.943066 22424 raft_consensus.cc:2410] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:54.875869 26779 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:54.895450 26737 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.953188 23079 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:07:54.955185 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:54.956409 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:54.961277 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.961958 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.924202 26775 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:54.964119 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:54.895473 26731 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.924878 26791 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.894738 26526 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.895017 26448 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.936101 26710 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:54.962570 26603 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.940203 26604 raft_consensus.cc:697] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:54.878089 26599 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:54.920288 26529 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:54.973323 26812 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:54.974711 26731 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:55.014567 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:54.961133 22474 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:55.015544 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 54507.5us
I20260709 13:07:55.017107 22427 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
W20260709 13:07:54.999483 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 420323us
I20260709 13:07:54.959720 26657 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:54.952344 26595 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:07:54.881426 26753 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:55.005239 22546 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:54.967969 26775 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.012256 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:55.020119 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:55.082211 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 62189.7us
I20260709 13:07:55.013236 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:55.025151 22472 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:55.030627 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:55.029201 22501 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:55.087728 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 62685.3us
I20260709 13:07:55.101438 22472 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:55.019367 26729 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:55.106645 22504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.004s	sys 0.022s
W20260709 13:07:55.107172 22504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.004s	sys 0.023s
I20260709 13:07:55.128167 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:55.135970 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47414.8us
I20260709 13:07:55.137424 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:55.138314 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:54.960132 26779 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:55.155364 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 53995.4us
I20260709 13:07:55.156520 22472 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:55.139745 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:55.085266 26786 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:54.998183 26791 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:55.084465 26657 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:07:55.154270 26530 consensus_meta.cc:287] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.001s
W20260709 13:07:55.152936 26810 log.cc:927] Time spent T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:07:55.214457 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 129969us
I20260709 13:07:55.084174 26746 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:07:55.104879 26796 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:55.079416 26731 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:07:55.175854 23076 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:55.134891 26687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.018s	sys 0.065s
I20260709 13:07:55.020826 26799 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:55.204382 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 100999us
W20260709 13:07:55.206918 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 336437us
W20260709 13:07:55.207630 26806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.006s	sys 0.026s
W20260709 13:07:55.208588 26727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.204s	user 0.004s	sys 0.021s
I20260709 13:07:54.961936 26763 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:55.228734 22545 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:55.165426 26670 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.173069 26768 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:55.171698 26813 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:55.248126 26687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.018s	sys 0.065s
I20260709 13:07:55.253700 26529 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:55.252713 26806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.006s	sys 0.027s
I20260709 13:07:55.226894 26256 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:55.251539 26803 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:07:55.303997 22499 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 15: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:55.308619 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 79996.6us
I20260709 13:07:55.392251 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:55.251487 26727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.004s	sys 0.022s
I20260709 13:07:55.393070 23106 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:07:55.348554 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 192108us
I20260709 13:07:55.224192 26530 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:55.170511 26786 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:55.284816 26537 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:55.284500 26766 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.254323 26609 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:55.281410 26670 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:55.293082 26796 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:55.422513 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 417284us
I20260709 13:07:55.423725 22545 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:55.435340 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:55.436299 23106 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:55.438328 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:55.439605 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 263268us
I20260709 13:07:55.310483 26595 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 13:07:55.453425 22577 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 15: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:55.464546 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.464852 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.465809 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:55.472069 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.473799 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.474537 22582 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:55.430459 26670 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.477470 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.422499 26256 raft_consensus.cc:697] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:55.458390 26822 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.423187 26806 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.417598 26831 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.497746 22582 raft_consensus.cc:1240] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:55.522411 26818 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:07:55.430397 26766 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:55.524070 26829 log.cc:927] Time spent T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:07:55.524861 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 541) took 1007 ms. Trace:
W20260709 13:07:55.525151 26825 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:07:55.525260 22574 rpcz_store.cc:276] 0709 13:07:54.517512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.517623 (+   111us) service_pool.cc:224] Handling call
0709 13:07:54.551950 (+ 34327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:54.619230 (+ 67280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.619262 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:54.633975 (+ 14713us) log.cc:844] Serialized 52 byte log entry
0709 13:07:55.099852 (+465877us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:55.099894 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.099960 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.524597 (+424637us) raft_consensus.cc:1685] finished
0709 13:07:55.524625 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.524803 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38186,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":18008,"thread_start_us":512197,"threads_started":2,"wal-append.queue_time_us":739617}
I20260709 13:07:55.528128 22574 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:07:55.528887 26840 log.cc:927] Time spent T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:55.529105 26766 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:55.429764 26820 consensus_queue.cc:1059] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:07:55.466812 26737 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:55.534221 26811 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.535398 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 542) took 1017 ms. Trace:
I20260709 13:07:55.535130 26729 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.575778 22575 rpcz_store.cc:276] 0709 13:07:54.517751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.517875 (+   124us) service_pool.cc:224] Handling call
0709 13:07:54.553382 (+ 35507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.553722 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.553754 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.566267 (+ 12513us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.889607 (+323340us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:54.889658 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.889740 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.535157 (+645417us) raft_consensus.cc:1685] finished
0709 13:07:55.535180 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.535337 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":7537,"thread_start_us":304142,"threads_started":1,"wal-append.queue_time_us":587895}
I20260709 13:07:55.519778 26710 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:55.540445 26786 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:55.458552 26650 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:55.465907 26657 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:55.309384 26604 consensus_queue.cc:237] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:55.543277 26603 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:55.488325 26526 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:55.438298 26609 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:55.545797 26733 consensus_meta.cc:287] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.001s
I20260709 13:07:55.500695 26812 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.547762 26595 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:55.522812 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.479885 26529 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.494702 26448 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:55.537817 26765 consensus_meta.cc:287] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.002s
W20260709 13:07:55.529016 26819 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
I20260709 13:07:55.437867 26797 consensus_queue.cc:1048] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.455s
W20260709 13:07:55.623378 22426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.009s	sys 0.009s
I20260709 13:07:55.539162 26530 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:55.596879 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.599239 26839 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.050s	user 0.001s	sys 0.001s
I20260709 13:07:55.594901 26753 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:55.629809 22426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.009s	sys 0.009s
I20260709 13:07:55.564733 26813 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:55.632771 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.615664 26762 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:55.644982 22581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.015s	sys 0.020s
W20260709 13:07:55.645576 22581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.015s	sys 0.020s
I20260709 13:07:55.589314 26806 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:55.649261 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:55.630788 26765 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11.
I20260709 13:07:55.650354 22582 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:55.588075 26811 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:55.656039 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:55.658890 22580 raft_consensus.cc:2368] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11.
I20260709 13:07:55.632784 26813 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:55.657637 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 136236us
I20260709 13:07:55.615015 26812 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:55.660522 22578 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:07:55.663782 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:55.664433 22428 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:55.665365 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:55.666486 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:55.655488 26426 raft_consensus.cc:3055] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:55.655064 26599 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:55.648382 26762 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:55.680847 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.661618 26813 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:55.668002 26826 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
I20260709 13:07:55.694737 22575 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:07:55.696447 26841 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:07:55.703292 26851 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:55.725186 26851 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:55.725836 26851 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:55.728030 26851 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:55.701593 22547 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:55.703591 26806 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:55.729302 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:55.707197 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.701525 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:55.731738 26782 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:55.732401 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.645624 26256 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:55.701946 26848 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:07:55.729683 26842 log.cc:927] Time spent T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 13:07:55.729193 26831 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.741624 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.674998 26426 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:55.740944 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.742851 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:55.719823 22424 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:55.766100 26609 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:55.766995 26426 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:55.668387 26765 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:55.761730 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:55.763942 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:55.770532 26764 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.773509 26757 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:55.768349 23104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 917) took 1121 ms. Trace:
I20260709 13:07:55.764104 26811 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:55.796720 22573 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:55.796612 22399 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:55.796624 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:55.744875 26775 consensus_meta.cc:287] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.003s
I20260709 13:07:55.800388 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:55.800880 26812 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:55.802826 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:55.805140 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:55.732314 26782 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:55.909545 23110 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.982596 23112 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:55.799140 26640 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:55.996623 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 534) took 1045 ms. Trace:
I20260709 13:07:55.998577 22433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 535) took 1037 ms. Trace:
I20260709 13:07:55.952107 23104 rpcz_store.cc:276] 0709 13:07:54.647098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.647232 (+   134us) service_pool.cc:224] Handling call
0709 13:07:54.647585 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.648040 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.648068 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.929602 (+281534us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b2c00047618. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:54.930028 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.213699 (+283671us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:55.213739 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.213814 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.768023 (+554209us) raft_consensus.cc:1685] finished
0709 13:07:55.768045 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.768264 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":406,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":92,"spinlock_wait_cycles":68232576,"thread_start_us":283263,"threads_started":1,"wal-append.queue_time_us":836506}
I20260709 13:07:55.960448 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:56.000818 22431 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:07:55.961763 22427 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:55.783499 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55062 (request call id 545) took 1174 ms. Trace:
I20260709 13:07:55.766891 26670 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.001703 22577 rpcz_store.cc:276] 0709 13:07:54.586877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.587010 (+   133us) service_pool.cc:224] Handling call
0709 13:07:55.745642 (+1158632us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540009b854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:55.761264 (+ 15622us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949361408}
W20260709 13:07:55.951514 26834 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:07:56.008569 22472 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:55.972569 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:55.962292 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 165789us
I20260709 13:07:55.981624 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:55.963501 22578 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:56.043936 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:55.998972 22433 rpcz_store.cc:276] 0709 13:07:54.960781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.961802 (+  1021us) service_pool.cc:224] Handling call
0709 13:07:54.974708 (+ 12906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.106040 (+131332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.106074 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.106604 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.308191 (+201587us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:55.308241 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.962485 (+654244us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54002986d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:55.962532 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.962593 (+    61us) raft_consensus.cc:1685] finished
0709 13:07:55.962608 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.998514 (+ 35906us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5019,"raft.queue_time_us":57620,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":55616,"spinlock_wait_cycles":300916096,"thread_start_us":197398,"threads_started":1,"wal-append.queue_time_us":653924}
I20260709 13:07:56.015023 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:55.997030 22430 rpcz_store.cc:276] 0709 13:07:54.953816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.953966 (+   150us) service_pool.cc:224] Handling call
0709 13:07:54.954364 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.961228 (+  6864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.961258 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.966941 (+  5683us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.207642 (+240701us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:55.612528 (+404886us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.615543 (+  3015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.615793 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.996412 (+380619us) raft_consensus.cc:1685] finished
0709 13:07:55.996431 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.996566 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132305,"prepare.queue_time_us":333142,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":15986,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":12140,"thread_start_us":431093,"threads_started":2,"wal-append.queue_time_us":476051}
I20260709 13:07:56.047705 22430 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:55.962968 26426 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.029784 26855 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:56.049597 26855 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:55.891567 26861 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.023958 26851 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:07:55.985746 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.041685 22576 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:55.961587 26765 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.065970 22399 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:55.994604 26775 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:55.957350 26764 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.038223 26812 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.171852 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.052160 26855 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.007856 26640 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.203265 23110 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
I20260709 13:07:56.184201 26871 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:56.216004 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 207713us
I20260709 13:07:56.074314 26863 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:56.098440 26841 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:07:56.241323 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.262157 22501 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:56.251744 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 222762us
W20260709 13:07:56.255014 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 178349us
I20260709 13:07:56.078055 26711 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.215149 26834 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:07:56.300812 23105 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:56.030318 22428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:56.215111 26786 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:56.248745 26603 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:07:56.308275 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 242374us
I20260709 13:07:56.303063 22428 raft_consensus.cc:606] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:56.317658 22399 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:56.080112 26851 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.074622 26813 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.072849 26861 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.337942 22429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1759) took 1535 ms. Trace:
I20260709 13:07:56.233582 26812 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.346567 26862 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.081s
W20260709 13:07:56.347332 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.347965 26836 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:56.348985 26868 log.cc:927] Time spent T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
W20260709 13:07:56.353313 26874 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:07:56.338136 26769 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.339114 22429 rpcz_store.cc:276] 0709 13:07:54.791846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.792002 (+   156us) service_pool.cc:224] Handling call
0709 13:07:54.826106 (+ 34104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.845780 (+ 19674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.845811 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.853791 (+  7980us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.175694 (+321903us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:55.440375 (+264681us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.615583 (+175208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.615662 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.326625 (+710963us) raft_consensus.cc:1685] finished
0709 13:07:56.326645 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.326796 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9730,"prepare.queue_time_us":364748,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":105660,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":3005,"thread_start_us":660133,"threads_started":3,"wal-append.queue_time_us":909872}
I20260709 13:07:56.257362 26871 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.332816 26872 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:56.357268 26782 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.358424 26873 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:56.321158 26758 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.327814 26603 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.287837 26711 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.343806 26849 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:56.357345 26885 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:56.370396 22501 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:07:56.331218 26786 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.454298 26758 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:56.385483 26856 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:56.452451 26782 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:56.490267 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.457664 26877 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.494410 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.495168 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:56.505721 22502 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.469369 26885 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.476495 26758 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.495801 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:56.509259 22506 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.509837 26812 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.510929 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 533) took 1585 ms. Trace:
I20260709 13:07:56.512260 26786 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.511340 22426 rpcz_store.cc:276] 0709 13:07:54.925724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.928861 (+  3137us) service_pool.cc:224] Handling call
0709 13:07:54.929182 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.941194 (+ 12012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.941225 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.956422 (+ 15197us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.631653 (+675231us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:55.631710 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.631785 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.510704 (+878919us) raft_consensus.cc:1685] finished
0709 13:07:56.510725 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.510869 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13811,"raft.queue_time_us":19367,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5612,"thread_start_us":674780,"threads_started":1,"wal-append.queue_time_us":938732}
I20260709 13:07:56.513608 26861 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.492218 22504 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:07:56.515327 22504 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.515720 26765 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.516994 26711 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.491559 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.515367 26871 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.496450 26782 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.522581 26782 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.522775 26775 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.390733 26836 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.523262 26782 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:56.455623 26849 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:56.524350 26849 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.525446 26836 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.452493 26872 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.503166 26884 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:56.462770 26843 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:56.527967 22506 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:07:56.508220 26885 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.528702 22502 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:56.482692 26670 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.540099 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:07:56.477995 26256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.003s	sys 0.008s
I20260709 13:07:56.555670 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:56.560820 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:56.561628 23106 raft_consensus.cc:2368] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:07:56.569254 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.570016 22506 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:56.524070 26782 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.544142 26775 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.505296 26877 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.573088 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:56.575479 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.576359 22504 raft_consensus.cc:2410] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:56.577569 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.579090 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.489804 26873 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.589165 22504 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:56.552778 26812 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.491151 26856 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.579465 22473 leader_election.cc:400] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
W20260709 13:07:56.551887 26256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.004s	sys 0.008s
I20260709 13:07:56.546245 26836 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.603204 22473 leader_election.cc:403] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:56.537740 26884 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.605195 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.605228 22499 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:56.608155 22504 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:07:56.610685 22503 raft_consensus.cc:2410] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:07:56.589587 26632 raft_consensus.cc:3055] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:56.581461 26891 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:56.537433 26843 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.615514 26890 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:07:56.604159 26872 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.618214 26849 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.635401 26849 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.618794 26884 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.630257 26813 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.636654 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1984) took 1038 ms. Trace:
I20260709 13:07:56.612915 26885 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:56.637063 22582 rpcz_store.cc:276] 0709 13:07:55.598341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.598939 (+   598us) service_pool.cc:224] Handling call
0709 13:07:55.599296 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.655758 (+ 56462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.636379 (+980621us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b540016d0d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:56.636595 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116830592}
I20260709 13:07:56.637519 22500 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:56.638422 22508 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:56.606007 26836 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.640587 26836 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.640655 26782 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.640811 26780 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.626021 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.626585 26851 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.601891 26775 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.643628 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1979) took 1146 ms. Trace:
I20260709 13:07:56.613734 26632 raft_consensus.cc:740] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:56.607735 26812 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.644426 26775 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.629913 26873 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:56.646030 26426 consensus_meta.cc:287] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.002s
I20260709 13:07:56.628249 26856 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:56.648056 26632 consensus_queue.cc:260] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.648696 26779 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.628991 26877 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.646142 26812 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:56.649732 26640 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.659508 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.661082 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34614 (request call id 539) took 1662 ms. Trace:
I20260709 13:07:56.661580 22424 rpcz_store.cc:276] 0709 13:07:54.999028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.127842 (+128814us) service_pool.cc:224] Handling call
0709 13:07:56.660860 (+1533018us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b540038aed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:56.660985 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1226048256}
I20260709 13:07:56.650023 26843 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.644030 22579 rpcz_store.cc:276] 0709 13:07:55.497638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.499858 (+  2220us) service_pool.cc:224] Handling call
0709 13:07:55.500161 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.633866 (+133705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.633902 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.633945 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:55.633975 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.643337 (+1009362us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540009a454. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:56.643386 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.643535 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306970880}
I20260709 13:07:56.650520 26891 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.669422 26799 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.670930 26632 raft_consensus.cc:3060] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.651481 22504 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:56.654691 26763 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:56.673053 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 408676us
I20260709 13:07:56.655550 26885 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.674779 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:56.657204 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.676213 22503 raft_consensus.cc:2410] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:07:56.679919 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 362318us
I20260709 13:07:56.681723 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:56.681723 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:56.683019 22502 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 15: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:56.696871 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:56.699069 22399 leader_election.cc:400] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11.
I20260709 13:07:56.683897 26357 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:56.706666 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.701858 26731 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.710350 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.711033 22500 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:56.711956 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.702144 26871 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:56.713021 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.722373 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:56.722398 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:56.725440 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:56.726265 23110 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 15: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:56.731529 22399 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:56.731650 26861 consensus_queue.cc:1059] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:56.732800 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:56.733215 26765 consensus_queue.cc:1059] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.734304 26765 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:56.734665 26765 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.734994 26765 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.737264 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1989) took 1137 ms. Trace:
I20260709 13:07:56.737686 22581 rpcz_store.cc:276] 0709 13:07:55.599775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.771428 (+171653us) service_pool.cc:224] Handling call
0709 13:07:55.771814 (+   386us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:07:55.772284 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.772321 (+    37us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:07:55.773200 (+   879us) log.cc:844] Serialized 104 byte log entry
0709 13:07:56.032936 (+259736us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:56.075925 (+ 42989us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.077030 (+  1105us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.150177 (+ 73147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.150277 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.732850 (+582573us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b1800427720. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:07:56.737019 (+  4169us) raft_consensus.cc:1685] finished
0709 13:07:56.737049 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.737204 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279857,"prepare.queue_time_us":42774,"prepare.run_wall_time_us":5511,"raft.queue_time_us":77826,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":136829,"spinlock_wait_cycles":28058368,"thread_start_us":259127,"threads_started":1,"wal-append.queue_time_us":412118}
I20260709 13:07:56.707856 26891 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.734903 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:56.723109 26758 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.735256 26875 raft_consensus.cc:3055] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:56.760715 22502 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
W20260709 13:07:56.765050 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.739650 26711 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:56.767894 26603 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:56.770987 26796 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:56.773988 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.776428 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.777998 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.779603 22505 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:56.771649 26796 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.753163 26875 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:56.783335 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:56.794816 22545 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:56.795161 26799 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.795961 26822 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.801083 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:56.779158 26812 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.807160 22545 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:56.795490 26856 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:56.795792 26799 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.809973 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:56.810776 22582 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.779026 26891 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:56.813596 22581 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:56.813859 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.814116 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.811535 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.816160 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.817814 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.812413 26856 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:56.783006 26762 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.821976 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.828971 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:56.808399 23107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.024s	sys 0.039s
W20260709 13:07:56.830907 23107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.024s	sys 0.040s
I20260709 13:07:56.832000 23107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 552) took 1070 ms. Trace:
I20260709 13:07:56.832182 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:56.799700 26892 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:56.850692 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:56.809412 26757 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.828912 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.857676 22574 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:56.856006 22582 raft_consensus.cc:2393] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:56.813539 26836 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:56.820969 26256 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:56.848636 26856 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.854107 26855 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.886089 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.885040 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:56.887204 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 213432us
I20260709 13:07:56.857415 26757 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.891577 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.816077 26812 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.865854 26791 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.902895 23076 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:56.900003 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:56.877179 26256 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:56.830029 26891 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:56.905095 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 170232us
I20260709 13:07:56.909839 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:56.864449 26892 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.911880 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:56.905376 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.914671 22472 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:56.942364 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.944523 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.899901 26836 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:56.903978 26757 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.951192 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.952549 22582 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:56.909240 26604 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:56.912678 26256 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:56.956717 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:07:56.957683 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 213666us
I20260709 13:07:56.960975 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:56.960841 22396 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:56.948549 26791 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:56.866341 26875 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.965174 22574 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 15: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:56.958055 26836 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.969933 26836 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.965886 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.906505 26855 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.967262 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.984827 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:56.986322 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:56.989836 22574 raft_consensus.cc:2393] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 13: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:56.966758 26791 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:56.991673 26791 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.985670 26908 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.992327 26711 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:56.992792 26908 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.992950 26711 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:56.833700 23107 rpcz_store.cc:276] 0709 13:07:55.762034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.762263 (+   229us) service_pool.cc:224] Handling call
0709 13:07:55.774557 (+ 12294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.774799 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:56.040564 (+265765us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.831651 (+791087us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.831712 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:56.831759 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.831829 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.831946 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":534006,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":6876,"raft.queue_time_us":94,"thread_start_us":1055987,"threads_started":2}
I20260709 13:07:56.995118 26711 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:56.995675 26711 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.996053 26900 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:56.992156 26777 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:56.996956 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.997617 26900 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:56.998287 22580 raft_consensus.cc:2393] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:56.996464 26711 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:56.998802 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.998145 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:56.998081 26900 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.999174 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.997251 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.000415 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.000898 22577 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:56.997660 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:56.999675 22578 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:57.002655 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 1982) took 1422 ms. Trace:
I20260709 13:07:57.002816 22505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:07:57.003485 22505 raft_consensus.cc:606] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.003870 22505 raft_consensus.cc:614] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:57.004201 22575 rpcz_store.cc:276] 0709 13:07:55.580200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.580407 (+   207us) service_pool.cc:224] Handling call
0709 13:07:55.604891 (+ 24484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.709168 (+104277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.002426 (+1293258us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x7b540016b2d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:57.002600 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183413504}
I20260709 13:07:56.963757 26762 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:56.970758 26758 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:57.006116 22582 raft_consensus.cc:2368] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
W20260709 13:07:57.011189 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 180914us
I20260709 13:07:57.021658 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.003255 26769 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.995067 26908 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:57.011149 26875 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:57.050024 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 103057us
I20260709 13:07:57.052546 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.036770 26822 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.057961 26822 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.033489 26799 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:57.064375 26711 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:57.064982 23108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59024 (request call id 550) took 1623 ms. Trace:
I20260709 13:07:57.065439 23108 rpcz_store.cc:276] 0709 13:07:55.442490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.442822 (+   332us) service_pool.cc:224] Handling call
0709 13:07:55.443166 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.630657 (+187491us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:56.003277 (+372620us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.063569 (+ 60292us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.063700 (+   131us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:56.063780 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.064751 (+1000971us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400594cd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:57.064797 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.064922 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":634871,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":105,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":430532480,"thread_start_us":409711,"threads_started":2,"wal-append.queue_time_us":500465}
I20260709 13:07:57.031857 26820 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.066565 26791 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.067404 26820 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.068725 22505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:07:57.069392 22505 raft_consensus.cc:606] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:57.069727 26820 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:57.070833 26791 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:57.072101 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:57.073035 23113 raft_consensus.cc:2410] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:07:57.073307 26791 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.072942 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.069757 22505 raft_consensus.cc:614] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:57.080871 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 109278us
I20260709 13:07:57.032074 26872 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.081914 22396 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:57.082901 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:57.085232 22474 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.086831 22546 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:57.089381 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.060282 26822 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:57.097684 22474 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.098547 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.098965 26836 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:57.093462 26777 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.036818 26897 consensus_queue.cc:1059] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:07:57.099277 26892 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:57.100385 22581 raft_consensus.cc:2410] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:57.106117 22474 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.107023 26892 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.107597 22474 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.108448 26892 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.109014 22474 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:57.109889 26892 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:57.112126 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:57.112833 22547 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:57.113086 26892 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.113883 22547 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:57.114667 22474 leader_election.cc:400] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:07:57.115605 22474 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:57.116767 26892 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:57.117921 26764 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:57.119388 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1760) took 2292 ms. Trace:
I20260709 13:07:57.119828 22425 rpcz_store.cc:276] 0709 13:07:54.827062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.827233 (+   171us) service_pool.cc:224] Handling call
0709 13:07:54.850404 (+ 23171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.975418 (+125014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.975447 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.975920 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.263504 (+287584us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:56.628038 (+1364534us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b180046e820. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f007081a3c7 00007f006ce2c9a7 00007f006ce3c0bf 00007f006ce3c038
0709 13:07:56.884299 (+256261us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.002897 (+118598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.119035 (+116138us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001e64d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:57.119088 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.119137 (+    49us) raft_consensus.cc:1685] finished
0709 13:07:57.119149 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.119302 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175229,"prepare.queue_time_us":265472,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":45201,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":34420,"spinlock_wait_cycles":289524864,"thread_start_us":660468,"threads_started":3,"wal-append.queue_time_us":682245,"wal-append.run_cpu_time_us":4480,"wal-append.run_wall_time_us":1268973}
I20260709 13:07:57.122977 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:07:57.133049 26894 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:07:57.134547 26789 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.138032 26813 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.138842 26813 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:57.139303 26813 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:07:57.141438 22501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 585) took 2054 ms (client timeout 2363 ms). Trace:
W20260709 13:07:57.141873 22501 rpcz_store.cc:269] 0709 13:07:55.087888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.088003 (+   115us) service_pool.cc:224] Handling call
0709 13:07:57.141211 (+2053208us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400184cd4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:57.141356 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2582821120}
I20260709 13:07:57.147653 26604 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:57.147845 23077 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:57.148283 26604 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:57.151401 26604 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:57.152104 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:57.153630 22398 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:57.154053 26885 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:57.155046 26836 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:57.155560 26836 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.159775 26875 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.160645 26875 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.162777 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:57.163017 26909 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:57.086711 22396 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:57.170738 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.172513 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.174422 22579 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:57.176070 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.081636 26746 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.163072 23105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 820) took 1182 ms. Trace:
I20260709 13:07:57.176949 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.192396 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.192898 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.192937 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:57.086136 26791 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:57.177295 23105 rpcz_store.cc:276] 0709 13:07:55.980762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.980956 (+   194us) service_pool.cc:224] Handling call
0709 13:07:55.981299 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.301299 (+320000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.162846 (+861547us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54002977d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:57.163017 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637153152}
I20260709 13:07:57.195199 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.188465 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:57.201948 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.189164 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:57.266965 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 180301us
I20260709 13:07:57.267590 22430 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:07:57.268177 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.268159 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:57.091899 26357 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:57.096069 26888 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.269336 22429 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:57.270278 23076 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:57.272684 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.279327 22425 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
W20260709 13:07:57.280000 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.112274 23079 connection.cc:256] RPC call timeout handler was delayed by -1.0618116529999497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:07:57.201987 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.282277 22426 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:57.178040 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.273470 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:57.285436 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:57.287329 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.176451 26812 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:57.290515 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.291664 22474 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:57.291886 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.091609 26872 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.108355 26731 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:57.176071 26871 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:57.295161 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.297654 22474 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.300937 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.294974 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.295162 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.308202 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.295468 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.189792 26913 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:57.189318 26758 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:57.168939 26856 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.189509 26763 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.490667 26856 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:57.493059 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:57.493741 26870 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:57.494345 26870 raft_consensus.cc:697] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:57.493779 23113 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:07:57.495255 26870 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:57.496160 26891 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:57.497184 22508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 1979) took 1005 ms. Trace:
I20260709 13:07:57.497638 22508 rpcz_store.cc:276] 0709 13:07:56.492202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.492315 (+   113us) service_pool.cc:224] Handling call
0709 13:07:56.492616 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.638816 (+146200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.496942 (+858126us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54001833d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:57.497127 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334527744}
I20260709 13:07:57.498924 26897 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:57.499449 26897 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.499835 26862 raft_consensus.cc:3055] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:57.501439 26862 raft_consensus.cc:740] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:57.501956 26853 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.502477 26862 consensus_queue.cc:260] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.500447 26918 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.503474 26836 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.308027 26731 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:57.498288 26913 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:57.503811 26862 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:57.508133 26913 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:57.289582 26822 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:57.508882 26822 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.509012 26731 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.510419 26731 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.511077 26822 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:57.473840 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 176270us
I20260709 13:07:57.293990 26917 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:57.308523 26871 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:57.513517 26871 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.514555 26871 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.308943 26796 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:57.423329 26901 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:07:57.288779 26909 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.519914 26909 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:57.520830 26758 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:57.522300 22433 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:07:57.523984 26758 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:57.398291 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.336932 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:57.191895 26861 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:07:57.313171 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45082.7us
I20260709 13:07:57.337865 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.140120 26813 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:57.309113 22581 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:57.370630 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.500581 26811 consensus_queue.cc:1059] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:57.500936 22578 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:07:57.501605 26897 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:57.360198 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:57.424222 26904 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:07:57.520398 26917 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:57.295076 26357 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:57.525585 22426 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:07:57.526748 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:57.566363 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.567492 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.569871 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.570679 26885 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.571094 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:57.571666 22500 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:07:57.566231 26357 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.570603 22426 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:57.551273 22399 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:57.552764 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:57.554280 26256 consensus_meta.cc:287] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.000s
W20260709 13:07:57.508888 26765 consensus_meta.cc:287] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.762s	user 0.008s	sys 0.002s
I20260709 13:07:57.505756 26836 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:07:57.564146 26900 consensus_meta.cc:287] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.000s
W20260709 13:07:57.565131 26757 consensus_meta.cc:287] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.003s
I20260709 13:07:57.502503 26872 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:57.592381 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:57.604137 23113 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:07:57.500016 26812 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:57.593187 22472 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.548998 26822 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.601958 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2574) took 2680 ms. Trace:
I20260709 13:07:57.571799 26891 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.593730 26915 consensus_queue.cc:1059] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:07:57.632392 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 105428us
I20260709 13:07:57.634994 22396 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:57.632596 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 81399us
I20260709 13:07:57.637967 22399 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:57.639636 22426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:07:57.640286 22426 raft_consensus.cc:606] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:07:57.638293 22499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.030s
W20260709 13:07:57.641412 22499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.000s	sys 0.030s
I20260709 13:07:57.642913 22573 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:57.626587 22432 rpcz_store.cc:276] 0709 13:07:54.921140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.928507 (+  7367us) service_pool.cc:224] Handling call
0709 13:07:54.928891 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.937745 (+  8854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.937777 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.938290 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.397169 (+458879us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:56.702841 (+1305672us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b18003c2080. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f007081a3c7 00007f006ce2c9a7 00007f006ce3c0bf 00007f006ce3c038
0709 13:07:56.940785 (+237944us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.074304 (+133519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.601598 (+527294us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b54000d6454. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:57.601664 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.601714 (+    50us) raft_consensus.cc:1685] finished
0709 13:07:57.601726 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.601885 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96755,"prepare.queue_time_us":144325,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":2043,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":11839,"spinlock_wait_cycles":139499008,"thread_start_us":803560,"threads_started":3,"wal-append.queue_time_us":1118493,"wal-append.run_cpu_time_us":3613,"wal-append.run_wall_time_us":1173060}
I20260709 13:07:57.628147 22472 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.597193 26765 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.557034 26861 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.584643 26860 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:57.603286 26599 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:57.651254 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:57.656256 26876 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.632823 26822 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.660094 26762 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:57.660801 26863 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:57.632258 26426 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.632858 26800 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.596884 26256 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:57.668797 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.669613 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:57.635767 26875 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:57.603235 26900 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.632822 26836 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:57.642645 26758 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:57.683290 22425 raft_consensus.cc:2368] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 13. Current term is 14.
I20260709 13:07:57.566115 26917 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.635316 26891 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.650184 26791 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.603410 26757 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:57.718390 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 448171us
W20260709 13:07:57.692101 22431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.010s	sys 0.014s
I20260709 13:07:57.695433 22581 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:57.630683 26812 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:57.705375 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:57.712674 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.683686 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:57.726122 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.651098 26731 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:07:57.716897 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:57.690388 22573 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:57.684077 26762 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:57.720229 23077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.018s	sys 0.010s
W20260709 13:07:57.721253 22431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.010s	sys 0.014s
I20260709 13:07:57.691586 26796 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:57.729751 26796 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:57.730198 26796 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.739462 26796 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:57.728919 23077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.018s	sys 0.010s
W20260709 13:07:57.759069 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 563473us
I20260709 13:07:57.761026 23077 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:57.762586 23077 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:57.763506 23077 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:57.764220 22474 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:57.742138 22427 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 14: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:57.742904 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:57.765872 22429 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:57.744094 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 60467.9us
I20260709 13:07:57.748313 26526 raft_consensus.cc:3055] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:57.754796 26871 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:57.755605 26811 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:57.720065 26640 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.020s	sys 0.026s
I20260709 13:07:57.766650 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:57.711853 26758 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.663158 26599 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:57.775079 22430 raft_consensus.cc:2368] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:07:57.782107 22472 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.768289 26526 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:57.696014 26426 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.742937 26762 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.707881 26875 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.788045 22500 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:57.776335 26640 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.020s	sys 0.026s
W20260709 13:07:57.794426 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.715021 26836 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.770684 26876 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:57.776152 26800 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:57.797379 26800 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:57.658156 22319 maintenance_manager.cc:643] P 71b24ec4eeaf4affa54fd8c740a7795b: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.972s	user 0.186s	sys 0.085s Metrics: {"bytes_written":31046,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":924299,"dirs.run_cpu_time_us":613,"dirs.run_wall_time_us":79039,"drs_written":1,"lbm_read_time_us":379,"lbm_reads_lt_1ms":4,"lbm_write_time_us":226692,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":5652352,"thread_start_us":509114,"threads_started":2,"update_count":36,"wal-append.queue_time_us":119203}
I20260709 13:07:57.779690 26758 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.783501 26885 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:57.820684 26891 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:57.821245 26812 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:57.821408 26891 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.815631 26800 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.783802 26811 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.825001 26811 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:57.786214 26888 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:57.826712 26888 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:57.827107 26888 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:07:57.828866 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.835603 22473 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:57.805747 26876 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:57.818965 26872 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:57.852548 26822 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:57.854750 26603 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.860524 26603 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:57.873636 26764 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.878441 22320 maintenance_manager.cc:419] P 71b24ec4eeaf4affa54fd8c740a7795b: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9582 bytes on disk
I20260709 13:07:57.885586 22319 maintenance_manager.cc:643] P 71b24ec4eeaf4affa54fd8c740a7795b: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":360,"lbm_reads_lt_1ms":4}
I20260709 13:07:57.894027 26599 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:57.895584 26853 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:57.897055 26912 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.400s	user 0.003s	sys 0.009s
I20260709 13:07:57.899072 26861 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:57.829643 26885 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:57.828063 26888 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.847522 26876 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:57.912323 22329 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33162 (request call id 245) took 43409 ms (client timeout 15000 ms). Trace:
W20260709 13:07:57.916646 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 428932us
I20260709 13:07:57.905090 26885 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.920225 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:57.908095 26796 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:57.905254 26872 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:57.927013 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 541) took 2684 ms. Trace:
I20260709 13:07:57.929316 22431 rpcz_store.cc:276] 0709 13:07:55.242908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.009147 (+766239us) service_pool.cc:224] Handling call
0709 13:07:57.149854 (+1140707us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800000c98. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfdb71 00007f0069cfda22 00007f0072c16c09 00007f0071d70ee0 00007f0071e3a0ab 00007f0071e3a131 00007f0071dfbfc0 00007f0071de6929 00007f0071de63d2 00007f006b35dbd4
0709 13:07:57.150080 (+   226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.150455 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.150483 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.150954 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.735988 (+585034us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:57.736033 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.736107 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.920982 (+184875us) raft_consensus.cc:1685] finished
0709 13:07:57.921008 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.926915 (+  5907us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9111,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":24696576,"thread_start_us":584657,"threads_started":1,"wal-append.queue_time_us":699131}
I20260709 13:07:57.915035 26855 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:57.915424 26765 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:57.918263 26888 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.920009 26757 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:57.940697 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.950209 26872 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:57.951498 26769 raft_consensus.cc:3055] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:57.951972 26769 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:57.952894 26769 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.953982 26769 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.936282 26256 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:57.938814 26855 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:57.945400 26900 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:57.976303 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 341350us
W20260709 13:07:57.912985 22329 rpcz_store.cc:269] 0709 13:07:14.492162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.496648 (+  4486us) service_pool.cc:224] Handling call
0709 13:07:57.901442 (+43404794us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:53.140533 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:53.240747 (+100214us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:53.287435 (+ 46688us) write_op.cc:435] Acquired schema lock
0709 13:07:53.291153 (+  3718us) tablet.cc:662] Decoding operations
0709 13:07:53.446976 (+155823us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:53.462911 (+ 15935us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:53.464302 (+  1391us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:07:53.531581 (+ 67279us) tablet.cc:701] Row locks acquired
0709 13:07:53.531641 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:07:53.531865 (+   224us) write_op.cc:270] Start()
0709 13:07:53.532023 (+   158us) write_op.cc:276] Timestamp: P: 1783602473531765 usec, L: 0
0709 13:07:53.532061 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:07:53.545751 (+ 13690us) log.cc:844] Serialized 1679 byte log entry
0709 13:07:54.466021 (+920270us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b240013ccb8. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069bbb9c4 00007f0069bb9acb 00007f0069d74dc9 00007f0069d74a55 00007f0069d73fb0 00007f006c9ea488 00007f006c9eabe8 00007f006c9c2398 00007f006c9bd76a 00007f006c9bcbb6
0709 13:07:54.606105 (+140084us) op_driver.cc:464] REPLICATION: finished
0709 13:07:54.908386 (+302281us) write_op.cc:301] APPLY: starting
0709 13:07:54.920032 (+ 11646us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:54.930162 (+ 10130us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:54.930209 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:54.930718 (+   509us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:54.931055 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:07:54.931121 (+    66us) write_op.cc:312] APPLY: finished
0709 13:07:54.931487 (+   366us) log.cc:844] Serialized 41 byte log entry
0709 13:07:54.931702 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:54.931821 (+   119us) write_op.cc:454] Released schema lock
0709 13:07:54.931882 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:54.932361 (+   479us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:54.932390 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":176793,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":216853,"apply.run_cpu_time_us":3041,"apply.run_wall_time_us":53689,"num_ops":4,"prepare.queue_time_us":198189,"prepare.run_cpu_time_us":18120,"prepare.run_wall_time_us":553313,"raft.queue_time_us":102407,"raft.run_cpu_time_us":6865,"raft.run_wall_time_us":59408,"replication_time_us":1055538,"spinlock_wait_cycles":3293440,"thread_start_us":238582,"threads_started":4,"wal-append.queue_time_us":140294,"wal-append.run_cpu_time_us":37234,"wal-append.run_wall_time_us":2493440}]]}
I20260709 13:07:57.984818 22396 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:07:57.965582 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46154.8us
I20260709 13:07:57.997046 23079 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.008368 23079 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:57.956452 26885 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:57.979350 26875 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:58.017356 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 253905us
I20260709 13:07:58.018757 26870 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:58.021018 26927 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:07:58.011327 26926 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:58.024097 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 242053us
I20260709 13:07:58.009797 26426 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:58.026569 22472 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:58.031970 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 217037us
I20260709 13:07:58.035730 23079 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:58.022642 26836 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:58.026690 26915 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:58.040548 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:07:58.055516 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 217918us
W20260709 13:07:58.058943 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48621.9us
I20260709 13:07:58.061062 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:58.062423 22473 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:58.063796 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 272023us
I20260709 13:07:58.059019 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:58.036361 26926 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:07:58.064296 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.065057 22577 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:07:58.035907 26796 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.024689 26800 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.080814 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.081306 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:58.062201 26426 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.087023 22474 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:58.061187 26915 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:58.035392 26870 consensus_queue.cc:1059] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:58.095955 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.097994 22502 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:58.066809 26855 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.099274 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.105221 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.109308 22506 raft_consensus.cc:2410] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:07:58.109458 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 48486.9us
I20260709 13:07:58.110435 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:58.099963 26915 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.070353 26758 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.124346 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:58.125442 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51806.4us
I20260709 13:07:58.127359 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:58.128232 22503 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.127358 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.087771 26357 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:58.190124 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:58.138952 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.137872 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.225894 22504 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.226023 22431 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:58.191555 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.137090 22425 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:58.227993 22501 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:58.230968 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.231197 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.235658 22430 raft_consensus.cc:2393] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 14: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:58.136409 22503 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:07:58.090716 26933 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:07:58.255059 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:58.256924 22503 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 14: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:58.241317 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 130956us
I20260709 13:07:58.242298 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.259291 22428 raft_consensus.cc:2410] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:58.242600 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.099363 26426 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.243594 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.269940 22432 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:07:58.100198 26796 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:58.252974 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:58.101613 26929 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:07:58.110157 26925 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:07:58.251955 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.190317 26872 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.114425 26938 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.116163 26765 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:58.119545 26945 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:58.295209 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.307260 22430 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:58.288982 22431 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.230417 26731 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:58.298671 22425 raft_consensus.cc:2410] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:58.122736 26935 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:58.299340 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.303745 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.138195 26256 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.306166 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.313910 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 230618us
I20260709 13:07:58.314354 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.253947 26940 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:58.346129 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 259177us
I20260709 13:07:58.295130 26813 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:58.304677 26949 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.323720 22503 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:07:58.360780 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.359848 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.302547 26599 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:58.322547 26762 consensus_meta.cc:287] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.003s
I20260709 13:07:58.318483 26936 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:58.373049 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.373723 22501 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:58.322314 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:07:58.365031 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 300789us
I20260709 13:07:58.366550 22504 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:58.363173 22425 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
W20260709 13:07:58.369372 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 110991us
I20260709 13:07:58.370481 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:58.312734 26765 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.377350 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:58.347895 26870 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:58.385128 22577 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:58.324465 26940 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:58.341122 26885 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:58.384958 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.381912 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.385902 23112 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
W20260709 13:07:58.393097 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 156091us
I20260709 13:07:58.392583 22472 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:58.313102 26945 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.399556 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.397089 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:58.323124 26731 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:58.398981 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.403028 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:58.398098 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.401255 22503 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.404443 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.405042 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:58.405606 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.407198 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.407431 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.408109 22507 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:58.408012 22505 raft_consensus.cc:2393] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 7: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:58.410053 26758 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:58.412401 22424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2582) took 1221 ms. Trace:
I20260709 13:07:58.412824 22424 rpcz_store.cc:276] 0709 13:07:57.191463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.193240 (+  1777us) service_pool.cc:224] Handling call
0709 13:07:57.193581 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.193993 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.194020 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.194447 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.856932 (+662485us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b4800080358. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0071d4baa1 00007f0071d42b37 00007f0071d429ca 00007f0071e3a26f 00007f0071e39f37 00007f0071e4e55c 00007f0071e4e508 00007f0071e4e488 00007f0071e4e443 00007f0071e4d6ec 00007f0070d77a96
0709 13:07:58.115258 (+258326us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b1800332fe0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b 00007f006c9c1d23 00007f006c9c20d1 00007f006cddda0f
0709 13:07:58.357894 (+242636us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:58.357972 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.358115 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.412164 (+ 54049us) raft_consensus.cc:1685] finished
0709 13:07:58.412185 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.412345 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26519,"raft.run_cpu_time_us":18879,"raft.run_wall_time_us":589629,"spinlock_wait_cycles":23832192,"thread_start_us":242278,"threads_started":1,"wal-append.queue_time_us":1190474}
I20260709 13:07:58.414813 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.415392 22424 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:58.416580 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.416872 26938 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:58.417487 26938 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.419545 26938 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:58.383303 26800 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:58.388952 26940 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.377560 26762 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.421916 26796 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:58.342568 26256 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:58.386883 26949 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.377370 26936 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:07:58.407704 26939 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:07:58.380211 26955 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:58.337174 26872 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.431396 22503 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:07:58.434866 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.387957 26870 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:07:58.408375 26947 log.cc:927] Time spent T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:07:58.438724 22428 raft_consensus.cc:2393] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 13: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:58.438941 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.438993 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.439764 22501 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:58.434983 22431 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:58.363759 26813 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:58.424767 26942 log.cc:927] Time spent T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:07:58.441048 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.439599 23112 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:58.445739 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.444217 22426 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:07:58.453723 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.454398 23112 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:58.455279 22431 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:07:58.456427 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.452348 22546 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:58.424432 26256 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:58.380955 26599 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:58.407243 26948 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:58.460902 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.459426 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:58.461958 22396 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.469594 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.472613 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:58.472891 22398 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:58.473228 22502 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.429919 26936 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.474023 22431 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:58.475863 22398 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.476248 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:58.480365 23112 raft_consensus.cc:1217] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Deduplicated request from leader. Original: 9.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 13:07:58.480934 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.480872 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:58.443250 26955 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.482700 22500 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:58.484150 22500 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:58.485023 22546 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.485261 22500 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:58.490726 23112 raft_consensus.cc:1240] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:58.490943 22398 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.494378 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.497227 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.460068 26909 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.499929 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.473163 26928 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:58.460906 26762 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:58.508931 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.509560 23107 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:58.509696 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.510686 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.510715 22396 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:58.507166 22431 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:07:58.512499 22396 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:58.504278 26919 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.514201 22431 raft_consensus.cc:1240] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:58.514282 22502 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:58.514556 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.489993 26918 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.491693 26955 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.490437 26938 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.505511 22546 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.520742 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.511237 26862 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.498484 26256 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:58.475502 26820 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:07:58.531368 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.525094 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:58.501696 26952 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:58.544525 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.513540 26928 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.528818 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.555847 22502 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:58.481801 26860 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:07:58.513688 26900 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:58.482776 26948 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:58.522648 26946 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:07:58.557206 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:58.558346 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.521690 26913 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:58.558045 26961 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.545455 26426 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:58.545156 26746 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.594583 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:58.544814 26758 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:58.559800 26928 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.617945 22579 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:58.619764 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:58.594764 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.622737 22472 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:58.629464 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.629796 23108 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:07:58.637223 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 124802us
I20260709 13:07:58.558413 26952 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:58.562213 26949 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.654973 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:58.560861 26900 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:58.655498 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:58.601653 26836 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:58.658911 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:58.660857 22472 leader_election.cc:400] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 13. Current term is 14.
I20260709 13:07:58.516919 26870 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:58.666733 22396 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:58.621693 26913 raft_consensus.cc:697] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:58.673132 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 182248us
I20260709 13:07:58.675031 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.687667 26746 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:58.664978 22547 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:58.680413 22579 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:58.692204 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:58.692848 22579 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:58.693706 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:58.680856 22576 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.570794 26256 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.658738 26796 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.704429 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.682121 26900 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.707509 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:58.708178 22426 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:58.682180 26632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.003s	sys 0.012s
I20260709 13:07:58.681541 26949 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.682876 22396 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:58.639874 26758 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:58.690128 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:58.680799 22472 leader_election.cc:403] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:58.698140 22547 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.698269 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:58.679764 26965 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:58.723218 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 62523.1us
I20260709 13:07:58.724318 22472 leader_election.cc:400] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:07:58.725153 22472 leader_election.cc:403] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:07:58.689159 26856 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.193s	user 0.011s	sys 0.016s
I20260709 13:07:58.682596 26836 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.679122 26765 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:07:58.712077 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 187065us
I20260709 13:07:58.620905 26961 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.691337 26746 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.718550 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.719033 22574 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.711007 26870 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.737093 22424 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:07:58.715727 26791 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.738126 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.701279 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:58.719303 22579 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:58.730479 26856 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.012s	sys 0.016s
I20260709 13:07:58.743467 22399 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:58.693012 26731 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:58.690456 26945 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:58.745288 26945 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:07:58.745733 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.728509 22398 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:07:58.731671 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:07:58.732277 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49485.1us
I20260709 13:07:58.714870 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:58.710256 26632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.003s	sys 0.013s
I20260709 13:07:58.747262 22427 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:07:58.747138 26856 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:58.748731 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.749119 22579 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:58.749934 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:58.750109 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:58.750622 22427 raft_consensus.cc:2393] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:58.750695 22546 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.748436 26632 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:58.751564 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:58.721717 26357 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:58.721101 26758 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.752346 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:58.751886 22501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:07:58.766553 22501 raft_consensus.cc:606] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:58.751101 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:58.719853 26599 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:58.761348 22427 raft_consensus.cc:2368] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:07:58.720086 26872 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:58.761242 26856 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:58.763365 22399 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:58.732143 26962 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 13. Current term is 14.
I20260709 13:07:58.764680 26930 consensus_queue.cc:1059] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:58.764694 22533 heartbeater.cc:646] Failed to heartbeat to 127.20.208.62:33169 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.208.62:33169 timed out after 15.000s (SENT)
I20260709 13:07:58.731073 26836 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.709971 26796 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.738606 26746 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:58.836119 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 72806.2us
I20260709 13:07:58.837051 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:58.778169 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:07:58.818521 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.838279 22579 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:07:58.820951 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:58.752619 26762 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:58.739336 26820 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:58.780655 26915 consensus_meta.cc:287] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.594s	user 0.004s	sys 0.007s
I20260709 13:07:58.775169 26917 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:58.781152 26860 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:58.787547 26964 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:07:58.785557 26872 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:58.841741 26960 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 13:07:58.876631 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 126015us
I20260709 13:07:58.765897 26632 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.727502 26526 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.841554 26930 consensus_queue.cc:1243] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer e32ba8e6132b4f8e98a99066b6fffe05 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:58.776269 26791 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:58.861685 26917 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.862145 26860 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:07:58.897605 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 158017us
I20260709 13:07:58.876660 26934 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:58.876428 26973 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.779354 26913 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.900187 26917 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.900421 26526 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:58.917011 26976 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:07:58.898142 26769 consensus_meta.cc:287] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.944s	user 0.014s	sys 0.000s
I20260709 13:07:58.899106 26731 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.972303 22574 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
W20260709 13:07:58.943871 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 63700.4us
I20260709 13:07:58.954668 22576 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
W20260709 13:07:58.903852 26963 log.cc:927] Time spent T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
I20260709 13:07:58.901113 26860 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.980505 22576 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:58.872042 26915 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:58.981006 22576 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:58.976313 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:58.943241 26966 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:07:58.986343 22574 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:59.013450 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 176480us
I20260709 13:07:59.018056 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:07:58.974618 26932 log.cc:927] Time spent T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.887s	user 0.002s	sys 0.003s
W20260709 13:07:58.979446 26977 log.cc:927] Time spent T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.200s	user 0.001s	sys 0.001s
W20260709 13:07:58.979417 26980 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:07:58.980851 26967 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.291s	user 0.001s	sys 0.001s
I20260709 13:07:59.020032 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:07:59.017856 26982 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:07:59.036557 22432 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:59.037485 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 313273us
I20260709 13:07:58.979218 26934 raft_consensus.cc:697] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:59.035863 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:59.021860 26948 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.022392 26952 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.032699 22576 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:59.050191 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 74004.1us
I20260709 13:07:59.056567 22546 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:58.943615 26973 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:59.050856 26876 consensus_meta.cc:287] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 1.132s	user 0.009s	sys 0.004s
I20260709 13:07:59.062589 22546 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:59.088868 26791 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:59.090070 26632 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:59.057266 26949 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.090894 26949 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.057118 26983 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.082199 22426 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:07:59.065712 22576 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.060045 26948 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.124742 26994 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.165376 26256 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.091360 26949 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.188300 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 2643) took 1449 ms. Trace:
I20260709 13:07:59.193675 22582 rpcz_store.cc:276] 0709 13:07:57.738979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.739899 (+   920us) service_pool.cc:224] Handling call
0709 13:07:57.740221 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.814456 (+ 74235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.814487 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.814529 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:57.814557 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.187991 (+1373434us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b5400046354. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:59.188049 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.188219 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170275200}
I20260709 13:07:59.195521 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:59.197149 26746 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.198173 26357 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:59.198655 26357 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.199487 26746 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.204259 26855 raft_consensus.cc:3055] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:59.204785 26855 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:59.205699 26855 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.208848 26357 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.211176 26357 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:59.213617 26940 consensus_meta.cc:287] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.793s	user 0.010s	sys 0.000s
I20260709 13:07:59.213816 26973 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.214160 26940 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:59.216859 26928 consensus_meta.cc:287] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.002s
I20260709 13:07:59.197566 22578 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:07:59.111253 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 48731.8us
I20260709 13:07:59.092244 26820 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:59.217319 26928 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.113811 26983 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.115432 26632 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:59.216310 26940 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:59.220629 26994 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.230434 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:59.231220 26994 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.232687 26928 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:59.236172 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.236759 22576 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:59.190065 26961 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.244283 26915 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.249853 22432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1781) took 1123 ms. Trace:
I20260709 13:07:59.257323 22432 rpcz_store.cc:276] 0709 13:07:58.126018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.283626 (+157608us) service_pool.cc:224] Handling call
0709 13:07:58.289688 (+  6062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.047571 (+757883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.249579 (+202008us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b540038c2d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:07:59.249780 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717041408}
I20260709 13:07:59.080071 26876 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.260051 22499 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
W20260709 13:07:59.260555 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 240789us
I20260709 13:07:59.261993 26876 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.263242 26640 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:59.263804 26640 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.265892 26640 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:59.268741 26872 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.269424 26872 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.270260 23077 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:59.271721 26872 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:59.273577 26952 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.274082 26952 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.274394 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:59.276701 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.279170 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.292819 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.286113 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.293628 22582 raft_consensus.cc:1275] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:07:59.294051 22582 pending_rounds.cc:85] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 7
I20260709 13:07:59.294811 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.223734 26820 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:59.294308 22582 pending_rounds.cc:107] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:07:59.296898 22582 raft_consensus.cc:2889] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.227898 26983 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.192958 26948 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.303422 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.303723 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.303421 22573 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:59.305461 22424 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:07:59.274447 26952 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.240793 26632 raft_consensus.cc:697] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:07:59.306957 23079 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:59.298835 26820 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:59.314325 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.316942 22432 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
W20260709 13:07:59.307701 26888 consensus_meta.cc:287] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 1.367s	user 0.008s	sys 0.014s
I20260709 13:07:59.325663 22508 raft_consensus.cc:2410] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:59.337097 22430 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:07:59.220556 26934 consensus_queue.cc:237] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.312816 26926 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.325610 26944 consensus_queue.cc:1048] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:59.317799 26961 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.355731 26936 consensus_meta.cc:287] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.847s	user 0.009s	sys 0.001s
I20260709 13:07:59.309118 26836 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.360358 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.314003 26640 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:07:59.310822 26762 raft_consensus.cc:697] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:59.378422 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:07:59.361104 26955 consensus_meta.cc:287] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.000s
I20260709 13:07:59.379230 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:59.383606 22426 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:59.364115 26915 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.395886 22581 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 10: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:59.408985 26981 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:59.409704 26981 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:07:59.419282 23078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.419900 26990 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:59.379793 27004 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:59.380686 26999 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:07:59.418238 26758 consensus_meta.cc:287] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.636s	user 0.005s	sys 0.005s
I20260709 13:07:59.414813 26907 raft_consensus.cc:3055] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:59.363862 26961 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.433781 27005 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:59.367539 26936 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.423354 26949 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.380852 26955 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.449630 26948 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.416162 26915 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.445539 27005 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.446674 26918 raft_consensus.cc:993] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:07:59.450778 26955 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.456008 26918 raft_consensus.cc:1081] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:07:59.443511 26907 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:07:59.456008 26900 consensus_meta.cc:287] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.738s	user 0.004s	sys 0.004s
I20260709 13:07:59.457267 26860 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.441504 26758 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.459493 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51870 (request call id 1792) took 1161 ms. Trace:
I20260709 13:07:59.462926 23077 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:59.470988 26917 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.444154 26999 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:59.472023 26919 consensus_meta.cc:287] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.949s	user 0.009s	sys 0.000s
I20260709 13:07:59.381213 26632 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.483822 22430 rpcz_store.cc:276] 0709 13:07:58.298275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.308521 (+ 10246us) service_pool.cc:224] Handling call
0709 13:07:59.459304 (+1150783us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54003acad4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:07:59.459427 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1243670272}
I20260709 13:07:59.490700 26961 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:59.491901 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 106611us
I20260709 13:07:59.481454 26929 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.442484 26762 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.486748 26640 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:59.436625 27004 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.490085 26907 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.511775 26907 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.500648 26981 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:59.520694 26758 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.521057 26999 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.522035 26836 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:59.522890 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 744189us
I20260709 13:07:59.525389 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:07:59.492756 26983 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:59.526810 26978 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:07:59.527354 26978 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:59.527736 26978 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:59.527998 26983 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:59.528774 22576 raft_consensus.cc:2368] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10.
I20260709 13:07:59.531701 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51870 (request call id 1806) took 1086 ms. Trace:
I20260709 13:07:59.534427 26915 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.535183 26961 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.535699 26961 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:59.536918 26870 consensus_meta.cc:287] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.781s	user 0.002s	sys 0.017s
I20260709 13:07:59.532122 22431 rpcz_store.cc:276] 0709 13:07:58.445032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.512958 (+ 67926us) service_pool.cc:224] Handling call
0709 13:07:58.513235 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.521394 (+  8159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.531436 (+1010042us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b54001d8ba0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006cd99dc0 00007f006ce25a02 00007f006ce21dd6 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:07:59.531642 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22334720}
I20260709 13:07:59.546382 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.547214 22577 raft_consensus.cc:2393] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:07:59.483176 26900 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.487149 26919 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:59.554106 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:59.552906 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:59.566205 22503 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:59.563455 22582 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:59.566334 22577 raft_consensus.cc:1240] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:59.569185 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:59.569805 22502 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.572644 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:59.574419 22501 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:59.567616 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.576687 22505 raft_consensus.cc:2410] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:59.575924 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.508178 26640 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:07:59.583653 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:59.576649 22577 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:07:59.528085 26978 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.591672 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:07:59.598102 22502 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:07:59.599578 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:59.600155 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.601549 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:59.603529 22577 raft_consensus.cc:2368] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 12. Current term is 13.
I20260709 13:07:59.504029 26929 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.605247 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.603839 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.615700 22425 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:59.620349 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.591486 26640 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.624182 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:59.625579 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.626799 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:59.630709 22580 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:07:59.631654 22425 raft_consensus.cc:2393] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:07:59.625756 26981 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:07:59.633484 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.614709 26820 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.635625 22582 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:07:59.637758 26952 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.640267 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:07:59.641458 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.643476 26990 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:07:59.643985 26990 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.647953 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:59.649482 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:59.650275 23113 raft_consensus.cc:2393] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:07:59.641508 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:07:59.603561 26836 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.656219 26917 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.628645 26926 consensus_queue.cc:1059] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:59.657382 26926 raft_consensus.cc:3055] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:59.657711 26926 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:07:59.658530 26926 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.659747 26926 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.620285 26955 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:59.660912 26955 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.663046 26955 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.665782 27005 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:59.666855 26860 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:59.668201 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:59.602402 26961 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.673633 27004 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:59.674942 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.660921 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:59.676295 23105 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:07:59.691709 22473 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:59.699358 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 59531.3us
I20260709 13:07:59.702437 22432 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:59.708834 22399 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:07:59.734431 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 82232.5us
I20260709 13:07:59.738169 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:59.740381 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:59.673637 26900 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.769120 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:59.699286 26961 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:59.772168 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.776880 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.798456 22432 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:07:59.802572 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 93833.7us
I20260709 13:07:59.797331 26961 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.805872 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.808648 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.806195 26961 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.810472 26875 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:59.811055 26875 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:59.811892 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:59.811908 26875 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.815387 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:59.806116 22428 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:59.817535 22431 raft_consensus.cc:2376] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9. Re-sending same reply.
I20260709 13:07:59.811224 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.815979 22432 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.699577 26604 consensus_queue.cc:1059] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:07:59.822480 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:59.823208 22425 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.825815 22502 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:59.827052 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:07:59.819145 26952 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.833986 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:59.834710 22500 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:07:59.856519 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:59.840586 26990 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.866524 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:07:59.874900 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:07:59.876917 23105 raft_consensus.cc:2368] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10.
I20260709 13:07:59.878765 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:07:59.842089 26862 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:07:59.884464 22431 consensus_queue.cc:237] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.840353 26978 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.885876 27000 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.873039 26757 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:59.899284 26955 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:59.890226 26813 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:59.880858 26765 consensus_queue.cc:1059] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:07:59.873873 26820 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:59.899034 26757 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:07:59.897513 27018 log.cc:927] Time spent T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:07:59.904752 22577 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:07:59.909026 22396 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:59.919454 26765 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:59.922461 26990 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:07:59.930559 27002 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:59.931167 22502 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:59.932672 26938 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:59.933395 26938 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.935590 26938 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.936877 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:59.937448 26978 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:07:59.899847 26955 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.931205 27002 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.940158 26955 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:07:59.922484 26972 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 1.030s	user 0.005s	sys 0.011s
I20260709 13:07:59.945822 22501 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:59.946923 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:59.947530 22501 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.950824 26757 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.953500 26929 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.954246 26929 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:07:59.953984 26640 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.954856 26796 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.911494 27003 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:59.956270 27003 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:59.935774 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:59.956681 23106 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:59.956888 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:07:59.959702 22504 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:07:59.968570 22504 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:59.970443 22503 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:59.960050 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:07:59.962569 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:59.974501 22505 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:07:59.974805 22502 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:07:59.960850 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:59.979842 22501 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:07:59.980960 22507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 2015) took 1518 ms. Trace:
I20260709 13:07:59.984248 22501 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:59.985838 22425 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:07:59.981444 22507 rpcz_store.cc:276] 0709 13:07:58.452119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.452251 (+   132us) service_pool.cc:224] Handling call
0709 13:07:58.452580 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:58.452945 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.452973 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:58.460325 (+  7352us) log.cc:844] Serialized 52 byte log entry
0709 13:07:58.643931 (+183606us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:58.643970 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.644041 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.921784 (+1277743us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:07:59.960155 (+ 38371us) raft_consensus.cc:1685] finished
0709 13:07:59.960177 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.970596 (+ 10419us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4371,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":11546,"spinlock_wait_cycles":13461376,"thread_start_us":137288,"threads_started":1,"wal-append.queue_time_us":250700}
I20260709 13:07:59.989432 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:07:59.940259 27002 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:07:59.995760 22396 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:07:59.996810 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:07:59.999094 22396 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.2:42819 timed out after 1.684s (SENT) [suppressed 10 similar messages]
I20260709 13:08:00.001222 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1998) took 1912 ms. Trace:
I20260709 13:08:00.001652 22506 rpcz_store.cc:276] 0709 13:07:58.088848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.089016 (+   168us) service_pool.cc:224] Handling call
0709 13:08:00.000974 (+1911958us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b54003ea654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:08:00.001157 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3849984}
I20260709 13:07:59.985390 27000 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.006311 27000 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.006719 27000 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.957238 27003 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:07:59.954859 26929 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.014755 23107 raft_consensus.cc:2410] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:00.015249 26929 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.019129 26974 raft_consensus.cc:3055] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:00.019641 26974 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:07:59.995011 26758 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:00.023731 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:07:59.982308 26961 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.985678 26949 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:00.025442 26949 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:07:59.956442 26640 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:00.027149 26961 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:00.029472 22432 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:08:00.028218 26949 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:00.003757 26765 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.031081 26765 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:07:59.990965 27001 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:08:00.031481 26765 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.032850 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:00.033507 23105 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:00.034646 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:00.035414 22503 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 16: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:08:00.037813 22508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1996) took 1957 ms (client timeout 1684 ms). Trace:
I20260709 13:08:00.042443 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:00.035307 23113 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
W20260709 13:08:00.056703 22508 rpcz_store.cc:269] 0709 13:07:58.080758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.081056 (+   298us) service_pool.cc:224] Handling call
0709 13:08:00.037582 (+1956526us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400425ed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:08:00.037738 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2846439168}
I20260709 13:08:00.033632 26918 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:00.065038 22432 raft_consensus.cc:1240] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:00.066479 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.069664 22398 leader_election.cc:400] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10.
I20260709 13:08:00.070057 22398 leader_election.cc:403] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.073288 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.074610 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.026027 26940 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.076143 26604 consensus_queue.cc:1059] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:08:00.077659 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:00.075982 26965 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:00.093837 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.083098 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:00.074548 22472 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:00.072427 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.092187 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:00.096022 22508 raft_consensus.cc:2393] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:00.096953 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.097712 22508 raft_consensus.cc:2393] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:00.054534 26913 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:08:00.101166 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.093856 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.109395 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:00.114040 22508 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.109946 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.114995 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:00.113044 22507 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:08:00.117343 26870 raft_consensus.cc:3055] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:00.117769 26870 raft_consensus.cc:740] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:00.119324 22425 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:08:00.110177 22472 leader_election.cc:400] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:08:00.120632 22472 leader_election.cc:403] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.121357 26855 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:00.128407 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 129341us
I20260709 13:08:00.132658 26936 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:00.133492 26934 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:08:00.133749 22499 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 1999) took 2038 ms (client timeout 1993 ms). Trace:
I20260709 13:08:00.134120 26934 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.136945 26934 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.080523 27002 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:00.076881 26918 raft_consensus.cc:697] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:00.079663 26933 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10.
I20260709 13:08:00.079906 26853 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:08:00.134156 22499 rpcz_store.cc:269] 0709 13:07:58.095471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.095675 (+   204us) service_pool.cc:224] Handling call
0709 13:08:00.133563 (+2037888us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003eb554. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:08:00.133678 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2675449728}
I20260709 13:08:00.156759 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:00.157687 22499 raft_consensus.cc:2410] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:00.115330 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:00.144774 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.145212 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.158305 22432 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:00.158926 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.159111 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.159665 22430 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:00.147591 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:00.160352 22425 raft_consensus.cc:2393] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 13: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:00.138394 22396 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:00.148458 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 124822us
I20260709 13:08:00.162241 22474 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:00.165356 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 55317us
I20260709 13:08:00.153123 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.153448 23113 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:00.035816 26974 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.154279 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:00.159730 22432 raft_consensus.cc:2393] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:00.168834 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.169188 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:00.142768 27030 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:00.169662 22499 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:00.138243 26796 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.183903 22474 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:00.186486 22474 leader_election.cc:400] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 12. Current term is 13.
I20260709 13:08:00.187364 22474 leader_election.cc:403] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.187163 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.187742 22396 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:00.185997 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:00.196396 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.197371 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:00.197526 22472 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:08:00.198939 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49188 (request call id 2024) took 1583 ms (client timeout 1994 ms). Trace:
I20260709 13:08:00.166706 26990 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.199363 22580 rpcz_store.cc:269] 0709 13:07:58.615220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.615336 (+   116us) service_pool.cc:224] Handling call
0709 13:08:00.198718 (+1583382us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b5400375854. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:08:00.198868 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2087943936}
I20260709 13:08:00.174288 26934 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.220299 23105 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 16.
I20260709 13:08:00.243598 22473 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:00.209292 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.189096 26758 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.155359 27002 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.191444 26949 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.185449 26940 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.230839 23108 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:00.176651 27039 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:08:00.203682 26961 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:00.200189 26938 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.193946 26900 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:00.261986 27046 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:00.262147 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 64870.9us
I20260709 13:08:00.263307 26961 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:00.264389 26961 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.266564 26965 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.267092 26965 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:00.267443 26965 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.172744 26853 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.270224 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:00.251870 26796 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.268108 26900 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:00.258507 26949 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.281658 26949 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.273317 27036 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:08:00.244755 26990 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.262598 27046 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:00.220333 27000 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.281904 26900 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.296866 27002 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.298884 26990 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.299860 22433 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:00.285162 26855 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.302148 26855 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:08:00.305169 22317 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4d35c45e33c4336b33461cdbe7f7b6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9cea93fb03e04e48a6dabc4094ee7c93 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:00.308367 26855 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.305593 22508 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:08:00.316213 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:00.267874 26918 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.318835 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.318095 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.325989 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.326830 22508 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:00.328728 23076 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.328287 22396 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:00.290139 26929 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:08:00.341975 26640 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:00.342520 26640 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:00.343451 26640 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.348925 26731 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.349532 26731 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.349874 26731 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.354900 26853 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.357228 26640 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.372905 27046 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.374171 26990 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:00.374981 26990 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.376916 22428 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:00.376899 26900 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.379498 26900 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.382612 27002 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.383486 27002 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:00.387564 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 58948.4us
I20260709 13:08:00.388597 23076 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.385123 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 2031) took 1760 ms. Trace:
I20260709 13:08:00.393432 26929 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.389761 22578 rpcz_store.cc:276] 0709 13:07:58.624762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.889241 (+264479us) service_pool.cc:224] Handling call
0709 13:07:58.901725 (+ 12484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.218611 (+316886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.384831 (+1166220us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540028c154. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:08:00.385055 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679501056}
I20260709 13:08:00.395660 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.400841 26929 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.403939 27002 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.351846 26765 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.415287 26765 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:00.425832 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 228379us
I20260709 13:08:00.416078 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 564) took 1131 ms. Trace:
I20260709 13:08:00.396411 22502 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:00.416016 26919 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.421953 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:00.423229 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.420739 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.443125 22574 rpcz_store.cc:276] 0709 13:07:59.284187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.299017 (+ 14830us) service_pool.cc:224] Handling call
0709 13:07:59.301516 (+  2499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.301710 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:59.348833 (+ 47123us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.622332 (+273499us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.415569 (+793237us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b180046ab00. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069cafc0a 00007f00733ef219 00007f0069d37a40 00007f0069d324e4 00007f0069d32455 00007f006ce1a060 00007f006ce2c716 00007f006ce3d287 00007f006ce3d208
0709 13:08:00.415735 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.415785 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:00.415823 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.415904 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.416010 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":792450,"prepare.queue_time_us":63076,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":2136,"raft.queue_time_us":796534,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":9283,"spinlock_wait_cycles":6486784,"thread_start_us":297980,"threads_started":2,"wal-append.queue_time_us":359337}
I20260709 13:08:00.449430 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:00.444622 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:00.448801 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.450977 22578 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.450920 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:00.451699 22581 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:08:00.452543 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.442467 22472 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:00.458390 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:00.459228 22577 raft_consensus.cc:2393] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:00.460646 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.461493 22574 raft_consensus.cc:2368] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10.
I20260709 13:08:00.462857 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:00.471246 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.471959 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.472095 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:08:00.471928 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.443298 26936 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.444051 27002 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.479140 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 553015us
I20260709 13:08:00.481802 22546 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:00.483494 22472 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:00.448977 26526 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:00.458572 26961 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.488466 22472 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:00.470083 22575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:08:00.494174 22575 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.484655 26796 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.494328 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:00.496074 22575 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.498162 22545 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.499505 22545 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.505909 26256 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.508260 22501 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:00.488864 26938 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 12. Current term is 13.
I20260709 13:08:00.514909 22580 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:00.466110 26909 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:08:00.492764 27039 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.515281 26983 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.516862 26940 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:00.494851 27000 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.533963 26940 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.534304 26965 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.520332 26955 raft_consensus.cc:3055] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:00.516578 26820 consensus_queue.cc:1059] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:08:00.487865 26978 consensus_queue.cc:1059] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:08:00.496832 26604 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.542012 26949 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.543248 22499 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:00.525702 26990 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.544854 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:00.546056 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.547016 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.547482 22576 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.536676 26965 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.548609 26856 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.549365 26820 raft_consensus.cc:3055] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:00.549165 26856 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.549787 26820 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:00.550207 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:00.550688 26820 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.551324 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:00.551966 22574 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:00.552876 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.553956 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.555333 22580 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:00.536216 26940 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.558277 22579 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:00.510192 27044 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.526400 22505 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:00.488395 27002 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.510319 26981 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.527500 26855 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.528717 26731 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.488744 26936 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.495697 26526 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.500597 27045 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.536654 26955 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:00.560117 22574 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:00.539206 22575 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:00.596438 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 97023.5us
I20260709 13:08:00.597241 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:00.597651 22575 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:00.564970 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:00.544848 22578 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:00.581602 22576 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:00.558560 26978 raft_consensus.cc:3055] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:00.599321 26978 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:00.599475 22399 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.590101 23106 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:00.552187 26820 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.601431 26918 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.601701 26843 raft_consensus.cc:2764] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:00.602165 27000 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.544332 26949 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:00.593954 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 89955.5us
I20260709 13:08:00.600849 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.541971 26604 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.607719 22399 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.593016 27045 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.584878 27003 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:08:00.627645 26731 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.629654 26856 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:00.630316 27045 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.613592 26862 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.634148 27002 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.637615 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:00.600337 26978 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.639569 26978 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.641386 22506 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:00.644089 26526 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:00.646756 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:00.649669 22399 leader_election.cc:400] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10.
I20260709 13:08:00.650580 22399 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.657414 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.612821 22545 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.610074 26765 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.621016 26936 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.623786 26955 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:00.660712 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 149777us
I20260709 13:08:00.629560 26604 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:00.665403 22546 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:00.665392 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.666550 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 85441.6us
I20260709 13:08:00.667973 26632 raft_consensus.cc:3055] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:00.668363 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 55621.3us
I20260709 13:08:00.674645 26870 consensus_queue.cc:260] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.675814 26870 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.676904 26926 raft_consensus.cc:3055] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:00.677336 26926 raft_consensus.cc:740] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:00.678170 26926 consensus_queue.cc:260] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.679401 26926 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.668406 26632 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:00.681169 26632 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.682603 26632 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.682853 22547 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:00.684736 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:00.685590 22505 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.686321 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.687565 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:00.688069 22502 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.691326 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:00.691979 22500 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.693674 22429 consensus_queue.cc:237] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.658788 26862 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.657243 26933 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.703019 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:00.703998 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:00.704891 22545 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:00.700016 22426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34614 (request call id 560) took 1412 ms. Trace:
I20260709 13:08:00.700429 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:00.705819 22508 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.704288 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:00.699893 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.707424 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:00.705610 22426 rpcz_store.cc:276] 0709 13:07:59.287415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.392861 (+105446us) service_pool.cc:224] Handling call
0709 13:07:59.419570 (+ 26709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.565237 (+145667us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:59.609070 (+ 43833us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.894577 (+285507us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b1800181720. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b 00007f006c9c1d23 00007f006c9c223a 00007f006ce2ca2a
0709 13:08:00.094726 (+200149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.094776 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:00.094817 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.522556 (+427739us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800181720. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:08:00.699799 (+177243us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540043ab54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:08:00.699843 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.699964 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2656,"prepare.queue_time_us":29867,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2873,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6696,"spinlock_wait_cycles":367520256,"thread_start_us":197069,"threads_started":1,"wal-append.queue_time_us":528685}
I20260709 13:08:00.662569 26526 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.711205 22500 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:00.716260 26256 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:00.716966 26256 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:00.666348 27003 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.714701 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:00.733631 26999 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:00.737380 22508 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:08:00.737112 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:00.710700 26856 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:00.740585 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.718271 26872 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:00.712849 26981 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.702693 26915 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:08:00.746867 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:00.747566 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.759178 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:00.749502 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:00.760944 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.718911 26765 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.755328 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:00.735808 26526 raft_consensus.cc:2764] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:00.771862 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:00.740885 26813 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:00.746327 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.773185 22430 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:00.759824 22579 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.710536 26983 consensus_queue.cc:1059] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:08:00.769320 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:00.769879 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 52600us
I20260709 13:08:00.771580 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.779698 22428 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:00.769188 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.710381 26758 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:08:00.767961 26765 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:00.775986 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:00.782968 22426 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 14.
I20260709 13:08:00.774376 22472 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:00.756457 22502 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:00.742026 26426 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:08:00.778600 26813 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:00.794214 22396 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:00.806962 22582 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:00.816886 22327 catalog_manager.cc:5697] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 7 to 10, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.825351 26919 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:00.825899 26919 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.790928 27002 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:00.830858 27002 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.831328 27002 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.802289 27045 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.835067 27045 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.788607 26855 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:00.787464 26989 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:08:00.786286 26765 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.851502 22327 catalog_manager.cc:5697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 5 to 7, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 7 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.755695 27003 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.853895 22579 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:00.860100 22327 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 3 to 7, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 7 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.864915 22427 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
W20260709 13:08:00.866433 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 72514.9us
I20260709 13:08:00.867501 22396 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:00.873261 22327 catalog_manager.cc:5697] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 5 to 8, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 8 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.874696 22505 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
W20260709 13:08:00.879369 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 174556us
I20260709 13:08:00.881313 26426 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:00.881719 22396 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:00.883402 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:00.876386 26357 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:00.892670 27001 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:00.898258 26919 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.861590 27003 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.907238 22327 catalog_manager.cc:5697] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 7 to 9, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 9 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.911850 22501 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:00.912988 22507 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:00.884435 26426 raft_consensus.cc:697] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:00.927013 22327 catalog_manager.cc:5697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 6 to 11, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.912367 26746 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:00.914703 26974 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.925273 26999 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:08:00.937258 23105 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:00.920816 27001 raft_consensus.cc:697] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:00.940675 22327 catalog_manager.cc:5697] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 5 to 7, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 7 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.941133 27001 consensus_queue.cc:237] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.926256 26907 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:08:00.931810 26746 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:00.878624 26813 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.915011 26357 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:00.959657 26999 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:08:00.958488 26917 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:00.981851 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:00.984795 22327 catalog_manager.cc:5697] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 5 to 8, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 8 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:00.986490 22327 catalog_manager.cc:5697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 5 to 6, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 6 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.988687 26426 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:00.996905 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:00.997289 26765 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:00.999544 26836 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:00.999946 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55062 (request call id 574) took 1449 ms. Trace:
I20260709 13:08:01.004739 22502 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.968693 26813 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:01.006662 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 269631us
I20260709 13:08:00.988281 22327 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 5 to 7, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 7 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:01.010583 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:01.011240 22327 catalog_manager.cc:5697] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 7 to 10, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.000382 22573 rpcz_store.cc:276] 0709 13:07:59.550909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.642416 (+ 91507us) service_pool.cc:224] Handling call
0709 13:07:59.642779 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.419589 (+776810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.419619 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.420040 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.566450 (+146410us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:00.734680 (+168230us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.999598 (+264918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.999683 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.999726 (+    43us) raft_consensus.cc:1685] finished
0709 13:08:00.999736 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.999880 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1046322,"prepare.queue_time_us":58736,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":1093277,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":12750,"thread_start_us":289897,"threads_started":2,"wal-append.queue_time_us":196648}
I20260709 13:08:01.012550 26765 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:01.049868 22502 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
W20260709 13:08:01.056619 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.058947 23105 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:01.060690 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:00.988792 26926 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:01.000118 26836 raft_consensus.cc:697] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:01.053295 23076 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:08:01.071283 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 190968us
W20260709 13:08:01.072053 27069 log.cc:927] Time spent T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:01.073174 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:01.074373 22545 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:01.075583 22545 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:01.076709 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:01.077214 26820 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:01.078581 26820 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.079140 26820 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.079317 22545 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:01.080430 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:01.081893 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:01.082129 26256 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.082581 26256 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.082868 26526 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:01.083529 26526 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.084425 26256 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:01.086805 23077 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:01.090384 22472 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:01.107682 22472 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:00.976857 26917 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.110126 26936 raft_consensus.cc:2764] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:01.104334 27045 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:01.105120 26909 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.034523 27056 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:01.115891 22433 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:01.034197 26872 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:01.114907 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:01.120811 22431 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:08:01.070370 26765 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:01.125488 22426 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.084913 27055 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:01.098645 26763 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:01.104933 26855 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:01.116833 26949 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:01.114761 27045 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.108896 26918 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:01.147970 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:01.150213 27056 raft_consensus.cc:697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:01.155469 22431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51866 (request call id 2623) took 1015 ms. Trace:
I20260709 13:08:01.124836 26843 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.024147 26746 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:01.171663 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.149986 26981 raft_consensus.cc:3055] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:01.172019 22431 rpcz_store.cc:276] 0709 13:08:00.139837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.153990 (+ 14153us) service_pool.cc:224] Handling call
0709 13:08:01.155282 (+1001292us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54000d6954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:08:01.155400 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2172743552}
I20260709 13:08:01.149900 26526 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:01.132957 26983 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.060779 26357 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.142264 26765 raft_consensus.cc:697] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:08:01.195943 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.159698 26763 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:01.140352 26855 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.192838 22508 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:08:01.183432 26981 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:08:01.195163 27061 log.cc:927] Time spent T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:08:01.141597 26919 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:01.169785 26769 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.100556 26926 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.221591 22426 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:01.186885 26929 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:01.186427 26603 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:01.183251 26888 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:08:01.236461 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 226013us
I20260709 13:08:01.182502 26918 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.184231 26426 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:08:01.210777 26855 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.242101 22546 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:01.236927 23107 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:01.194519 26875 consensus_queue.cc:1059] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:01.243875 22327 catalog_manager.cc:5697] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 6 to 7, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 7 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.252235 22474 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:01.241582 26603 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.255538 26853 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:01.255939 26853 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.256771 26603 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:01.257756 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:01.258648 27076 log.cc:927] Time spent T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
I20260709 13:08:01.258380 22327 catalog_manager.cc:5697] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 3 to 4, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 4 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.259490 22429 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.256309 26853 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.260136 22327 catalog_manager.cc:5697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 5 to 8, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 8 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.266762 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:01.269049 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:01.270304 26763 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.273097 26875 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:01.273569 26875 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:01.274369 26875 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.260728 26919 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:01.275528 26875 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.275908 26919 raft_consensus.cc:697] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:08:01.277225 27072 log.cc:927] Time spent T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:01.278442 26765 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:01.281034 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.281437 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:08:01.282024 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.281900 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:01.283082 27074 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:08:01.200176 26836 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.285503 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.286123 22575 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:08:01.287585 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.288857 26918 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:01.289160 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.283138 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:01.289814 22575 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:08:01.290144 22430 raft_consensus.cc:2410] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:01.291085 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.269138 26981 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.292685 26981 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.292810 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.235873 26769 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.293533 22575 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:08:01.294961 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.295897 22575 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:01.242075 26929 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.229440 26872 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.299104 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:01.276794 26919 consensus_queue.cc:237] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.301522 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:08:01.289425 27073 log.cc:927] Time spent T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:01.303417 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:01.303337 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:01.305004 23107 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:01.305457 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:01.305820 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.305984 22433 raft_consensus.cc:3055] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:01.306368 22433 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:01.304068 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:01.306737 22398 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:01.247606 27002 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.331044 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:01.331866 22425 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:01.305142 22575 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:01.310084 22433 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.307900 22426 raft_consensus.cc:2393] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 13: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:08:01.333178 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 251324us
I20260709 13:08:01.346354 22433 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.342648 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:01.249584 27056 consensus_queue.cc:237] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.351920 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:01.352823 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:01.353561 22426 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:08:01.354020 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:01.307019 27066 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.341921 26974 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.361334 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:01.362287 22501 raft_consensus.cc:2368] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13.
I20260709 13:08:01.364919 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.367048 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:01.367785 22505 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.355192 26813 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:01.354228 26929 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:01.378319 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.378574 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.379006 22577 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:01.383102 22399 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:01.359817 26974 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:01.389324 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:01.390703 22575 raft_consensus.cc:2393] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 10: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:01.394779 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:01.395658 22545 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:01.396803 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.398119 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:01.400969 22503 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:01.453177 22503 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:01.396274 22505 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:01.399258 26974 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.404659 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.458329 22580 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:01.458915 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:01.390098 26918 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:01.457098 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:01.377840 26813 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:01.376962 27045 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:01.461505 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 65944.2us
I20260709 13:08:01.456115 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.465148 22581 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.466758 22576 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:01.466837 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:01.469233 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:01.470257 22573 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:01.472896 22545 leader_election.cc:400] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13.
I20260709 13:08:01.473251 22545 leader_election.cc:403] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:01.473660 22577 raft_consensus.cc:2393] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 9: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:01.391446 26758 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:08:01.475627 22575 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:08:01.470293 26813 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.478731 26983 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13.
I20260709 13:08:01.481132 27002 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:01.476328 22545 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:01.481884 26836 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:01.521255 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45001.7us
I20260709 13:08:01.521554 26836 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:01.521972 26836 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:01.521885 26983 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:01.523175 26983 raft_consensus.cc:697] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:01.523006 26836 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.470337 26843 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.486408 26853 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.497190 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:01.537088 22426 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.506502 26917 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:01.512867 22575 pending_rounds.cc:85] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 11
I20260709 13:08:01.524168 26983 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.539064 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:01.503509 26855 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.524291 26836 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.452277 26765 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:08:01.543015 22575 pending_rounds.cc:107] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:08:01.554610 22575 raft_consensus.cc:2889] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.553429 22426 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:08:01.555217 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:01.555902 22579 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 16.
I20260709 13:08:01.557106 22499 raft_consensus.cc:1240] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.562849 22502 raft_consensus.cc:2368] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8.
I20260709 13:08:01.563588 22578 raft_consensus.cc:1240] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:01.571339 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 160450us
I20260709 13:08:01.563396 27078 consensus_queue.cc:1059] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:08:01.580037 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:01.586018 27086 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:08:01.593251 23107 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:01.618435 22433 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
W20260709 13:08:01.635074 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.572503 27083 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:08:01.641209 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:01.646741 22431 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:01.647588 22500 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:01.654784 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:01.668906 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:01.669786 22500 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:08:01.601159 26888 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:08:01.648910 26426 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:01.688839 26990 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:01.705125 26990 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.707445 26990 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:01.679019 26357 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:01.709286 26357 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.712143 26357 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:01.713165 26915 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:01.713550 22433 raft_consensus.cc:1240] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:01.715474 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:08:01.718443 26949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.065s	sys 0.086s
I20260709 13:08:01.730589 22506 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:01.741986 27090 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
W20260709 13:08:01.730144 26949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.065s	sys 0.086s
I20260709 13:08:01.718557 26426 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.719046 26765 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:08:01.784653 26855 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:01.789664 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 64694.3us
I20260709 13:08:01.793654 22396 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:01.775760 26949 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:01.798830 22396 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:01.801824 26989 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:01.803284 26862 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.803743 26862 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.805722 26862 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.809856 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:01.810571 22508 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:08:01.813339 26989 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.813911 26989 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.817137 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:01.818020 22507 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:01.847246 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:01.847940 22508 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:08:01.851132 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:01.798475 26731 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:08:01.834235 26426 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:01.851678 27094 log.cc:927] Time spent T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:08:01.864987 26907 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:01.868968 26875 consensus_meta.cc:287] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.593s	user 0.012s	sys 0.000s
I20260709 13:08:01.876618 23113 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:01.878674 27092 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:01.873886 26907 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:01.872628 26813 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:01.906420 27102 log.cc:927] Time spent T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:08:01.897680 26907 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.918609 22582 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.920312 22427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:01.873472 26949 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.925251 26955 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.911964 26974 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.936340 26974 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:01.915828 27092 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:01.943943 26769 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:01.942039 27103 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:08:01.944936 27092 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:01.957902 27092 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:01.955154 22578 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:08:01.963440 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:01.965449 22582 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:01.980743 26813 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:01.976962 26913 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.982899 26913 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.985085 26913 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:01.984714 26731 raft_consensus.cc:2955] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:01.994282 26989 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.997553 26862 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:01.999779 26862 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:01.992126 26907 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.000999 27003 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.004128 27002 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:02.004664 27002 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:02.005504 27002 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.010922 27080 raft_consensus.cc:3055] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.011523 27080 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:01.997062 26989 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.013504 27002 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:02.012377 27080 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.015026 27080 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:02.015071 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.015918 23079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.016628 26763 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.017119 26763 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:02.018757 27108 log.cc:927] Time spent T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:08:02.019354 26763 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.006263 26731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51860 (request call id 82) took 3882 ms. Trace:
I20260709 13:08:02.022541 23079 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.022526 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:02.022006 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.025053 23108 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:02.025429 26926 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.022966 26907 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.025607 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.024966 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.023718 23105 raft_consensus.cc:2955] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:02.028992 26763 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.029526 26763 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.027438 26853 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.033977 26763 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.034310 23106 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:02.038328 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:02.040009 26763 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.041313 26926 raft_consensus.cc:2764] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:02.046083 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.047068 23105 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:08:02.047077 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:08:02.051893 27084 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.488s	user 0.002s	sys 0.002s
W20260709 13:08:02.092387 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.096764 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.024555 26731 rpcz_store.cc:276] 0709 13:07:58.123448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.125374 (+  1926us) service_pool.cc:224] Handling call
0709 13:07:59.884415 (+1759041us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001d95a0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006cd9f520 00007f006ce28b42 00007f006ce27800 00007f006ce209fa 00007f0071de84c9 00007f006b364c54 00007f006b364be2 00007f006b364b11 00007f006b364a8c 00007f006b363d42
0709 13:08:00.027187 (+142772us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b18000c2fa0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce5d73d 00007f006ce28f3f 00007f006ce286b3 00007f006ce209fa 00007f0071de84c9 00007f006b364c54 00007f006b364be2 00007f006b364b11 00007f006b364a8c 00007f006b363d42
0709 13:08:00.693037 (+665850us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b58004523d0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006cd7e0aa 00007f006ce00447 00007f006ce1d70a 00007f006ce1e76a 00007f006ce1d91b 00007f006ce2903c 00007f006ce286b3 00007f006ce209fa 00007f0071de84c9 00007f006b364c54
0709 13:08:00.709351 (+ 16314us) log.cc:844] Serialized 494 byte log entry
0709 13:08:02.006152 (+1296801us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5400,"raft.queue_time_us":4084,"raft.run_cpu_time_us":1328,"raft.run_wall_time_us":3077,"spinlock_wait_cycles":1832599936,"thread_start_us":215066,"threads_started":1,"wal-append.queue_time_us":252472}
I20260709 13:08:02.114782 26853 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:02.116201 26843 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:02.114779 26820 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:02.096765 22427 raft_consensus.cc:606] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:02.117553 22427 raft_consensus.cc:614] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:02.116237 26853 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.120702 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:02.123196 26919 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:02.124123 26919 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.125627 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.127750 26919 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:02.133353 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:02.134356 22502 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.137311 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.138062 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:02.138911 22546 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:02.141669 22573 raft_consensus.cc:1240] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.138926 22508 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.145211 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:02.145458 26843 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.146338 22506 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.153462 26843 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:02.165844 22507 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:02.167330 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee6d9e2f597948e7b4670b3606ebf448 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:02.168782 26872 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.117842 26820 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.173224 26820 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.176316 22506 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:02.179184 23105 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:02.187027 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.188215 22582 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:08:02.189947 23076 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:02.191195 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.192755 26763 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.193800 26763 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.195783 22474 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.196827 26926 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.203043 22508 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:02.198328 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:02.216863 26989 raft_consensus.cc:2955] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:02.225196 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.228451 26763 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:02.230938 22545 leader_election.cc:400] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8.
I20260709 13:08:02.233614 27057 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.234687 22582 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:02.234535 27057 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.237357 27057 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.216248 26853 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.250762 22398 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:02.252250 26918 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.253278 26918 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.255575 27003 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:02.255998 26918 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:02.256739 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 58612.5us
I20260709 13:08:02.257094 27080 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.257661 27080 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:02.258153 27080 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:02.258899 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63373.8us
I20260709 13:08:02.259521 26872 consensus_queue.cc:1059] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:02.260622 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:02.260747 26853 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:02.264721 27066 consensus_queue.cc:1059] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:08:02.270586 26820 raft_consensus.cc:3055] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:02.271054 26820 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:02.261165 26919 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:08:02.272261 26820 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.273172 26919 consensus_queue.cc:1243] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer e32ba8e6132b4f8e98a99066b6fffe05 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:02.273468 26820 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.273878 27078 raft_consensus.cc:3055] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:02.274386 27078 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:02.261857 26872 raft_consensus.cc:3055] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:02.275287 26872 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:02.284886 22508 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:02.286309 22504 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:02.276055 27078 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.285956 26872 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.288935 27078 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.289723 22499 raft_consensus.cc:2393] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 8: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:02.288853 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.277802 22398 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:02.282558 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:02.291446 22582 raft_consensus.cc:2393] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:02.291647 22428 raft_consensus.cc:2368] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:02.283821 22427 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.292315 26926 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:02.284356 22506 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:02.293107 26926 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.259971 22474 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.279925 27080 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.295974 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:02.289316 26872 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.295761 26926 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:02.256160 27003 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:02.205857 26843 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:02.274356 22502 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:02.303831 23105 raft_consensus.cc:2955] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:02.319823 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.314297 27003 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.312563 26853 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.327090 23106 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:02.320844 22425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51866 (request call id 2644) took 1019 ms. Trace:
I20260709 13:08:02.331171 26731 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:08:02.332749 22582 raft_consensus.cc:2393] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:02.333441 26949 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:02.334527 23079 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.340392 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:02.334087 26949 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:02.320844 26843 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.343443 26926 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.330294 26907 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:02.352310 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.353505 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:02.354745 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 77126.1us
I20260709 13:08:02.355608 22398 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:02.357249 26918 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:02.357774 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:02.360291 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.357776 26918 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:02.365824 26918 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:02.369019 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 73185.9us
I20260709 13:08:02.368728 22575 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:02.347728 26949 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.373504 26998 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.373852 26843 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:02.385433 22396 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:02.385365 26998 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.394951 26998 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.330317 22425 rpcz_store.cc:276] 0709 13:08:01.297470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.332562 (+ 35092us) service_pool.cc:224] Handling call
0709 13:08:01.347690 (+ 15128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.348060 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.348089 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.089914 (+741825us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b2c00000f48. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:08:02.140064 (+ 50150us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.202769 (+ 62705us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:02.204926 (+  2157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.211278 (+  6352us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.306844 (+ 95566us) raft_consensus.cc:1685] finished
0709 13:08:02.306862 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.316612 (+  9750us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":400,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6928,"spinlock_wait_cycles":4911488,"thread_start_us":62200,"threads_started":1,"wal-append.queue_time_us":157154}
I20260709 13:08:02.404675 27057 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:02.405401 27057 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.408700 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.410470 22474 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.381469 27080 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.415781 27003 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.385521 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:02.421828 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 106998us
W20260709 13:08:02.429735 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 110851us
I20260709 13:08:02.430526 27002 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.430560 27083 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.431447 26731 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:02.432242 22581 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:02.432910 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.433447 22580 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:02.437553 22575 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:08:02.455045 26731 raft_consensus.cc:697] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:02.456395 26731 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.457547 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.459527 27057 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.450331 26926 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.460741 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:02.461820 26907 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:02.462163 26765 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:02.462971 26757 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:02.463666 26998 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:02.464174 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.462385 26907 raft_consensus.cc:697] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:02.464846 23106 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:02.449036 27002 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:02.465723 26907 consensus_queue.cc:237] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.466426 27002 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.463276 22396 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:02.468343 26763 consensus_queue.cc:1059] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:02.469842 26763 raft_consensus.cc:3055] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.470202 26763 raft_consensus.cc:740] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:02.470763 26746 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:02.471449 26746 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:02.471626 26763 consensus_queue.cc:260] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.472591 26746 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.473532 26763 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.483726 22575 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.484944 27083 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:02.486090 27083 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.489533 27083 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.491672 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:02.492422 22425 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:08:02.495898 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:02.496539 22425 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:08:02.498867 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:02.499498 22474 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.499883 22425 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:02.501165 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.501572 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.504163 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.505506 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.506027 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:02.506784 22574 raft_consensus.cc:2393] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:02.507367 22579 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:02.470122 22582 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 7.
W20260709 13:08:02.512024 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.507579 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 44439us
W20260709 13:08:02.519001 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 76066.5us
I20260709 13:08:02.523034 23079 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.532684 26998 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.533444 26998 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.535828 26998 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.501217 27057 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.540187 22428 raft_consensus.cc:1240] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:02.539932 26929 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:02.440040 26949 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.519695 27083 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:02.565897 22576 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:02.569923 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 70590.2us
I20260709 13:08:02.581005 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.589275 27080 consensus_queue.cc:1059] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:08:02.563369 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:02.592383 22398 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:02.565070 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:02.563046 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:02.598193 22579 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.600977 27067 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:02.601802 27067 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.602316 27067 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.605993 23077 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:02.607072 22575 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:02.549953 26870 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
W20260709 13:08:02.644335 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.652319 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.613886 23079 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:02.615540 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:02.577426 26929 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:08:02.619328 22574 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:02.625686 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:02.634421 22579 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:02.640815 27003 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.606228 22427 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:08:02.654125 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.654522 22507 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:02.660250 22474 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:02.657868 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 60559us
I20260709 13:08:02.588819 22546 leader_election.cc:400] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:02.663817 22546 leader_election.cc:403] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:02.672173 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:02.672400 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:02.672945 22427 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:02.673862 27057 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.674369 22547 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.676748 26897 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.677347 26897 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.678361 22424 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:02.678889 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:02.679574 26897 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.679576 22430 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
W20260709 13:08:02.681632 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 67930.1us
I20260709 13:08:02.646782 26949 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.692787 22427 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
W20260709 13:08:02.692907 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 104264us
I20260709 13:08:02.694079 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:02.696282 22424 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:02.577000 27083 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.701630 23107 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:02.703398 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:02.704522 26843 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.704737 26949 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:02.705426 26949 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.707521 26926 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:02.708041 26926 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.708408 26926 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:02.708667 26897 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:02.709012 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.709673 23107 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:02.707513 26949 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.711923 22473 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:02.712739 27057 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:02.712934 27107 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.005s
I20260709 13:08:02.713905 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:02.704694 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:02.714601 26843 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.720907 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.722484 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:02.704550 26853 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.729573 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:02.732820 27067 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:02.732591 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 58373.4us
I20260709 13:08:02.734349 23109 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:02.735468 27067 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.735760 22547 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.714955 27057 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:02.736802 27057 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.742682 27003 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:02.743399 27003 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.744688 22428 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:02.745311 26897 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.720907 26843 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.746959 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:02.747912 26919 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:02.748448 26820 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:02.749614 26919 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.749969 26820 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:02.750263 22398 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:02.750563 27083 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.750025 26919 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:02.751227 26919 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.751636 26758 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:02.753320 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 112868us
I20260709 13:08:02.754845 26758 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:02.755406 26758 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:02.756734 27080 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:02.757433 27001 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:02.757939 22399 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:02.758551 22547 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.759318 27080 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.732985 26853 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.760555 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:02.761168 23106 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.761972 26853 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.767727 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.768514 23105 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:02.771073 22399 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:02.771067 26862 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:02.771670 26763 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.772060 26763 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:02.755352 22474 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.771584 22473 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:02.755906 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.791754 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.792608 22579 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:02.748862 26929 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:02.758278 26872 raft_consensus.cc:3055] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.799045 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.759538 27001 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.799089 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:02.802176 22499 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:02.802034 22474 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.777552 22580 raft_consensus.cc:2955] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:02.796082 23106 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:08:02.805214 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.803442 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.808120 22398 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:02.800278 26929 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.801954 26757 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:02.801424 27083 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.772934 26763 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.811879 27001 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.809223 27078 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:02.809464 27080 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.803612 26872 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:02.805706 27067 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.774942 27002 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.810472 26853 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.821605 27001 raft_consensus.cc:697] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:02.811347 26929 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.851244 23110 raft_consensus.cc:1240] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:08:02.845306 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46207.1us
I20260709 13:08:02.847247 22547 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.812343 26949 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.857582 22424 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:08:02.778170 26758 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.868187 22474 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.851218 26853 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:02.872810 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 58500.5us
I20260709 13:08:02.876120 22503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "634877efa82d48ea9055feb74030391f"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:08:02.877019 22474 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.877801 27083 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:02.878520 22474 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.879012 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:02.880115 22577 raft_consensus.cc:2410] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:08:02.880998 27001 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.877137 23108 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:02.880019 22474 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:02.892374 26907 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:02.869813 27078 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.895303 27078 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:02.896863 26872 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.898268 26872 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.901117 26949 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.901208 26955 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.901654 26929 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.906934 27057 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.908277 22505 raft_consensus.cc:1240] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.910472 27002 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:02.854933 27067 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:02.868984 26820 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:02.875680 26853 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.870221 27066 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.882694 26763 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.911959 27080 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:02.911770 26820 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.950928 22425 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:02.952064 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 72138.3us
I20260709 13:08:02.922305 26926 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:02.963325 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:02.972575 23109 raft_consensus.cc:2368] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8.
I20260709 13:08:03.003641 26746 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:03.006122 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:03.007970 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 159705us
I20260709 13:08:02.949000 26765 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:02.973605 27083 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.965234 26998 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:08:03.017928 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 412159us
I20260709 13:08:03.019268 23077 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:03.020653 27067 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:03.022377 26926 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:03.023025 26926 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:03.023396 26926 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.023703 26926 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.979410 27057 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:03.024998 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:03.026476 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:03.027380 22474 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:03.029305 26955 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:03.029812 26955 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:03.030766 26955 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.040629 27003 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:03.008191 27066 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:03.042353 27066 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.046294 26929 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:03.049233 26843 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.051678 26843 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:03.054339 27083 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:03.015300 26907 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:03.055509 26907 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.055635 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:03.015170 26731 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:08:02.961743 27080 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:03.057981 27137 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:08:03.059451 27080 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:03.014914 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:03.054929 27083 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:03.066524 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 57656.9us
I20260709 13:08:03.066731 22503 raft_consensus.cc:606] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:03.067188 22503 raft_consensus.cc:614] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:03.071655 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:08:03.072835 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 181956us
I20260709 13:08:03.072393 22580 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:02.974438 27002 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
W20260709 13:08:03.044351 27135 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.135s	user 0.003s	sys 0.000s
I20260709 13:08:03.082499 22473 leader_election.cc:400] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8.
I20260709 13:08:03.082894 22473 leader_election.cc:403] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:03.055001 26820 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:03.065747 26907 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.090746 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.089389 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:03.094992 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:03.087044 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:03.097463 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:03.072808 27057 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:03.079603 26949 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:03.073348 26998 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.096715 22506 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:08:03.106786 27066 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:03.132596 26989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51860 (request call id 83) took 3241 ms. Trace:
I20260709 13:08:03.114229 26765 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.134460 27078 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.124751 27142 raft_consensus.cc:3060] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:03.137146 22502 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:03.078431 27080 consensus_queue.cc:1059] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:08:03.075616 26919 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.082837 26843 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:03.139937 22580 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:08:03.155925 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:03.166546 22501 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.167318 22576 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:03.107692 26820 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:08:03.183257 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 48094.3us
I20260709 13:08:03.186276 22499 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:03.187480 22573 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:03.140097 26949 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:08:03.184355 27144 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:08:03.201467 22575 raft_consensus.cc:2955] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:03.204373 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:03.149408 26989 rpcz_store.cc:276] 0709 13:07:59.865121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.865256 (+   135us) service_pool.cc:224] Handling call
0709 13:07:59.906149 (+ 40893us) log.cc:844] Serialized 494 byte log entry
0709 13:08:03.106474 (+3200325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1082,"raft.run_cpu_time_us":1230,"raft.run_wall_time_us":1229,"thread_start_us":218727,"threads_started":1,"wal-append.queue_time_us":219924,"wal-append.run_cpu_time_us":1824,"wal-append.run_wall_time_us":1004147}
I20260709 13:08:03.214380 26989 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:03.215131 26989 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.216071 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:03.216715 22425 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.219033 26926 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.195593 26872 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.223055 26872 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.214227 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.225215 26872 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:03.179487 26853 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.227620 22425 raft_consensus.cc:2468] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:08:03.228045 26853 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:03.229069 26949 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.237860 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:03.238957 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.177142 27078 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.183506 26998 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.248438 22505 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:03.235177 27080 raft_consensus.cc:3055] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:03.276794 26926 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:03.277572 27083 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.200609 26765 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.279052 26989 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:03.279634 27153 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.285760 22506 raft_consensus.cc:2410] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:03.196628 26820 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.286150 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.294303 22501 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:08:03.203346 26843 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:03.289371 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.298228 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:03.312279 22507 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:03.312305 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.287595 27080 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:03.276340 26998 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:03.339036 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 260146us
I20260709 13:08:03.309626 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:03.340080 22425 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.335266 22505 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:03.336647 22501 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:03.298746 23077 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:03.344650 22504 raft_consensus.cc:2393] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 9: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:08:03.345363 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 46663.6us
I20260709 13:08:03.355881 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.294327 26870 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:08:03.359383 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:03.370935 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:03.377123 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:03.377748 23108 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.382750 22581 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:03.360011 27003 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:03.394420 23076 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:03.394639 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.402038 22425 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:03.345073 27153 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.373790 27066 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.435757 23108 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:03.438059 22504 raft_consensus.cc:2393] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:03.445726 22578 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:03.448028 27150 consensus_queue.cc:1059] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:08:03.449096 27150 raft_consensus.cc:3055] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:03.449535 27150 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:03.450635 27150 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.451921 27150 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:03.452248 26763 consensus_meta.cc:287] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.000s
I20260709 13:08:03.461527 27153 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:03.463358 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 396022us
W20260709 13:08:03.453202 27151 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:03.456565 27154 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.449417 22473 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:03.460247 26843 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:03.422626 27159 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:03.513073 26853 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:03.513741 26853 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:03.514676 26853 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.481129 22507 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:03.462033 26820 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:03.391080 26919 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:03.424597 27148 raft_consensus.cc:2804] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:03.517508 27148 raft_consensus.cc:697] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:03.518452 27148 consensus_queue.cc:237] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.422399 26929 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.523016 22507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:08:03.523685 22507 raft_consensus.cc:606] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:03.524062 22507 raft_consensus.cc:614] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:03.503582 22396 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:03.423705 27083 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:03.525281 27153 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:03.525660 27153 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.525995 27153 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.428910 27142 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8.
I20260709 13:08:03.528600 26862 consensus_queue.cc:1059] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:03.462082 27149 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:08:03.530254 27067 raft_consensus.cc:3055] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:03.530639 27067 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:03.531647 26929 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:03.531468 27067 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.534679 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:08:03.529107 22499 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:08:03.475852 26907 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.540700 22503 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:08:03.510380 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 61075us
I20260709 13:08:03.539067 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.548787 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:03.547812 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 151276us
I20260709 13:08:03.397071 27080 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.554669 23076 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:03.556218 22503 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:03.559065 22508 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:03.559919 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.560382 22508 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 15.
I20260709 13:08:03.551733 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.582998 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.585691 22503 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:03.603552 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:03.606276 22474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.606681 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.606122 22505 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:03.535570 27066 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.631048 27066 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:03.633411 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.584169 27067 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.624716 27177 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.582494 26929 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:03.590755 26765 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:03.552621 27154 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.577203 27078 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:03.635586 22508 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:03.639096 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:03.607398 22504 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:03.659034 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:03.624883 27169 log.cc:927] Time spent T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:08:03.662190 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:03.667790 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.669397 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:03.670259 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:03.674688 22574 raft_consensus.cc:2368] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8.
I20260709 13:08:03.665457 26929 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:03.680915 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.687893 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:03.693528 22505 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.693724 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:03.694289 27167 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:08:03.696085 27157 log.cc:927] Time spent T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
W20260709 13:08:03.704133 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.716920 26929 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.718632 27080 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.706099 23079 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:03.708371 26907 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:03.660005 27177 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.720822 27174 raft_consensus.cc:2804] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:03.721364 27174 raft_consensus.cc:697] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:03.722491 27177 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:03.722596 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:03.723038 27153 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.722257 27174 consensus_queue.cc:237] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:03.722250 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:03.725373 27153 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:03.724299 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:03.726260 23109 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 15: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:03.726132 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:03.727262 23113 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:03.734735 22573 raft_consensus.cc:2410] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
W20260709 13:08:03.747331 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.771063 23109 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.774390 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.775969 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:03.778791 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:03.779441 23109 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.783041 27154 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:03.783635 27154 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:03.784157 27154 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.784896 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:03.786398 27154 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:03.788618 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.790279 22576 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:03.790892 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:03.791320 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:03.791750 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:03.792466 22428 raft_consensus.cc:2368] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9.
I20260709 13:08:03.789328 22508 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:08:03.793749 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:03.795331 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:03.796066 22425 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:08:03.790170 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:03.808722 22427 raft_consensus.cc:2410] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:03.812867 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:03.813664 22508 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.815287 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.795007 22472 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:03.823814 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:03.825695 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.835340 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.837349 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:03.839046 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.835696 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:08:03.823398 26955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.001s	sys 0.018s
I20260709 13:08:03.856961 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:03.857281 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:03.895277 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 100353us
I20260709 13:08:03.902218 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:03.917258 22576 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.854300 22503 raft_consensus.cc:2393] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:03.846139 22474 leader_election.cc:400] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 7. Current term is 8.
W20260709 13:08:03.879081 26955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.002s	sys 0.018s
I20260709 13:08:03.907017 22427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:03.921859 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:03.906620 22331 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.835115 26949 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:03.915449 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:03.854604 27083 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:03.916235 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 177230us
I20260709 13:08:03.845551 26853 raft_consensus.cc:2764] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:08:03.844708 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 132568us
W20260709 13:08:03.918215 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 92286.5us
W20260709 13:08:03.920625 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 81729us
I20260709 13:08:03.920725 23109 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:03.855705 27154 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.931821 22508 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:03.927785 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:03.924844 22577 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:03.858595 27176 consensus_queue.cc:1059] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 13:08:03.943205 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 115264us
I20260709 13:08:03.944151 22396 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:03.858428 27155 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:08:03.948979 26862 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:03.949486 26862 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.949837 26862 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.952702 27153 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:03.952854 27154 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:03.955243 27154 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:03.958052 27186 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:03.964408 22431 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:03.981393 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:03.985929 22396 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:03.986953 22396 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:03.990206 22577 raft_consensus.cc:2410] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:03.939224 27177 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:03.995337 27155 consensus_queue.cc:1243] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer e32ba8e6132b4f8e98a99066b6fffe05 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:03.996501 27150 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:03.997989 27150 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:03.998397 27150 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:03.998742 27150 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.003074 26758 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.003545 26758 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.003906 26758 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:04.009554 27156 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.760s	user 0.002s	sys 0.000s
I20260709 13:08:04.010262 27184 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:04.010881 27184 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.011974 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:04.012616 27189 log.cc:927] Time spent T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:08:04.013454 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 2116) took 1401 ms. Trace:
I20260709 13:08:04.013836 22500 rpcz_store.cc:276] 0709 13:08:02.612445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.662757 (+ 50312us) service_pool.cc:224] Handling call
0709 13:08:02.685580 (+ 22823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.727787 (+ 42207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.727826 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.818763 (+ 90937us) log.cc:844] Serialized 26 byte log entry
0709 13:08:03.066580 (+247817us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:03.066617 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.068084 (+  1467us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.008739 (+940655us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:08:04.013026 (+  4287us) raft_consensus.cc:1685] finished
0709 13:08:04.013052 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.013271 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2955,"raft.queue_time_us":24137,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":49866,"spinlock_wait_cycles":9139584,"thread_start_us":182770,"threads_started":1,"wal-append.queue_time_us":393222}
I20260709 13:08:04.015132 22472 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:04.016907 22545 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.018046 27066 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.018831 26949 raft_consensus.cc:2804] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:03.996280 27172 raft_consensus.cc:3055] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:04.020131 27172 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:04.022493 22577 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:04.019362 26949 raft_consensus.cc:697] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:04.025349 26949 consensus_queue.cc:237] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.028559 27163 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.031744 22581 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:08:04.008152 22398 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:04.038128 22576 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:04.036919 22578 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:08:04.013403 27177 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.042855 22581 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:04.064822 22580 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:04.091744 22580 pending_rounds.cc:85] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 8
I20260709 13:08:04.091944 22580 pending_rounds.cc:107] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:04.092270 22580 raft_consensus.cc:2889] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:04.065418 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 57298.1us
W20260709 13:08:04.096143 27187 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:08:04.070032 27163 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:04.084107 27159 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.087584 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:04.116997 22505 raft_consensus.cc:2393] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:04.101843 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:04.042821 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 87126.6us
I20260709 13:08:04.106796 27184 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:04.024330 27172 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.108011 27182 raft_consensus.cc:3055] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:04.109647 22427 raft_consensus.cc:606] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:04.120456 22398 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:08:04.110143 27183 log.cc:927] Time spent T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.442s	user 0.003s	sys 0.002s
I20260709 13:08:04.131451 23109 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:08:04.090107 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 161539us
I20260709 13:08:04.118187 22575 raft_consensus.cc:1813] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Handling vote request from an unknown peer e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:04.119675 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 132799us
I20260709 13:08:04.123468 26746 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:04.126572 27172 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.123836 22331 catalog_manager.cc:5697] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 13, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 13 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.134717 22575 raft_consensus.cc:2410] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:04.114354 27163 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.136039 27200 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:04.155318 26746 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:04.155864 27200 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.156463 26746 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.159215 27200 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:04.159610 26746 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:04.143666 27163 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.162245 22545 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.166273 27080 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:04.137590 26998 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:04.168720 27184 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.168987 26998 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:04.170013 26918 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.170382 26998 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.171896 26765 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:04.172353 27153 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:04.172964 26918 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:04.174019 26918 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.175412 26918 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.174019 27164 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:08:04.182399 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46788.2us
I20260709 13:08:04.184237 27153 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.187091 27153 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:04.189065 26765 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.191452 26765 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:04.122083 27182 raft_consensus.cc:740] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:04.196998 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:04.201203 23109 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:04.198468 22545 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.197105 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:08:04.199200 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 55786us
I20260709 13:08:04.205613 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:04.206704 22474 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:04.207463 27153 raft_consensus.cc:993] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:04.220278 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.121806 27159 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.228696 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:08:04.194098 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 52670.6us
I20260709 13:08:04.231752 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:04.210467 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.227329 26853 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:04.217783 26843 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.240960 22398 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:04.216619 27153 raft_consensus.cc:1081] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:04.249078 27209 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:04.249845 27209 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.204193 27080 consensus_queue.cc:1059] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:08:04.172794 26757 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:08:04.229485 27154 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.237607 26763 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:04.208907 27184 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:04.240598 27002 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:04.253105 27176 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:04.234499 27142 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:04.155365 27201 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:08:04.273221 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:04.239023 27200 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:04.258432 27083 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.259049 27163 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.260346 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.259620 27154 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.279706 22506 raft_consensus.cc:2468] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:08:04.282115 26746 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:08:04.277230 27002 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.258774 26862 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.275578 26989 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:04.294054 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.260058 27150 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:04.312458 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 55272.6us
I20260709 13:08:04.313230 26907 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:04.314832 26907 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.316660 26897 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:04.292668 27209 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:04.274464 26763 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.320240 27150 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:04.290628 27154 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.323951 27177 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:04.295913 26989 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:04.330634 26989 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.316977 27163 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:04.328251 27182 consensus_queue.cc:260] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:04.338728 27165 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:04.339587 27182 raft_consensus.cc:3060] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:04.340021 27083 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.343528 26862 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:04.277460 26731 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:08:04.291530 26872 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.353751 27202 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:04.354467 27202 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:04.399600 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 105626us
I20260709 13:08:04.400720 22545 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:04.347067 22331 catalog_manager.cc:5697] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 8, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 8 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
W20260709 13:08:04.413316 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 171082us
I20260709 13:08:04.415475 22578 raft_consensus.cc:3060] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:04.417238 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:04.417976 23109 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.419672 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:04.420567 23105 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 15: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:08:04.422664 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 148522us
W20260709 13:08:04.428704 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 113587us
I20260709 13:08:04.432987 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:04.433650 22507 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:08:04.445067 22331 catalog_manager.cc:5697] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 8, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 8 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.448372 22578 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:04.449700 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:04.435889 27142 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:04.435854 27155 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.465489 22331 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.449911 27002 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:04.492058 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 55362.7us
W20260709 13:08:04.488096 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 52351.5us
I20260709 13:08:04.462370 27176 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.498797 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 74967.5us
I20260709 13:08:04.459723 26853 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:04.459611 27218 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:04.501643 22331 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:04.511831 23109 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:04.485150 27202 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:04.488780 26897 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.513252 22396 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:04.490778 27155 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.486356 26907 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:04.489718 26763 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:04.452658 26758 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:04.560186 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47021.1us
I20260709 13:08:04.565701 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.563060 27155 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.519066 27002 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.576807 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:04.577600 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:04.581162 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:04.590101 22579 raft_consensus.cc:2393] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:04.582988 22331 catalog_manager.cc:5697] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 10, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 10 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.583422 27142 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.517148 27218 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.585157 27220 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:04.585640 27224 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:04.519222 27159 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:04.521031 26897 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:04.558560 27083 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:04.598788 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 133293us
I20260709 13:08:04.602938 26897 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.602597 22474 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:04.504537 27176 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.587652 27153 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.637215 22331 catalog_manager.cc:5697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 8, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 8 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.675423 22331 catalog_manager.cc:5697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 10, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:04.675298 22505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:08:04.604632 26757 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.682720 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:04.687830 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 120300us
I20260709 13:08:04.681691 22505 raft_consensus.cc:606] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:04.596455 27002 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.695839 22500 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:08:04.676775 27066 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.682302 22331 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 11, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 11 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:04.689126 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 115759us
I20260709 13:08:04.706660 26758 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:04.707113 22327 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33162 (request call id 246) took 21920 ms (client timeout 15000 ms). Trace:
I20260709 13:08:04.712764 27066 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.694521 26757 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.718465 27002 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:04.719100 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:04.719516 27172 consensus_meta.cc:287] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.009s
I20260709 13:08:04.605448 27224 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.721577 27218 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:04.722656 27221 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:04.692538 27184 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.706554 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:04.725116 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:04.745756 22578 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.724463 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:04.728073 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:04.746631 22508 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:04.741259 22331 catalog_manager.cc:5697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.638782 26853 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.750097 22577 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:04.752117 22577 pending_rounds.cc:85] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:08:04.752532 22577 pending_rounds.cc:107] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:04.752772 22577 raft_consensus.cc:2889] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:04.627986 27220 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.768234 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:04.769066 22431 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:08:04.732023 26998 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:04.770205 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:04.771848 27217 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:04.772676 27212 log.cc:927] Time spent T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:08:04.778478 22331 catalog_manager.cc:5697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 9 to 10, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 10 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.773316 22428 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:04.776444 26757 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:04.777588 27154 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.778477 22546 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.779337 27176 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:04.779966 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:04.780282 27216 log.cc:927] Time spent T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:08:04.776116 26989 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.780776 27230 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:04.781169 27221 raft_consensus.cc:697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:04.781390 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:04.782042 27220 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:04.784431 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 297826us
I20260709 13:08:04.785989 22504 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:04.796118 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:04.772667 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:04.785991 27083 raft_consensus.cc:993] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
W20260709 13:08:04.789106 27211 log.cc:927] Time spent T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:08:04.817768 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:04.817708 22546 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.752161 27184 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.819324 22578 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:04.820272 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:04.802853 27218 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.811832 27222 log.cc:927] Time spent T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:08:04.847057 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:04.846786 22331 catalog_manager.cc:5697] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.837144 27080 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.853406 22546 leader_election.cc:400] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9.
I20260709 13:08:04.819059 22427 raft_consensus.cc:1275] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:04.856284 22499 raft_consensus.cc:1240] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:08:04.857425 22574 raft_consensus.cc:2410] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:04.790134 26897 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:04.849936 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:04.881116 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:04.880873 22546 leader_election.cc:403] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:04.877265 22430 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:04.883181 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.883383 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:04.884231 22431 raft_consensus.cc:2368] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10.
I20260709 13:08:04.884712 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:04.863626 26872 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.889317 22581 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:04.890103 26897 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:04.863641 26929 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:08:04.892802 26843 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 8. Current term is 9.
I20260709 13:08:04.893564 26843 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.896169 22331 catalog_manager.cc:5697] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 10, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 10 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.898578 22331 catalog_manager.cc:5697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 10, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 10 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.873584 22582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:08:04.905014 22582 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:04.905458 22582 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.904816 22331 catalog_manager.cc:5697] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 4 to 6, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 6 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:04.903393 27066 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:04.877460 22398 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:04.889187 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:04.907961 26918 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:04.917099 26918 raft_consensus.cc:697] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:04.803066 26998 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.906463 22331 catalog_manager.cc:5697] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 10, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:04.882303 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:04.921489 23113 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:04.958470 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:04.959275 22574 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:04.918170 26918 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.974987 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:04.975724 22580 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:04.864130 27220 raft_consensus.cc:1081] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:04.980379 22425 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:08:04.982141 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:04.963749 27241 log.cc:927] Time spent T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:04.951982 27066 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:04.975517 22331 catalog_manager.cc:5697] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 8, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 8 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:04.999169 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.005674 22474 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:05.017207 27239 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:08:04.850028 27230 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:04.879257 27218 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.024151 22429 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:05.025581 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.025889 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:05.026542 22432 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:05.026743 22426 raft_consensus.cc:2368] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10.
I20260709 13:08:05.027693 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.029623 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.030431 27224 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:04.726238 22327 rpcz_store.cc:269] 0709 13:07:42.661516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.661786 (+   270us) service_pool.cc:224] Handling call
0709 13:07:42.801136 (+139350us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b54001f1654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8c090 00007f006ce2af3a 00007f0072be11cc 00007f0072cdf37e 00007f00711a02a4 00007f00711a0232 00007f00711a0161 00007f00711a00dc 00007f007119f392 00007f006b15d48c 00007f006b15c8c6
0709 13:08:04.572427 (+21771291us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:01.565063 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:01.675932 (+110869us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:01.680235 (+  4303us) write_op.cc:435] Acquired schema lock
0709 13:08:01.684683 (+  4448us) tablet.cc:662] Decoding operations
0709 13:08:01.739880 (+ 55197us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:01.739936 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:01.739964 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:08:01.741079 (+  1115us) tablet.cc:701] Row locks acquired
0709 13:08:01.741098 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:01.741255 (+   157us) write_op.cc:270] Start()
0709 13:08:01.741379 (+   124us) write_op.cc:276] Timestamp: P: 1783602481741203 usec, L: 0
0709 13:08:01.741401 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:01.742127 (+   726us) log.cc:844] Serialized 5500 byte log entry
0709 13:08:01.943966 (+201839us) op_driver.cc:464] REPLICATION: finished
0709 13:08:02.013481 (+ 69515us) write_op.cc:301] APPLY: starting
0709 13:08:02.013570 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:02.059006 (+ 45436us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:02.059123 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:02.483856 (+424733us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:02.484290 (+   434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:08:02.484358 (+    68us) write_op.cc:312] APPLY: finished
0709 13:08:02.582154 (+ 97796us) log.cc:844] Serialized 129 byte log entry
0709 13:08:02.582447 (+   293us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:02.582895 (+   448us) write_op.cc:454] Released schema lock
0709 13:08:02.582981 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:02.583565 (+   584us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:02.583596 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6966,"reported_tablets":51,"spinlock_wait_cycles":154977152,"child_traces":[["op",{"apply.queue_time_us":69261,"apply.run_cpu_time_us":25967,"apply.run_wall_time_us":570017,"cfile_cache_hit":54,"cfile_cache_hit_bytes":56484,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":5913,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":14,"prepare.queue_time_us":276045,"prepare.run_cpu_time_us":25832,"prepare.run_wall_time_us":270609,"raft.queue_time_us":19952,"raft.run_cpu_time_us":8460,"raft.run_wall_time_us":34435,"replication_time_us":202401,"thread_start_us":292449,"threads_started":4,"wal-append.queue_time_us":125697,"wal-append.run_cpu_time_us":14617,"wal-append.run_wall_time_us":1844236}]]}
I20260709 13:08:04.962643 27225 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.162s
I20260709 13:08:05.035431 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 2148) took 1212 ms. Trace:
I20260709 13:08:05.039479 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.016397 27066 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:05.044214 26989 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.045854 27184 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:05.050173 27182 consensus_meta.cc:287] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.710s	user 0.014s	sys 0.001s
I20260709 13:08:05.052681 27221 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.040791 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.059443 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.035863 22577 rpcz_store.cc:276] 0709 13:08:03.823183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.023237 (+200054us) service_pool.cc:224] Handling call
0709 13:08:04.023515 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.770816 (+747301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.035162 (+264346us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400047754. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:08:05.035366 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665307008}
I20260709 13:08:05.067251 22504 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 15.
I20260709 13:08:05.068363 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.070173 22504 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.028280 22426 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 6.
I20260709 13:08:05.079734 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49184
I20260709 13:08:05.080333 22573 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:05.081319 22573 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.029557 27002 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.090018 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:05.090961 22425 raft_consensus.cc:2410] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:05.086560 22582 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.100399 23105 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:05.117923 22504 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:05.077932 27176 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.133695 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:05.136266 22582 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.138725 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.092111 27002 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.040832 27066 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.106881 27182 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.094983 26746 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:05.148444 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:05.153750 27238 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.080s	user 0.007s	sys 0.003s
W20260709 13:08:05.154282 27240 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.150s	user 0.004s	sys 0.007s
I20260709 13:08:05.173214 26998 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.174328 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.175045 22428 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:05.168294 27182 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.177577 27182 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.179438 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.146238 27176 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.159915 27002 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.168681 26746 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.198736 26746 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:05.199549 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:05.200672 27228 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.100s	user 0.001s	sys 0.008s
I20260709 13:08:05.200902 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.189038 27239 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:08:05.201925 27223 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.443s	user 0.000s	sys 0.010s
I20260709 13:08:05.202250 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:05.201920 27239 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.203536 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:05.209812 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.213387 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.214406 22428 raft_consensus.cc:2410] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:08:05.217022 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:05.219415 26746 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.220036 26746 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.223415 27002 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.220371 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:05.225170 22425 raft_consensus.cc:2368] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:08:05.226075 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.227296 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:05.228994 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.230485 22499 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:05.230791 22425 raft_consensus.cc:2410] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:08:05.222282 26746 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:05.231730 27155 consensus_meta.cc:287] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260709 13:08:05.243532 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.166790 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.244230 22425 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:05.243961 22573 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.212657 27177 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.227528 27176 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.291497 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:05.292403 22425 raft_consensus.cc:2410] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:08:05.281028 22504 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.282148 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.296056 22428 raft_consensus.cc:2410] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:05.277410 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.296247 22573 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.219938 27239 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.295035 23105 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:05.299180 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.314123 23077 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.315994 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:05.294476 27226 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.330164 22472 leader_election.cc:400] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10.
I20260709 13:08:05.330530 22472 leader_election.cc:403] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:05.282459 26926 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:08:05.253428 27155 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.326815 22428 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:05.307340 27237 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.325409 22507 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:05.336059 22507 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:05.291316 27177 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.308897 26897 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.332190 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.333410 23077 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:08:05.329416 27242 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.103s	user 0.009s	sys 0.000s
I20260709 13:08:05.345201 27162 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.344501 27225 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.344655 27239 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10.
I20260709 13:08:05.345898 27225 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.345780 27162 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.344453 23077 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.347711 27159 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:05.348109 27159 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.348455 27159 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.348780 27162 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:05.324131 27248 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:05.334034 26853 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.346307 27225 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.360435 22428 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:08:05.326118 27234 consensus_queue.cc:1048] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:08:05.361100 22428 pending_rounds.cc:85] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 12
I20260709 13:08:05.362146 22428 pending_rounds.cc:107] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:08:05.362799 22428 raft_consensus.cc:2889] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.334206 27142 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:05.336820 27209 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:08:05.356657 27248 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:05.356961 22504 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:05.352823 26897 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:05.387593 27249 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:08:05.409960 27177 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:05.426173 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 96120.3us
I20260709 13:08:05.429034 22472 leader_election.cc:400] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10.
I20260709 13:08:05.430639 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:05.437495 22472 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:05.378840 27219 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.441756 22472 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:05.442536 26853 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:05.443431 27257 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:05.383569 27248 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.449937 22472 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:05.455729 27254 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:05.439150 27142 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.465472 22472 leader_election.cc:400] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11.
I20260709 13:08:05.467397 22472 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:05.453712 27202 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.471851 22472 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:05.481639 27234 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.483604 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.488719 27227 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.493083 22506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 1880) took 1065 ms. Trace:
I20260709 13:08:05.493589 22506 rpcz_store.cc:276] 0709 13:08:04.427493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.427655 (+   162us) service_pool.cc:224] Handling call
0709 13:08:04.437097 (+  9442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.438071 (+   974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.438099 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:04.452977 (+ 14878us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.918486 (+465509us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b18001ea780. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d34c02 00007f006c9bc20b 00007f006c9c1d23 00007f006c9c20d1 00007f006cddda0f
0709 13:08:05.165459 (+246973us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:05.296730 (+131271us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.304420 (+  7690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.304548 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.488205 (+183657us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18001ea780. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d032a6 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1
0709 13:08:05.492824 (+  4619us) raft_consensus.cc:1685] finished
0709 13:08:05.492850 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.493012 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13948,"prepare.queue_time_us":53265,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":26,"raft.queue_time_us":82647,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":7451,"spinlock_wait_cycles":42027008,"thread_start_us":332357,"threads_started":2,"wal-append.queue_time_us":839151}
I20260709 13:08:05.497362 22433 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:05.476825 27224 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.499526 26897 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.500134 22507 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.525141 27154 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:05.478343 27162 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.482344 27234 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.341109 27237 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.480543 27239 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:08:05.555418 27234 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:05.566367 23108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59018 (request call id 895) took 1149 ms. Trace:
I20260709 13:08:05.566810 23108 rpcz_store.cc:276] 0709 13:08:04.416535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.416704 (+   169us) service_pool.cc:224] Handling call
0709 13:08:04.417077 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.462505 (+ 45428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.462534 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:04.774004 (+311470us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b1800172780. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069cafc0a 00007f00733ef219 00007f0070cf658f 00007f0069d35571 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd
0709 13:08:05.385157 (+611153us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b2c00047618. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006b71ba11 00007f006b72b372 00007f006ce5da01 00007f006ce2243a 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2
0709 13:08:05.393824 (+  8667us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.468418 (+ 74594us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:05.468455 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.468548 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.566123 (+ 97575us) raft_consensus.cc:1685] finished
0709 13:08:05.566142 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.566283 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16751,"raft.queue_time_us":29122,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3669,"spinlock_wait_cycles":19425408,"thread_start_us":74160,"threads_started":1,"wal-append.queue_time_us":92766}
I20260709 13:08:05.444662 27219 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.337747 27226 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.571799 27226 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:05.572299 27218 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.485551 27155 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.537256 27078 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.574056 27078 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.553059 27083 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.577674 27083 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.578890 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.579160 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.579807 27083 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:05.580802 27248 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.581995 27237 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.579818 23109 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
W20260709 13:08:05.550416 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 65274us
I20260709 13:08:05.576217 27078 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.587795 22472 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:05.601225 22545 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:05.606899 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.584764 27209 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.586591 27237 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:05.598724 27083 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.609695 27172 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:05.613960 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 135202us
I20260709 13:08:05.607295 27078 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.593634 27248 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.612735 27200 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.624223 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.594612 27225 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.624840 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.633261 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.633268 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.633931 22506 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:05.636340 27002 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:05.638098 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.638463 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:05.630468 27159 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.639036 22429 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:05.639456 22429 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:05.640199 22429 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.641074 22429 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.618261 27083 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.647743 27083 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.619166 27078 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.648691 22424 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:05.648789 27218 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.649302 27218 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.650549 27230 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.651178 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.651440 27218 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.651980 22502 raft_consensus.cc:2393] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:08:05.652889 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.653460 22507 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.614835 27209 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:05.632097 22316 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 06de1406fed544b39bf6d0ab441df770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 7
I20260709 13:08:05.628227 27253 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.653424 27159 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.658859 27209 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.620666 27172 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:08:05.661163 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.661593 27172 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.663961 22396 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.665328 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.674196 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.675374 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.666062 22504 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:05.666565 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.667205 23110 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 13: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:05.678977 22508 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:05.667263 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.667884 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:05.669190 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:05.669530 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.670075 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.655767 27253 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.671011 23105 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:05.671803 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.672879 22429 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:05.678401 22398 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:05.682767 22507 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:05.684710 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.618499 27237 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:05.696552 27251 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.368s	user 0.000s	sys 0.004s
I20260709 13:08:05.697582 26862 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:05.698171 26862 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:05.699091 26862 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.650548 27078 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.711373 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.708698 27177 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.705756 27204 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:05.710063 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.706444 22546 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.689030 26897 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:08:05.711508 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47638.5us
I20260709 13:08:05.712399 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.715811 23112 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:05.701416 27153 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:08:05.705353 27248 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:05.720463 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.720909 26897 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.713420 27220 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:08:05.724366 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.714846 26731 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:05.732925 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.733196 27204 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:05.734387 26897 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.716346 27226 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:08:05.735435 22396 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.733004 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.739189 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:05.743443 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:05.716989 27177 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.745384 22546 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:05.746209 22396 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.748116 22396 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.751720 22396 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.738690 27078 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.753319 22546 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.732998 27225 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:05.755851 22396 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:05.741897 27066 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:05.758759 22546 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.759711 27176 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:05.750094 26746 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:05.760617 27176 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.761098 27176 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:05.761576 27176 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.761615 26765 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:05.762348 26765 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:05.762454 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.754882 27155 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:05.754379 27218 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:05.748155 26897 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.765357 26897 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.765760 26897 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.763228 26765 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.761366 27204 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.748310 26757 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:05.747452 27172 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:05.739060 27248 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.768561 27186 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:05.786432 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.787132 27253 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.788196 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.787160 23107 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:05.747236 27153 consensus_queue.cc:1059] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:05.771030 27066 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:05.795075 27248 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:05.791215 27001 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.800567 27001 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.801412 27177 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:05.802875 27001 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:05.803146 27276 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:08:05.813145 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:05.816056 27153 raft_consensus.cc:3055] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:05.816642 27153 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:05.817543 27153 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.818830 27153 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.792824 27066 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:05.873683 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 63347.6us
I20260709 13:08:05.884637 22547 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:05.881410 22396 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:05.812809 27237 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:05.884769 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 97176.6us
I20260709 13:08:05.818184 27219 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:05.894606 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:05.895251 22573 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:05.895540 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:05.896371 22575 raft_consensus.cc:2410] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:08:05.896458 22399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.895507 22580 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:05.900771 22398 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:05.902253 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:05.876942 27248 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.895190 27281 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:05.908227 27219 consensus_queue.cc:1059] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:08:05.911640 27284 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:05.912230 27284 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.911429 27219 raft_consensus.cc:3055] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:05.893110 27155 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.915832 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:08:05.908286 27270 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.302s	user 0.000s	sys 0.005s
I20260709 13:08:05.893074 27230 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.920262 27219 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:08:05.927855 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 153699us
I20260709 13:08:05.932791 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:05.924459 27150 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.923884 27155 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.937915 22582 raft_consensus.cc:1275] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:08:05.941808 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 52536.4us
I20260709 13:08:05.927325 27230 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.946983 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:05.973104 22579 raft_consensus.cc:2393] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 10: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:05.960882 27219 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.922094 27248 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.929282 27176 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:05.973659 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.978063 22503 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:05.982863 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:05.984897 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.986174 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:05.986395 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.992148 27001 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.992799 27001 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.993407 26897 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:05.994894 27001 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:05.942695 27155 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.944430 27203 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.015748 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:05.975509 27230 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.016840 22579 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 13: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:06.020725 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.021332 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:06.018174 22578 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.020040 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.020383 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.019948 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.021708 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:05.996042 22424 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:06.024524 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.024721 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:06.023270 22427 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:05.981527 27083 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:06.029829 22426 raft_consensus.cc:2393] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:06.031700 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.034796 27172 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:06.035387 27172 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.036134 27248 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:06.036304 22429 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.037631 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:06.038301 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.038641 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:06.039243 27288 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:06.039924 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:06.016778 27203 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.034926 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:06.041468 27203 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.995522 26897 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.038173 22429 raft_consensus.cc:3060] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.052153 22501 raft_consensus.cc:2410] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:06.046977 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:06.053598 22396 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:06.054797 22575 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:08:06.055045 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.055657 22575 pending_rounds.cc:85] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:08:06.055943 22575 pending_rounds.cc:107] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:08:06.056185 22575 raft_consensus.cc:2889] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.055958 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.058308 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:06.060464 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.061225 22579 raft_consensus.cc:2368] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13.
I20260709 13:08:06.062705 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.032860 27219 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.074828 22545 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:06.073167 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.075714 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.076289 22579 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 10.
I20260709 13:08:06.077250 27224 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:06.078372 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.082784 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.083042 27182 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:06.083751 27182 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.089203 22429 raft_consensus.cc:2468] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:08:06.090315 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:06.092517 22501 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:08:06.089275 22472 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:06.093561 23077 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:06.091910 26897 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:06.096637 27248 raft_consensus.cc:2804] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:06.097208 27248 raft_consensus.cc:697] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:06.098080 27248 consensus_queue.cc:237] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.099119 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.096143 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.064433 27153 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.096264 23077 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.107146 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.108971 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.105809 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.111902 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.086853 27287 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.101037 27177 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:06.124850 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.071543 26757 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:08:06.122897 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.126145 22429 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:06.060837 27083 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.122459 27253 consensus_queue.cc:1059] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:08:06.104550 27153 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.141099 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.114697 27174 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.110739 27284 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:06.117878 27224 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:06.150452 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.156919 27155 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.159240 27155 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.160853 22578 raft_consensus.cc:2368] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13.
I20260709 13:08:06.164410 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.165045 22429 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 14.
I20260709 13:08:06.168856 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:06.170811 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:06.142980 27290 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:08:06.173731 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.174383 22433 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:06.176730 27172 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:06.178076 22399 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.179080 27001 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:06.179257 22399 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.180816 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.181577 22574 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:08:06.182454 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.181176 27186 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.186522 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.187175 22581 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:08:06.146420 27153 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.180687 27287 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:06.188230 22581 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.191565 27230 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.192888 22399 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.200934 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.117096 26897 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.198369 22474 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:06.202425 23079 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:06.183720 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:06.212812 22579 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.213145 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.219868 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:06.222199 23105 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.222548 22547 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.225437 22474 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:06.226943 22581 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:06.210515 27288 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:06.226660 26955 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.261267 27078 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.220335 27176 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:06.263319 22582 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.223321 26929 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.200603 27066 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.266710 22573 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:06.229904 27224 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.269721 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.272081 27230 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.278890 27083 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:06.279838 27249 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:08:06.163213 27253 consensus_queue.cc:1243] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer e32ba8e6132b4f8e98a99066b6fffe05 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:06.286329 23105 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:06.288641 22582 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 13:08:06.289757 22582 pending_rounds.cc:85] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 5
I20260709 13:08:06.290517 22582 pending_rounds.cc:107] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:08:06.291846 22582 raft_consensus.cc:2889] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:06.291471 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 109378us
I20260709 13:08:06.230396 22426 raft_consensus.cc:2368] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 12. Current term is 13.
W20260709 13:08:06.284808 27282 log.cc:927] Time spent T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.399s	user 0.005s	sys 0.000s
I20260709 13:08:06.210166 27172 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.212953 27225 consensus_queue.cc:1048] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:08:06.231128 27204 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.305341 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:06.320591 22506 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.217214 27291 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:06.326650 22499 raft_consensus.cc:1240] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.219241 27153 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.230141 26853 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:08:06.289153 27177 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:08:06.337423 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 123291us
W20260709 13:08:06.353848 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 138528us
I20260709 13:08:06.360019 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:06.333287 27291 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.358392 22547 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:06.326215 27172 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.369053 23107 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:06.359362 27182 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.344033 27203 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.382251 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:06.383617 23105 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.391155 22506 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
W20260709 13:08:06.394639 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.396062 27306 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:06.341101 27177 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.367383 27237 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:06.419515 23105 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:06.421028 22432 raft_consensus.cc:2368] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 10. Current term is 11.
I20260709 13:08:06.381057 26907 consensus_queue.cc:1059] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:08:06.427413 27304 log.cc:927] Time spent T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:06.429919 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.431337 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:06.431974 22433 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.437071 27078 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.437808 27078 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.440099 27078 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:06.440665 27176 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:08:06.443337 27309 log.cc:927] Time spent T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:06.451501 27176 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.454205 27176 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:06.455678 23112 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:06.457670 27218 raft_consensus.cc:3055] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:06.458174 27218 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:06.458968 27218 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.459851 27153 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:06.460157 27218 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.461194 27291 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:06.464833 22433 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:06.465523 27313 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:06.480108 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:06.421651 27237 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:06.412426 27066 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:06.465977 27203 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.481264 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.481439 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:06.405344 27182 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:06.466995 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:06.481918 22433 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
I20260709 13:08:06.486644 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:08:06.486680 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 148279us
I20260709 13:08:06.487357 22433 raft_consensus.cc:2393] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 13: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:06.481962 23104 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.457741 27172 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.504021 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.531714 22546 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:06.491333 27182 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.481226 27237 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.537436 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:06.532758 27176 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.533077 27154 consensus_queue.cc:1059] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:08:06.540964 22546 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.540418 27302 raft_consensus.cc:2749] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.566764 27066 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.577829 27182 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.541443 27078 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.579384 27220 raft_consensus.cc:3055] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:06.579600 22398 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:06.581373 27313 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:06.581905 27313 raft_consensus.cc:697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:06.582727 27313 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.539921 27176 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.585147 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:06.585599 27176 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.590032 22432 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:08:06.605847 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:06.616714 23104 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
W20260709 13:08:06.628751 27283 log.cc:927] Time spent T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.714s	user 0.003s	sys 0.000s
I20260709 13:08:06.618593 22398 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:06.539350 27314 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:06.629272 27320 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:08:06.579838 27220 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:06.616876 26853 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:06.639017 22546 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.632815 27226 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:08:06.643873 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 75626.4us
I20260709 13:08:06.634588 27218 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:06.648065 27176 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:06.659402 27317 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:06.661770 27317 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:06.662129 27317 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.663565 22424 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.665284 27200 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.665784 27200 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.661082 27176 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.667891 27200 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.668505 27176 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.650899 27220 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.652230 27153 raft_consensus.cc:3055] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:06.653985 27278 log.cc:927] Time spent T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.763s	user 0.002s	sys 0.000s
I20260709 13:08:06.685930 22429 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:06.658712 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 154756us
I20260709 13:08:06.672844 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:06.679056 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:06.686795 22399 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.687470 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:06.688021 22505 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.646878 22546 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.680172 22507 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:08:06.692375 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45603.9us
I20260709 13:08:06.696249 26897 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:06.684046 27153 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:06.698577 27153 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.699715 27220 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.665051 27226 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.705513 23108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59008 (request call id 1009) took 1075 ms. Trace:
I20260709 13:08:06.706008 23108 rpcz_store.cc:276] 0709 13:08:05.629931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.630036 (+   105us) service_pool.cc:224] Handling call
0709 13:08:05.630347 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.654815 (+ 24468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.654849 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.655335 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.739500 (+ 84165us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:05.739542 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.191789 (+452247us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5400543654. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:08:06.191838 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.653413 (+461575us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f006c9bd86e 00007f006c9bcbb6 00007f006c9bc7d8 00007f006c9c6221 00007f006c9c61d9 00007f006c9c6169
0709 13:08:06.705272 (+ 51859us) raft_consensus.cc:1685] finished
0709 13:08:06.705295 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.705442 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1331,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":62394368,"thread_start_us":83779,"threads_started":1,"wal-append.queue_time_us":138061}
W20260709 13:08:06.732812 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.734369 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:06.734875 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:06.736195 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:06.736650 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 59890.6us
I20260709 13:08:06.738375 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.740088 22546 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:06.659987 26853 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:06.741405 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 54689.7us
I20260709 13:08:06.741878 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.743451 27163 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.695205 27176 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.739539 26897 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.740872 23108 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.741348 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.750747 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.750805 22546 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.706105 27226 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:06.745862 27153 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.737182 27083 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:06.778785 22546 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:06.779997 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.772725 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.776039 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.739753 27218 raft_consensus.cc:697] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:06.752108 27184 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:06.784818 22399 leader_election.cc:400] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13.
I20260709 13:08:06.786643 22399 leader_election.cc:403] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.789662 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.790036 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.795085 22546 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:06.806286 22504 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:06.809865 22504 pending_rounds.cc:85] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 5
I20260709 13:08:06.810101 22504 pending_rounds.cc:107] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:06.810360 22504 raft_consensus.cc:2889] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.807823 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.801193 26897 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.795468 27287 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:06.785058 27291 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:06.821597 27287 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:06.822000 27287 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:06.787585 27083 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.822834 27287 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.823061 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:06.827267 27204 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:06.828372 27290 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.829893 22399 leader_election.cc:400] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13.
I20260709 13:08:06.831280 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:06.812107 27172 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:06.837208 27172 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:06.838248 27172 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:06.806803 27327 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:06.842114 27083 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:06.795773 26862 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13.
I20260709 13:08:06.795857 27176 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:06.845988 27329 log.cc:927] Time spent T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:06.847196 27218 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:06.814122 22503 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:06.849992 22577 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:06.850587 22505 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:06.851411 22501 raft_consensus.cc:1240] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.853336 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:06.855158 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:06.855834 22575 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.824096 27287 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.859236 22574 raft_consensus.cc:1240] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.858067 22396 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:06.865998 27317 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:06.869406 22575 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:08:06.871668 22472 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:06.872884 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:06.874349 22577 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.877348 22472 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:06.878499 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 70772.2us
I20260709 13:08:06.879371 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:06.885118 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:06.886955 22472 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:06.876616 27220 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:06.907660 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.903411 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.904163 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.873365 27317 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:06.909487 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:06.887455 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:06.913221 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.916415 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:06.858596 27307 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:08:06.922942 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 91764.6us
I20260709 13:08:06.924865 22429 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:06.882822 27176 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.882484 27291 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:06.934599 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.934253 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.933883 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:06.934587 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.929358 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.935122 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.939572 23077 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:06.949792 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 43766.5us
I20260709 13:08:06.885865 26853 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:06.902702 27083 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.956388 22433 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:06.958204 23077 leader_election.cc:400] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 10. Current term is 11.
I20260709 13:08:06.958640 23077 leader_election.cc:403] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.914281 26731 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:06.962533 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:06.914769 27220 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.908711 27253 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.922304 27224 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:06.969765 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 56388us
W20260709 13:08:06.997267 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 43575.2us
W20260709 13:08:07.004925 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 117533us
I20260709 13:08:06.950562 27291 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:07.010856 22433 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:07.011420 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:06.982221 27220 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.927733 27200 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:08:06.981927 27253 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:07.056936 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:07.057605 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 118475us
I20260709 13:08:07.056073 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:07.006376 26763 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:06.997005 27224 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:07.012930 27291 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.969954 27066 consensus_queue.cc:1059] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:08:07.013335 26853 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.013360 26731 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:08:07.116259 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 165275us
I20260709 13:08:07.052800 27225 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 10. Current term is 11.
W20260709 13:08:07.063756 27278 log.cc:927] Time spent T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:08:07.140625 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 131274us
I20260709 13:08:07.063203 27253 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:07.154148 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 156135us
I20260709 13:08:07.167659 26731 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.167737 27184 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:07.118868 27224 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:07.172303 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 214235us
W20260709 13:08:07.182786 27331 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
W20260709 13:08:07.183595 27332 log.cc:927] Time spent T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:08:07.092396 27310 log.cc:927] Time spent T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:08:07.161311 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 177735us
I20260709 13:08:07.195679 23077 leader_election.cc:400] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 12. Current term is 13.
I20260709 13:08:07.196157 23077 leader_election.cc:403] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:07.205248 27225 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 12. Current term is 13.
I20260709 13:08:07.119248 26853 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:08:07.227819 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 79255.2us
I20260709 13:08:07.184298 27184 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
W20260709 13:08:07.239568 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51878.5us
W20260709 13:08:07.229027 27295 log.cc:927] Time spent T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:08:07.243597 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 227686us
I20260709 13:08:07.226176 27308 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.230356 26853 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.220572 27200 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:08:07.341503 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 98243.8us
W20260709 13:08:07.353739 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 101429us
W20260709 13:08:07.357699 27335 log.cc:927] Time spent T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:08:07.364080 27186 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:07.367700 27226 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:07.368652 27226 consensus_queue.cc:1059] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:07.251358 27342 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:07.434166 27337 raft_consensus.cc:3055] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:07.434677 27337 raft_consensus.cc:740] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:07.435550 27337 consensus_queue.cc:260] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.379405 27342 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:08:07.472656 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 129803us
W20260709 13:08:07.475805 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 439007us
W20260709 13:08:07.436506 27334 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
W20260709 13:08:07.436419 27287 consensus_meta.cc:287] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.000s
I20260709 13:08:07.484395 23108 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:08:07.489712 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 64256.4us
I20260709 13:08:07.500180 27345 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:07.503378 27348 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:07.503973 27348 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.510391 27230 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:07.506091 27348 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:07.425817 27184 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.437197 27342 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.444542 27219 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:08:07.518877 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:07.532083 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:07.532889 22506 raft_consensus.cc:2393] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:07.544087 22427 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:08:07.544652 22427 pending_rounds.cc:85] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 10
I20260709 13:08:07.544909 22427 pending_rounds.cc:107] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:08:07.545159 22427 raft_consensus.cc:2889] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:07.551227 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 308419us
I20260709 13:08:07.553354 22474 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:07.559155 27363 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:07.559769 27363 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.522406 27345 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:07.575199 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:07.577155 27362 log.cc:927] Time spent T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:08:07.579939 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 58968.3us
I20260709 13:08:07.561435 27184 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.589125 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:07.564396 27339 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.556208 27186 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 13:08:07.599443 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44942.4us
I20260709 13:08:07.600530 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:07.602778 22472 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:07.602236 22474 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:07.579478 27345 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:07.604355 27083 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.627408 27253 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.596753 27339 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.635070 27363 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:07.638345 22500 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:07.637823 27224 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:07.676692 26929 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:07.643260 27339 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:07.632462 27220 consensus_meta.cc:287] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.000s
I20260709 13:08:07.641121 27340 raft_consensus.cc:3055] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.646893 27337 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:07.706756 27365 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.644461 26853 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.721246 27355 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:07.721925 27355 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:07.725375 27345 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:07.729044 22507 raft_consensus.cc:1240] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:07.696312 27340 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:07.692800 26929 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:07.727748 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:07.693392 27220 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.708272 27253 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:07.734758 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 132053us
I20260709 13:08:07.725814 27224 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:07.727964 27200 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:07.739997 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:08:07.740455 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 130703us
I20260709 13:08:07.739579 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:07.742846 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:07.744412 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:07.746053 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:07.747716 22427 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:08:07.749925 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 148787us
I20260709 13:08:07.750717 22474 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:07.746717 22426 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
W20260709 13:08:07.815375 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 64728.8us
I20260709 13:08:07.817145 22474 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:07.823864 27382 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.827335 27372 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.828806 27224 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.829282 27372 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:07.829849 27372 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.830418 27382 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.830905 27382 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.832020 27372 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:07.832723 27364 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.833236 27382 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:07.821269 26765 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.742722 27355 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:07.836899 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:07.838963 22503 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:07.838883 26853 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:07.840713 26929 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:07.837239 26765 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.841475 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:08:07.841809 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.842334 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:07.842578 27253 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:07.843178 27253 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:07.845516 27220 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:07.845897 27253 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:07.846467 27340 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:07.847501 27340 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.847790 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:07.848068 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:07.848639 22431 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.851689 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:07.852581 22506 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 14: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:07.857416 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:07.862124 27346 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:07.863090 27346 raft_consensus.cc:3055] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:07.863489 27346 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:07.829345 27224 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:07.867982 27224 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:07.837627 22425 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:07.882877 22506 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:07.885095 27319 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:07.888731 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.896740 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:07.902379 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.864326 27346 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:07.904739 27346 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:07.908154 27291 consensus_meta.cc:287] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.759s	user 0.006s	sys 0.002s
I20260709 13:08:07.908775 27291 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:07.924544 27330 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.858s	user 0.000s	sys 0.018s
I20260709 13:08:07.943003 27308 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:07.967024 27308 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.971161 27342 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.973795 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:07.973869 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:07.981470 27291 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:07.987681 22431 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:07.956668 22472 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:07.994575 22472 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:07.995292 27200 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:07.995951 27200 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.996371 27200 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:08.001439 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.006898 26765 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.024010 27351 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.024320 23077 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.024677 27351 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:08.025844 22508 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:08.028627 27155 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.029181 27155 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:08.030727 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 616606us
I20260709 13:08:08.030987 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.031587 22582 raft_consensus.cc:1813] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Handling vote request from an unknown peer e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.032186 22582 raft_consensus.cc:2410] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:08:08.032359 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.033445 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.034482 27177 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:08.034781 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.036051 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:08.036676 27302 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.037197 27302 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.039714 26897 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:08.040408 26897 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:08.045317 22545 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:08.037130 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 249845us
I20260709 13:08:08.046007 27176 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.046576 27176 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:08.048516 27078 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.049072 27078 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.050307 27172 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.050884 27066 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.051426 27066 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:08.052516 27372 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:08.053022 27372 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.053519 27372 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.040408 27174 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:08.055794 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 61282.9us
I20260709 13:08:08.059494 22472 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:08.028117 27317 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:08.079303 27317 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:08.080825 27083 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:08.081404 27083 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:08.082314 27083 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.083966 27317 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:08.061098 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.101266 22575 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:08.061702 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.061801 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.102955 22576 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:08.062657 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:08.062835 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:08.066625 22546 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:08.066951 27078 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:08.067948 27155 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:08.069259 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:08.105137 23105 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:08.105809 23109 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:08.035804 27177 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:08.066468 27284 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:08.072227 27176 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:08.073108 27302 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:08.070619 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:08.108557 27292 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:08.074373 27066 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:08.092042 27387 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:08.092718 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47519.6us
I20260709 13:08:08.118185 22473 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:08.060042 27172 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.125443 27291 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.126835 27172 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:08.094494 26897 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:08.130038 27308 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:08.100564 23076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.070168 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:08.108616 27177 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:08.133780 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:08.135140 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:08.077986 27200 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.136159 23104 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:08.125656 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.114750 23112 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:08.117390 22424 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:08:08.118625 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 52084.2us
I20260709 13:08:08.119724 22545 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.138441 22546 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:08.139645 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:08.140465 22545 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.141784 22545 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.141920 22473 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:08.147923 22506 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:08.148379 22546 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.152930 26897 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:08.153954 27184 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:08.147485 27177 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.155017 27177 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:08.155465 22546 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:08.155673 27177 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.156404 27177 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:08.156903 27177 raft_consensus.cc:697] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:08.157783 27177 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.159621 27066 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:08.153827 27372 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.164175 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.166729 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.168169 22545 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.169754 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.166333 22473 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:08.172150 22579 raft_consensus.cc:1275] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:08.172215 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:08.171486 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.165628 27372 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.162011 27066 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:08.165362 27342 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.175122 23077 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.132411 27308 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:08.172397 27184 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:08.170814 27155 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.172793 26897 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:08.185899 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:08.221689 22433 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.179282 26929 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.186843 23076 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.187343 27291 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.192025 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58706 (request call id 2214) took 1286 ms. Trace:
I20260709 13:08:08.195364 27200 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.176239 27307 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:08:08.239192 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 52438.3us
I20260709 13:08:08.173672 27172 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:08:08.178371 27342 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.242630 27342 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.184938 27348 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.247116 27348 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.199884 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.248872 22431 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:08:08.249521 27348 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.250180 22431 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:08.251498 22573 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:08.200891 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.203511 22545 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.225467 26926 consensus_queue.cc:1048] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:08:08.255456 23077 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:08.205122 22428 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:08.242700 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:08.256973 22425 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.207393 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.207690 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.258426 22430 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:08.213523 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.174100 27284 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.216985 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.218015 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:08.218902 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:08.223508 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 57255.3us
I20260709 13:08:08.228793 22500 rpcz_store.cc:276] 0709 13:08:06.905384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.906057 (+   673us) service_pool.cc:224] Handling call
0709 13:08:06.927357 (+ 21300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.652374 (+725017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.191783 (+539409us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54003ab954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:08:08.191959 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1634654464}
I20260709 13:08:08.230281 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.233536 22433 raft_consensus.cc:2468] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:08.261978 22472 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:08.262423 27083 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.262838 27381 raft_consensus.cc:2804] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:08.263024 27083 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.263449 27381 raft_consensus.cc:697] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:08.264386 27381 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.264981 27284 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:08.265165 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 61752.7us
I20260709 13:08:08.238538 27291 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.266407 27284 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:08.267196 27387 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:08.267540 27387 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:08.267889 27291 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:08.268311 27387 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.269610 27387 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.231138 27337 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:08.273103 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 55164.2us
I20260709 13:08:08.183373 27340 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.221012 27176 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.241008 26929 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:08.204608 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.275048 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:08.276197 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.276423 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.277592 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.277415 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.287837 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.277926 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.288980 22433 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:08.287756 22505 raft_consensus.cc:2393] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:08.275693 22425 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:08.291220 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.291296 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.292620 22428 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 13:08:08.301098 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:08.303012 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:08.303639 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:08.305531 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:08.306471 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.307417 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:08.310801 22474 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:08.313634 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.317770 22582 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:08:08.318185 22582 pending_rounds.cc:85] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 7
I20260709 13:08:08.318506 22582 pending_rounds.cc:107] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:08:08.314213 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.320547 22547 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.320660 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.318748 22582 raft_consensus.cc:2889] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.320778 22505 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:08.321900 22472 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:08.322042 22545 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.289710 27176 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.323678 27290 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:08.323836 27291 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:08.323698 27066 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.325716 27176 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:08.326315 27176 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.327328 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.328001 22573 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:08.309662 27337 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:08.329634 27337 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.331805 27337 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.315649 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:08.312609 27377 log.cc:927] Time spent T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:08.312839 27353 consensus_queue.cc:1059] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:08:08.306365 27376 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.256393 26926 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:08.340713 26926 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.341127 26926 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:08.265375 27083 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.273077 27307 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.348137 27307 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.311838 27351 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.348496 27153 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:08.352020 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.357036 27172 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:08.362296 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:08.365685 27370 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.177s	user 0.000s	sys 0.002s
W20260709 13:08:08.387027 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 88355.4us
W20260709 13:08:08.388821 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 66974.2us
W20260709 13:08:08.391438 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 75862.3us
I20260709 13:08:08.280072 27354 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.394665 22505 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
W20260709 13:08:08.396099 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44174.6us
I20260709 13:08:08.397782 22472 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:08.437556 22399 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.394330 27340 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:08.393234 27364 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.396378 27200 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:08.400444 27150 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.475818 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.476691 22580 raft_consensus.cc:2393] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:08.478382 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:08:08.479856 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 82477.4us
I20260709 13:08:08.486027 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.486758 22433 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:08.449545 27348 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:08.483762 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.490203 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:08.490665 22546 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:08.490890 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 93194.3us
I20260709 13:08:08.464915 27200 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.455053 27340 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.499523 22546 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:08.500844 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:08.501910 22582 raft_consensus.cc:2410] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:08.497627 27200 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.504400 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.504860 27163 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:08.505800 27391 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:08:08.506505 27340 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.495451 27066 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:08:08.495846 27176 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:08:08.514183 27176 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:08.514580 27176 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:08.514742 27066 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:08.515403 27176 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.516352 22546 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.514281 27200 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:08.518029 27155 consensus_queue.cc:1175] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" responder_term: 14 status { last_received { term: 14 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: [13.9-13.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:08.521194 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.521322 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:08.522025 22502 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:08.523017 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:08.526521 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.528702 22473 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:08.488866 26897 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.493402 27224 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.542270 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.497619 27284 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:08.548906 22499 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:08.528262 27176 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:08.525185 27337 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:08.528172 27387 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.539945 27302 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.588565 27387 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.589007 27387 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.531478 27184 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.587687 22579 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:08.541319 27338 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:08.576643 27284 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.582692 27078 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.602080 27184 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.603331 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:08.608640 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 121336us
I20260709 13:08:08.609825 22582 raft_consensus.cc:2393] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:08.534355 27342 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:08.612002 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.612262 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:08.612866 22547 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.543301 26897 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.614282 22399 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:08.551824 27224 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.598201 27284 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.597759 27200 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.606252 27338 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:08:08.685429 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 71211.1us
W20260709 13:08:08.686012 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 73253.4us
I20260709 13:08:08.613691 27337 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:08.692503 27340 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.613682 27184 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.693477 26746 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:08.693796 27177 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.696179 27150 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:08.731853 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:08.711985 26746 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.861763 26897 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:08.873842 26746 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:08.846810 27381 consensus_queue.cc:1059] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
W20260709 13:08:08.886421 27392 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:08:08.846154 27150 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:08.908157 22424 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:08.724372 27337 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.919996 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:08.920725 23112 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:08.925822 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.928781 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 232572us
I20260709 13:08:08.929658 23112 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:08.930876 22473 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:08.912840 27302 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:08.931748 22433 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:08.883574 27338 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:08.933089 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:08.937229 22427 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:08.920169 27342 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:08.923139 27066 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:08.939239 27381 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:08.952626 27396 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260709 13:08:08.953471 27399 log.cc:927] Time spent T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:08.964212 27150 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:08.934774 27302 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:08.970459 27302 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:08.974220 22578 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:08:08.974670 22578 pending_rounds.cc:85] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 8
I20260709 13:08:08.974905 22578 pending_rounds.cc:107] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:08:08.956420 27387 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.975176 22578 raft_consensus.cc:2889] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.977069 27387 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:08.978266 22575 raft_consensus.cc:2368] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
W20260709 13:08:08.979527 26926 consensus_meta.cc:287] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent flushing consensus metadata: real 0.638s	user 0.006s	sys 0.002s
I20260709 13:08:08.984205 27365 raft_consensus.cc:3055] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:08.984689 27365 raft_consensus.cc:740] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:08:08.986421 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.948997 27224 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.975889 26746 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:09.001787 27397 log.cc:927] Time spent T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:08:09.002005 27345 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:09.002542 27345 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.006743 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:08.985525 27365 consensus_queue.cc:260] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.008661 27184 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:08.997038 27340 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:08.946441 27172 consensus_queue.cc:1059] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:08:08.980017 26926 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.011360 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:09.008543 27351 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.012599 23105 raft_consensus.cc:2368] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12.
I20260709 13:08:09.012461 27351 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.014639 27351 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.015892 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.016551 22502 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 10.
I20260709 13:08:09.019469 23112 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:09.017867 23076 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:09.038231 22396 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:09.040701 26746 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.041855 26926 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.046710 22504 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:09.036304 27351 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:09.048336 27351 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.048765 27351 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.049386 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.056025 27371 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:09.056823 27371 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:08.993287 27381 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:09.062038 27381 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.017906 27284 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.068334 27284 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.010744 27172 raft_consensus.cc:3055] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:09.069159 27172 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:09.070091 27172 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.077865 26746 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:09.084986 27384 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 1.046s	user 0.000s	sys 0.006s
I20260709 13:08:09.084652 26746 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:09.076646 27371 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.109079 26746 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:09.121065 27372 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.121755 27372 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.122512 27083 raft_consensus.cc:3055] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:09.122951 27083 raft_consensus.cc:740] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:09.080046 27383 consensus_queue.cc:1059] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:08:09.131973 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53311.2us
I20260709 13:08:09.089614 27351 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.106906 26765 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:08:09.161185 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 218847us
I20260709 13:08:09.127084 27337 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.162675 22546 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:09.121759 27388 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:08:09.163647 23107 raft_consensus.cc:1240] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:09.173221 22398 leader_election.cc:400] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12.
I20260709 13:08:09.173617 22398 leader_election.cc:403] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:09.175572 22474 leader_election.cc:400] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:08:09.175917 22474 leader_election.cc:403] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:09.177045 27373 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.209066 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:09.147877 27291 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.212668 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:09.219453 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 54955.9us
I20260709 13:08:09.223618 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:09.226457 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:09.229272 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:08.989449 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:09.211113 27403 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:09.157546 26765 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.303727 27403 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.373198 27363 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.217504 27338 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:08:09.384640 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 214594us
I20260709 13:08:09.174330 27337 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.220901 27372 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.216845 27200 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.169s
W20260709 13:08:09.456317 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 225644us
I20260709 13:08:09.394301 27403 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.220976 27291 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.446573 27410 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:08:09.474265 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 81062.6us
I20260709 13:08:09.470057 27303 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:09.477720 27303 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.479878 27303 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.468032 27338 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.455324 27363 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.390021 27314 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:08:09.493111 27381 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.487181 27338 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:09.506378 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49194.3us
I20260709 13:08:09.515761 27204 raft_consensus.cc:3055] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:09.516345 27204 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:09.517557 27204 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.518029 27154 raft_consensus.cc:3055] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:09.519034 27154 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
W20260709 13:08:09.541076 27422 log.cc:927] Time spent T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:09.490190 27342 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.547015 27405 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.547647 27405 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.550000 27405 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:09.551864 27418 log.cc:927] Time spent T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:08:09.559682 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 52220.9us
W20260709 13:08:09.564024 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 50161.8us
I20260709 13:08:09.556391 27351 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.637411 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:09.511511 27381 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:09.648125 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 81140.8us
I20260709 13:08:09.653877 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:09.654528 22507 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.640257 26929 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.668623 26929 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.670876 26929 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:09.672817 27428 log.cc:927] Time spent T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:08:09.677105 26746 consensus_meta.cc:287] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
I20260709 13:08:09.677630 26746 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.680847 27291 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.682318 27345 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.639394 27372 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:09.568956 27405 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:09.728869 27405 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.729391 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.730182 22503 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:08:09.731277 27405 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:09.733151 27427 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:09.734088 26765 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:09.687304 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.734863 22499 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 15.
I20260709 13:08:09.705565 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.736572 27337 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.742627 27154 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.557938 27342 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.744869 27154 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.745548 27381 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:09.719400 27184 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.747362 27184 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:09.749337 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.656646 27417 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.428s	user 0.001s	sys 0.000s
I20260709 13:08:09.750059 26897 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.725700 27066 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.750589 26897 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.750738 27066 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.752854 27066 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.754570 27363 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:09.756526 27373 consensus_meta.cc:287] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.579s	user 0.014s	sys 0.000s
I20260709 13:08:09.733825 27427 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.758448 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:09.759200 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:09.722852 23105 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:09.745774 27342 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:09.762115 22507 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:09.760797 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:09.679827 26746 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.764729 23104 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:08:09.770670 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:09.771425 23109 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:09.718309 27291 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.763381 27066 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.773854 27066 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.776031 27066 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:09.773062 27291 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.757009 27372 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.778023 27291 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:09.778324 27372 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:09.733523 27391 log.cc:927] Time spent T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:09.749586 27184 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.776206 27427 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.772334 22473 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:09.788261 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:09.789891 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:09.778898 27337 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:08:09.763676 27292 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:09.757097 27373 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:08:09.718117 27200 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.794128 22472 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:09.794900 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 2215) took 1583 ms. Trace:
I20260709 13:08:09.797621 22581 rpcz_store.cc:276] 0709 13:08:08.203333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.203452 (+   119us) service_pool.cc:224] Handling call
0709 13:08:08.229714 (+ 26262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.267356 (+ 37642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.267386 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.267427 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:08.267457 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.786922 (+1519465us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b540009b354. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:08:09.786970 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.787166 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86120832}
I20260709 13:08:09.791649 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:09.773164 27430 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.799616 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.800806 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.767618 27410 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12.
I20260709 13:08:09.801716 22504 raft_consensus.cc:2410] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:09.796811 27200 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.800544 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:09.804224 27342 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.803475 27415 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.792568 27345 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:09.805477 27415 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.806031 27345 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.806371 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.807955 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.808574 27415 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.806898 27200 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.809834 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.786732 27405 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:09.803701 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:09.801604 22506 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:08:09.810963 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.811651 27373 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:09.812071 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.812187 27430 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.811683 22503 raft_consensus.cc:2368] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14.
I20260709 13:08:09.809348 22499 raft_consensus.cc:1240] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:09.814195 27430 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.815431 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:09.816587 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 44292.1us
I20260709 13:08:09.817561 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:09.818259 27177 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.818563 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:09.811935 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.820432 22508 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:08:09.819437 27373 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.821360 27373 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:09.821583 26746 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:09.811074 27405 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.822147 26746 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.823555 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.802695 26897 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.825208 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.794301 27292 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.819272 27177 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:09.826673 27177 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.827040 27177 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.825208 26746 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:09.827363 27292 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:09.827857 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:09.806430 27345 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:09.828435 22428 raft_consensus.cc:3060] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.831250 22501 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:09.826129 27405 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:09.833168 27430 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.833684 27430 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.839059 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:09.836408 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:09.839040 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:09.840859 22431 raft_consensus.cc:2368] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14.
I20260709 13:08:09.836496 22428 raft_consensus.cc:2468] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:09.841794 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.844169 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:09.848037 22545 leader_election.cc:400] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14.
I20260709 13:08:09.848366 22545 leader_election.cc:403] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:09.849418 22545 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:09.843012 26897 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.850482 26897 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.851735 27284 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:09.852161 27284 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.850286 27184 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.847671 27372 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.853435 27372 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.855677 27372 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:09.860649 27284 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.860688 22545 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:09.845968 27342 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:09.867730 27342 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.868314 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.869148 22499 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:09.787038 27403 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.872574 22501 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:08:09.875854 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.878042 27184 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14.
I20260709 13:08:09.880265 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b0ff4c7da4211acec428ae776775a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.870360 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.883769 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.886972 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.888720 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.891381 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:09.892115 22428 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.897459 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.900132 22428 raft_consensus.cc:2410] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:09.874679 27405 raft_consensus.cc:2804] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:09.902230 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:09.905844 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.879817 27436 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.909405 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.915367 27405 raft_consensus.cc:697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:09.924808 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.924437 27436 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.925482 22425 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:09.885296 26897 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.933215 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:09.889514 27430 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.925315 27403 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:09.926960 27292 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:09.956563 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.946938 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:09.948693 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:09.962148 22502 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.949414 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:09.950291 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.964287 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.953203 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.934489 23104 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:09.958393 22430 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:09.974440 22424 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:09.976613 22502 raft_consensus.cc:2410] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:09.916427 27405 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.978077 22425 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:09.968200 27372 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.977198 27434 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:08:09.979981 22396 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:09.983518 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:09.985397 22424 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:09.960397 26897 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:09.979027 27372 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.989566 27358 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:09.990125 26897 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.991061 27381 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:09.991597 27381 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:09.992967 27155 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.993644 27155 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:09.990867 27426 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.989567 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:09.964718 27292 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.001705 22396 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:09.969481 27436 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:10.004225 23079 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.011144 27174 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.993521 27342 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:09.998265 27172 raft_consensus.cc:3060] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.018023 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.014621 26862 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:10.019903 26862 raft_consensus.cc:697] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:10.020851 26862 consensus_queue.cc:237] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.008304 27345 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.000018 27184 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:10.022908 27184 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.025086 27184 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.015558 27372 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:10.016120 27373 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.024196 27345 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.028946 27373 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.003317 27358 raft_consensus.cc:697] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:10.019037 26897 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.030926 27358 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.032620 23112 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:10.012815 22396 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.036257 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:10.034512 22427 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 14.
I20260709 13:08:10.039904 22504 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 16: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:10.039726 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.040447 22424 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:10.025923 27381 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.042188 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:10.042979 23112 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 15: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:10.048506 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:10.050817 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:10.041734 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:10.054836 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:10.055572 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.056354 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.057675 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:10.058437 22504 raft_consensus.cc:2393] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:10.063598 23109 raft_consensus.cc:2393] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 16: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:08:10.064153 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.070111 27427 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.070911 27204 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.070734 27427 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.073832 27427 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:10.080809 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.082077 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.084880 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.085536 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.086894 22502 raft_consensus.cc:1240] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.038872 27292 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.095767 27066 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:10.096037 22425 raft_consensus.cc:1240] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:10.042078 26757 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.096386 27066 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.098042 27177 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.099279 27066 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.100117 27177 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.106164 27426 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.107215 22424 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:10.107630 22575 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:08:10.108021 22575 pending_rounds.cc:85] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 8
I20260709 13:08:10.108232 22575 pending_rounds.cc:107] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:08:10.108449 22575 raft_consensus.cc:2889] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:10.109361 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:10.041712 27416 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:08:10.111119 27416 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:10.100489 22504 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:10.101920 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.111488 27416 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:10.111876 22430 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:10.102520 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.052870 27078 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:10.112602 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.112335 27416 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.054141 27284 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.113420 27416 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.114867 27284 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.103116 27415 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:10.115767 27415 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.103747 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.116971 22429 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:10.117647 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.121263 27078 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.123150 27177 raft_consensus.cc:493] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:10.123057 27083 consensus_queue.cc:260] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.123772 27177 raft_consensus.cc:515] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.124193 27083 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.121914 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.131078 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.134805 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.136229 27345 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.137568 23077 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.139925 22472 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.141412 22472 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.142963 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.146119 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:10.149591 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.147197 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:08:10.208073 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 66729.6us
I20260709 13:08:10.141635 27426 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:10.211843 27426 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.214078 27426 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:10.211199 27434 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.216672 27434 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:10.218497 27177 leader_election.cc:290] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.218878 22472 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.124367 27078 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.130162 27403 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:10.224326 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:10.225466 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 87901.7us
I20260709 13:08:10.227715 22472 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.125592 27284 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:10.130244 27066 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:10.219365 27174 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:10.231853 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 82330.9us
I20260709 13:08:10.232635 22547 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.208556 27172 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:10.221328 27224 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.238970 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.243465 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:10.244022 22425 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.231707 27403 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:10.245338 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.246269 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.246438 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.246909 22504 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:10.230928 27434 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.230366 27345 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:10.250691 22546 leader_election.cc:400] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Vote denied by peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859) with higher term. Message: Invalid argument: T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14.
I20260709 13:08:10.251715 22472 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.237767 26897 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.258715 22472 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:10.238343 27174 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.239423 27381 raft_consensus.cc:2749] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.231508 27317 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:08:10.309824 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.288167 27363 raft_consensus.cc:2764] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:10.322312 22425 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:10.239502 27414 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:10.263262 27200 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:10.241168 27373 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:08:10.329651 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 71710.8us
I20260709 13:08:10.242151 27066 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.263597 27078 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.246703 27172 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.239982 27284 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:10.338999 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.346495 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:10.348133 22473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.303910 27174 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.253005 27372 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:08:10.361770 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.349376 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:10.364331 22578 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 16: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:08:10.365077 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 101985us
I20260709 13:08:10.365959 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.368237 22546 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.369603 22546 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.369666 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:10.370668 22581 raft_consensus.cc:2393] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 7: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:10.372870 27177 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.373713 27177 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:10.374087 27177 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.374397 27177 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.378082 27172 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.378630 27078 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.379733 27066 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:10.380703 27443 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:08:10.385918 27177 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.388164 27177 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.378319 22546 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.363117 26897 consensus_queue.cc:1059] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:08:10.390842 22546 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.391055 27354 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:10.392081 22331 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43174 (request call id 256) took 13682 ms (client timeout 15000 ms). Trace:
I20260709 13:08:10.392290 27078 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.392951 27078 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.392011 22546 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.393226 22329 catalog_manager.cc:5697] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:10.395211 27445 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:10.396554 27448 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:08:10.397096 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.398084 27291 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:10.398479 27291 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:10.399246 27291 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.389488 22472 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:10.317500 27224 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:08:10.407955 22582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:08:10.410248 22582 raft_consensus.cc:606] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.380187 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.410722 22582 raft_consensus.cc:614] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:10.404207 22329 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 11 to 13, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.422556 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.423589 22329 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 7 to 10, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 10 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.422639 22396 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:10.416054 27354 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.331684 27414 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.378400 27403 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.424208 22581 raft_consensus.cc:2468] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:08:10.400452 27291 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.428536 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:10.410501 22331 rpcz_store.cc:269] 0709 13:07:56.709229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.717681 (+  8452us) service_pool.cc:224] Handling call
0709 13:08:10.392005 (+13674324us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:05.458127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:05.556403 (+ 98276us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:05.556455 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:08:05.556490 (+    35us) tablet.cc:662] Decoding operations
0709 13:08:05.557977 (+  1487us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:05.558075 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:05.558101 (+    26us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:08:05.559379 (+  1278us) tablet.cc:701] Row locks acquired
0709 13:08:05.559426 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:08:05.559612 (+   186us) write_op.cc:270] Start()
0709 13:08:05.559760 (+   148us) write_op.cc:276] Timestamp: P: 1783602485559540 usec, L: 0
0709 13:08:05.559784 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:05.594781 (+ 34997us) log.cc:844] Serialized 7112 byte log entry
0709 13:08:06.077249 (+482468us) op_driver.cc:464] REPLICATION: finished
0709 13:08:06.153436 (+ 76187us) write_op.cc:301] APPLY: starting
0709 13:08:06.153579 (+   143us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:06.259354 (+105775us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:06.259478 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:06.628097 (+368619us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:06.628389 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:08:06.628440 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:06.628850 (+   410us) log.cc:844] Serialized 164 byte log entry
0709 13:08:06.641201 (+ 12351us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.656271 (+ 15070us) write_op.cc:454] Released schema lock
0709 13:08:06.656329 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:06.656863 (+   534us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.656905 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1768833,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":75870,"apply.run_cpu_time_us":25843,"apply.run_wall_time_us":503278,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79439,"num_ops":18,"prepare.queue_time_us":81199,"prepare.run_cpu_time_us":14247,"prepare.run_wall_time_us":268155,"raft.queue_time_us":249473,"raft.run_cpu_time_us":11999,"raft.run_wall_time_us":65915,"replication_time_us":511124,"thread_start_us":396366,"threads_started":4,"wal-append.queue_time_us":145577,"wal-append.run_cpu_time_us":21062,"wal-append.run_wall_time_us":1918877}]]}
I20260709 13:08:10.430461 27155 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.431082 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.415654 26757 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.401427 27415 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.435256 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:10.436259 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.416774 27342 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.445544 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.446081 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.446673 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.447359 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.440618 22577 raft_consensus.cc:2393] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 13: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:10.440975 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:10.448585 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.449141 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:10.442380 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.449793 22579 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:10.452215 22579 raft_consensus.cc:1240] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:10.455377 22508 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:10.457984 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.458680 22504 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:08:10.459522 22581 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:10.450158 22329 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 7 to 11, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:10.449790 27203 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:10.424249 27375 consensus_queue.cc:1059] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:10.465888 27203 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.466876 27375 raft_consensus.cc:3055] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:10.467275 27375 raft_consensus.cc:740] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:10.467908 27284 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.449988 26746 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:10.468705 26746 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:10.469131 26746 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.433153 27354 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.475888 27354 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:10.450393 27342 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.477097 27342 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.468071 27375 consensus_queue.cc:260] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.480185 27375 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.490895 27155 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:10.491519 27155 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.493822 27155 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.459187 27292 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:10.496858 27203 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:10.500308 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.498363 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.501268 22579 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:10.501030 22424 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:10.503931 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:10.498160 22399 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.208.3:40903 timed out after 1.554s (SENT) [suppressed 7 similar messages]
I20260709 13:08:10.505870 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.510041 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.507895 22329 catalog_manager.cc:5697] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.513743 22430 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 16.
I20260709 13:08:10.519465 22545 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:10.519776 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:10.520727 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.522223 22579 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:08:10.524516 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.525717 22329 catalog_manager.cc:5697] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:10.529057 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94be7e6c95554db88c30fee7a3db405f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:10.529966 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:10.530853 22581 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:10.534639 22579 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.536847 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.545478 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:10.551429 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.553788 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.532460 27177 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:10.579151 27177 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.579550 27177 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:10.518322 27414 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:10.527015 27317 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:10.509086 27292 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.584793 27317 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.527582 27403 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.607784 22547 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.609267 22547 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.610275 22547 leader_election.cc:304] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.532994 27284 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:08:10.608031 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.642616 22581 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:10.641569 22579 raft_consensus.cc:1813] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Handling vote request from an unknown peer e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.648656 22579 raft_consensus.cc:2410] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:10.642360 22329 catalog_manager.cc:5697] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
W20260709 13:08:10.654143 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.654810 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.657532 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.598261 27444 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:10.642426 27415 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:10.662696 22329 catalog_manager.cc:5697] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 6 to 12, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 12 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:10.642968 27447 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.641377 27405 raft_consensus.cc:2749] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:10.681666 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.682710 22581 raft_consensus.cc:2393] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:10.682435 27174 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.683826 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.687987 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.688593 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.701292 22329 catalog_manager.cc:5697] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 10 to 11, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 11 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:10.707525 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.708988 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.710538 27292 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.710521 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.711594 27317 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.712379 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.734622 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.735684 27317 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:10.598460 27403 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.741379 27403 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.742846 22546 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:10.748294 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.749943 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.701311 27452 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:08:10.716527 22474 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.642168 27427 consensus_queue.cc:1059] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:08:10.705693 22329 catalog_manager.cc:5697] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 10 to 12, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 12 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:10.768317 22546 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:10.773104 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 56698.5us
I20260709 13:08:10.749943 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:10.753212 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 62841.3us
I20260709 13:08:10.759819 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:10.760852 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.762066 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.762247 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.760269 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:10.603578 26746 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.774786 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.788841 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.789597 22428 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:10.790207 22329 catalog_manager.cc:5697] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:10.796221 27200 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:10.796838 27200 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:10.797241 27200 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.802460 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.802820 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:10.784657 27155 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.777215 22431 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:10.807303 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:08:10.807969 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.810232 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:10.675871 27444 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:10.810515 23079 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:10.823343 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 48606.9us
I20260709 13:08:10.807340 22329 catalog_manager.cc:5697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 8 to 10, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 10 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.825958 22474 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.704360 26757 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.833693 27174 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:10.835845 22474 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.846053 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.819942 27415 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:10.854173 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.803510 27353 consensus_queue.cc:1059] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:08:10.859181 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 361023us
I20260709 13:08:10.829459 27452 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.831235 27432 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:10.885658 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63445.6us
I20260709 13:08:10.847743 27451 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.894064 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:10.868958 27337 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.825071 27342 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.917371 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.869902 27353 consensus_queue.cc:1243] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer 10c2f471167442c0b75d8cd50ed8c40c log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:10.869647 27415 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:10.925662 22472 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:08:10.926661 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 90875.8us
I20260709 13:08:10.929147 22474 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:10.924635 22546 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.934077 22546 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.935753 22501 raft_consensus.cc:2368] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:10.936883 27342 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:10.937361 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:10.938482 27342 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.938941 27342 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.939289 27342 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.942112 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.942699 27405 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.945547 27403 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.946045 27433 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.946372 27452 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.946879 27452 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.947688 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:10.926934 27447 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.948583 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:10.949716 27353 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.950536 27444 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:10.946815 22426 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:10.938488 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:10.951030 27426 raft_consensus.cc:3055] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:10.971836 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:10.974581 22431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:10.976683 22431 raft_consensus.cc:606] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.976665 22426 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.962270 27353 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:10.963639 27291 consensus_meta.cc:287] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
W20260709 13:08:10.981623 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 47624.1us
I20260709 13:08:10.934765 27177 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.984678 22578 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:10.982968 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:10.988067 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 101543us
I20260709 13:08:10.988933 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.950414 27415 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.989573 27200 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:10.991917 27200 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:10.992847 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:10.993974 22508 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:10.997442 22505 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:10.976308 27426 raft_consensus.cc:740] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:11.002709 22546 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:11.005609 22546 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.007498 22546 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:10.998461 27317 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.015321 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
W20260709 13:08:11.055285 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 71152.9us
W20260709 13:08:11.057926 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44038.7us
I20260709 13:08:11.035261 22546 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.000504 27291 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.060554 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:11.114360 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 54883.3us
I20260709 13:08:11.115734 22546 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.059967 22398 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:11.116852 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 56981.9us
I20260709 13:08:11.012696 26897 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:11.086709 27405 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:11.138790 27462 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:08:11.089584 27470 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:11.135442 27444 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.153364 27155 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.115839 27426 consensus_queue.cc:260] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:11.155925 27426 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.136731 27405 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:11.012924 27403 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.134549 27292 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:11.174949 22398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.002589 26746 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:11.008683 27447 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.095553 22426 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 16.
I20260709 13:08:11.141475 26897 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:11.163225 27291 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.166236 27405 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:11.183495 22472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.202988 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 140993us
I20260709 13:08:11.215204 22545 leader_election.cc:400] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:11.243763 27451 raft_consensus.cc:3055] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:11.180065 27345 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:11.181730 26897 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.244249 27337 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.250562 27292 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:11.253383 27177 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:11.256249 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:11.259581 22547 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:11.260655 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 2249) took 1009 ms. Trace:
I20260709 13:08:11.250685 27345 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.166574 27470 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:11.244261 27451 raft_consensus.cc:740] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:11.266975 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:08:11.268747 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 153074us
W20260709 13:08:11.272305 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 213704us
I20260709 13:08:11.273602 22575 rpcz_store.cc:276] 0709 13:08:10.250946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.251102 (+   156us) service_pool.cc:224] Handling call
0709 13:08:10.251399 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.417601 (+166202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.417632 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.417679 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:10.417710 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.260387 (+842677us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400046d54. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce22e01 00007f006ce2183e 00007f0071de6419 00007f006b35dbd4 00007f006b35db62 00007f006b35da91 00007f006b35da0c 00007f006b35ccc2 00007f006b15d48c 00007f006b15c8c6
0709 13:08:11.260437 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.260593 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381791104}
I20260709 13:08:11.278357 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:11.284089 22547 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.284974 27479 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:11.286936 27479 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:11.288700 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.289577 22426 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:11.289922 27447 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:11.290421 27447 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.291643 27203 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.293416 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:11.294734 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:11.295032 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:11.297766 22574 raft_consensus.cc:1240] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:11.306411 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:11.307188 22578 raft_consensus.cc:2368] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8.
I20260709 13:08:11.308386 22577 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:11.276556 27427 consensus_queue.cc:1059] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:08:11.280537 27284 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:11.307648 27414 consensus_queue.cc:1059] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:08:11.331604 22399 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.334744 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:11.337007 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.338923 22399 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:11.336108 27475 log.cc:927] Time spent T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.131s	user 0.001s	sys 0.001s
I20260709 13:08:11.325289 27155 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:08:11.364715 27414 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:11.365309 27414 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.338830 27221 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:11.340070 27427 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:08:11.334774 27447 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:11.356618 22504 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:11.358397 27470 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:11.382694 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:11.339183 27177 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:11.359661 27342 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.397392 27342 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:11.398770 26897 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.379726 27221 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:11.328138 27451 consensus_queue.cc:260] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.401305 27451 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.403901 27380 raft_consensus.cc:3055] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:11.351779 27405 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.404407 27380 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:11.405122 27427 consensus_queue.cc:1059] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:11.405314 27380 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.406126 27405 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:11.406730 27467 consensus_queue.cc:1175] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "10c2f471167442c0b75d8cd50ed8c40c" responder_term: 13 status { last_received { term: 11 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 12. Current term is 13. Ops: [12.8-12.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:11.400916 27221 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.369396 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:11.352764 26862 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.379593 27203 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.386559 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:11.414049 22578 raft_consensus.cc:1813] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Handling vote request from an unknown peer e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.414649 22578 raft_consensus.cc:2410] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:08:11.414703 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 74291.9us
I20260709 13:08:11.365217 27155 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:11.392361 27365 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.394552 27414 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:11.410451 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:11.429080 22399 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.395967 27345 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:11.416606 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:11.431579 22505 raft_consensus.cc:2368] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:11.421653 26897 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:11.423740 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:11.387156 22546 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.406793 27380 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.436641 22545 leader_election.cc:400] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:11.436878 22502 raft_consensus.cc:2368] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:11.436965 22545 leader_election.cc:403] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:08:11.438174 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 51116.7us
I20260709 13:08:11.440006 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:11.440346 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:11.441514 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:11.423236 27155 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:11.443114 27345 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:11.443029 27155 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.444550 27155 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.450464 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:11.452617 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:11.455562 27150 raft_consensus.cc:2764] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:11.440898 22474 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:11.452401 26862 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.457269 22431 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:11.461465 22399 leader_election.cc:400] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 7 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8.
I20260709 13:08:11.467427 22545 leader_election.cc:400] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:11.467811 22545 leader_election.cc:403] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:11.468014 22546 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:11.469807 22425 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:11.473120 22430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34614 (request call id 618) took 1318 ms. Trace:
W20260709 13:08:11.474581 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.473538 22430 rpcz_store.cc:276] 0709 13:08:10.146782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.146930 (+   148us) service_pool.cc:224] Handling call
0709 13:08:11.464929 (+1317999us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b540043c954. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:08:11.465027 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624581504}
I20260709 13:08:11.463649 27177 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.456807 27485 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.492650 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:11.495154 22424 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.493026 22429 raft_consensus.cc:1240] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 14. Current term is 16. Ops: []
I20260709 13:08:11.496218 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:11.496829 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:11.496927 22433 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:08:11.496559 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:11.502617 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:11.503243 22433 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.504391 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:11.475390 27363 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:11.481271 26897 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:11.514233 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:11.515422 22578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:08:11.479669 27403 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.506276 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:11.519822 22580 raft_consensus.cc:2376] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14. Re-sending same reply.
I20260709 13:08:11.505862 22574 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:11.506345 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:11.487067 27356 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:11.517856 22576 raft_consensus.cc:2393] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 16: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:11.518872 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:11.525620 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:11.525061 23077 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.490692 27406 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:08:11.527064 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:11.527415 23077 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.531308 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:11.529876 22472 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:11.533393 22499 raft_consensus.cc:2468] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 15.
I20260709 13:08:11.530892 22424 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:11.544355 22472 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:11.552826 22433 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:11.500597 27452 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:11.545568 27364 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.555280 27364 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:11.532294 27356 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.552953 27476 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:11.548848 27365 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:11.557278 27476 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:11.534029 27468 raft_consensus.cc:2804] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:11.558475 27468 raft_consensus.cc:697] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:11.549147 27373 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:11.562399 27373 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.562722 27356 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:11.570381 27314 raft_consensus.cc:3055] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:11.570937 27314 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:11.572939 22399 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.571782 27314 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.577013 27364 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:11.577422 27314 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.578456 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:11.562774 27373 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:11.583266 27468 consensus_queue.cc:237] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:11.592386 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 94608.6us
I20260709 13:08:11.558274 27476 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:11.616981 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 55938.4us
I20260709 13:08:11.619859 22399 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.621189 22399 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.622253 27290 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:11.622583 27493 consensus_queue.cc:1059] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:11.623020 27290 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:11.626426 22499 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49792 (request call id 696) took 1737 ms (client timeout 2062 ms). Trace:
W20260709 13:08:11.626916 22499 rpcz_store.cc:269] 0709 13:08:09.886527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.886681 (+   154us) service_pool.cc:224] Handling call
0709 13:08:11.623838 (+1737157us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54001851d4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:08:11.623971 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3784569728}
I20260709 13:08:11.638236 22499 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:11.650620 23111 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:11.652061 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:11.629679 27348 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.655539 27452 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:11.656898 27150 raft_consensus.cc:3055] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:11.657393 27150 raft_consensus.cc:740] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:11.658238 27150 consensus_queue.cc:260] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.659195 27150 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.661263 27478 raft_consensus.cc:3055] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:11.661734 27478 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:11.630239 27221 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.656713 27452 raft_consensus.cc:3055] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:11.665802 22577 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:11.666213 22499 pending_rounds.cc:85] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 6
I20260709 13:08:11.688941 22499 pending_rounds.cc:107] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:11.689348 22499 raft_consensus.cc:2889] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:11.667090 23077 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.667268 22472 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:11.662611 27478 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.675181 27373 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.678673 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:11.684121 22503 raft_consensus.cc:1240] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:11.703914 22472 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
W20260709 13:08:11.704159 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 78678.2us
I20260709 13:08:11.706285 22574 raft_consensus.cc:1240] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:08:11.742543 27314 consensus_queue.cc:1175] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" responder_term: 11 status { last_received { term: 10 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:11.684931 27177 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:11.688700 27452 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:11.694703 27346 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.742683 27291 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:11.786486 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 81329.1us
I20260709 13:08:11.742493 27467 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:11.816985 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:11.820063 22432 raft_consensus.cc:1240] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:11.822927 22431 raft_consensus.cc:2393] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 16: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
W20260709 13:08:11.823796 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 108464us
I20260709 13:08:11.813488 27478 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.845439 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:11.851778 22399 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.848156 27177 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:11.855063 27221 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:11.829066 27467 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:11.841876 27340 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:11.864140 22578 raft_consensus.cc:606] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.867522 22578 raft_consensus.cc:614] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:11.850422 27468 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.864862 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:11.841344 27403 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12.
I20260709 13:08:11.815358 27452 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:11.871115 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 167307us
I20260709 13:08:11.863714 27408 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:11.868122 27495 log.cc:927] Time spent T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:11.881099 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:11.855209 27177 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.876915 26746 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.890419 27373 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:11.891461 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:11.879269 27340 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:11.897548 27371 consensus_queue.cc:1059] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:11.902355 27340 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.902281 27371 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:11.876435 27468 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:11.930882 27290 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:11.922816 27371 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:11.897485 27408 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:11.983040 27408 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.988368 27177 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:11.942250 27371 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.917740 27342 raft_consensus.cc:3060] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.989635 27371 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.917508 27467 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:11.962409 27452 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.988574 27468 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.008580 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:11.973666 27303 raft_consensus.cc:993] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:12.019901 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:12.022416 22578 raft_consensus.cc:2410] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:08:12.013914 27499 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
I20260709 13:08:12.019917 27303 raft_consensus.cc:1081] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Signalling peer e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:12.034216 22578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:08:12.007383 27177 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:12.034909 22578 raft_consensus.cc:606] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:12.035262 22578 raft_consensus.cc:614] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:12.042948 22428 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:12.050694 22500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:58706
I20260709 13:08:12.052121 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.053035 22428 raft_consensus.cc:2410] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:12.012050 27155 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:12.057996 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:12.058671 22431 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.064602 27177 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.071039 27177 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:12.078002 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.090601 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:12.100765 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44988.9us
I20260709 13:08:12.101508 22399 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:12.104434 22431 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 17.
W20260709 13:08:12.106698 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 46209us
I20260709 13:08:12.115152 22578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:08:12.115824 22578 raft_consensus.cc:606] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:12.103708 27342 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.066218 27317 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:08:12.066359 27155 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.124702 22504 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:12.125481 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:12.125933 22500 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:12.126327 22500 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.127327 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:12.130360 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:12.131031 22578 raft_consensus.cc:3060] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.115689 27406 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.150604 23077 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:12.155471 22472 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:12.160784 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49188 (request call id 2270) took 1715 ms. Trace:
I20260709 13:08:12.161542 27354 raft_consensus.cc:2804] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:12.162120 27354 raft_consensus.cc:697] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:08:12.163852 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 50322.5us
I20260709 13:08:12.161229 22582 rpcz_store.cc:276] 0709 13:08:10.445713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.445875 (+   162us) service_pool.cc:224] Handling call
0709 13:08:10.503885 (+ 58010us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.504299 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:10.747363 (+243064us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b48002601d8. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0071d4baa1 00007f0071d42b37 00007f0071d429ca 00007f0071e3a26f 00007f0071e39f37 00007f0071e4e55c 00007f0071e4e508 00007f0071e4e488 00007f0071e4e443 00007f0071e4d6ec 00007f0070d77a96
0709 13:08:11.314236 (+566873us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b18003e6fe0. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d17e07 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f007081a3c7 00007f006ce2c9a7 00007f006ce3c0bf 00007f006ce3c038
0709 13:08:11.415255 (+101019us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.862779 (+447524us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.863293 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.863417 (+   124us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:11.863627 (+   210us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.864038 (+   411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.864453 (+   415us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.160546 (+296093us) raft_consensus.cc:1685] finished
0709 13:08:12.160568 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.160719 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20050,"prepare.queue_time_us":332272,"prepare.run_cpu_time_us":165,"prepare.run_wall_time_us":12742,"raft.queue_time_us":4386,"raft.run_cpu_time_us":6849,"raft.run_wall_time_us":241252,"spinlock_wait_cycles":49939072,"thread_start_us":536366,"threads_started":2,"wal-append.queue_time_us":498566}
I20260709 13:08:12.153290 27345 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.166994 27430 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:08:12.162972 27354 consensus_queue.cc:237] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.181908 27155 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:12.184108 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:08:12.187810 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48421.1us
I20260709 13:08:12.190817 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:12.194300 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:12.204308 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 51789.4us
I20260709 13:08:12.204253 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.205688 22578 raft_consensus.cc:2468] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 17.
I20260709 13:08:12.209189 27485 raft_consensus.cc:993] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: : Instructing follower e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:12.209818 27485 raft_consensus.cc:1081] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Signalling peer e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:12.212432 22504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:58708
I20260709 13:08:12.213017 22504 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:12.213308 22504 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.215634 27473 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.216756 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:12.217696 27317 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.220199 27200 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.220784 27200 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.222913 27200 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.231563 22425 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:12.233033 22431 raft_consensus.cc:1275] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:12.240720 22507 raft_consensus.cc:1275] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:12.238703 22546 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:12.245887 26757 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.245954 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:12.252912 27200 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.253545 27200 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.255229 27174 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:12.255844 27200 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:12.246954 27472 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.258543 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:12.261014 22431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51860
I20260709 13:08:12.247269 22575 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:12.246471 26757 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.261624 22431 raft_consensus.cc:606] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Received request to transfer leadership
I20260709 13:08:12.263404 26757 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.269017 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:12.269683 22502 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:12.270145 22500 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.273240 22431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51860
I20260709 13:08:12.274657 22431 raft_consensus.cc:606] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Received request to transfer leadership
I20260709 13:08:12.272611 22396 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:12.280143 22474 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:12.281236 27371 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.281737 27371 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.282171 27371 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.283653 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:12.284049 27290 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.284317 23111 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.284605 27290 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.287617 27290 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.291239 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.292841 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:12.293068 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.293558 22428 raft_consensus.cc:3055] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:12.293749 22431 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 16.
I20260709 13:08:12.296002 22500 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:12.296974 22325 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 9 to 12, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 12 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:12.299384 22325 catalog_manager.cc:5697] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:12.293960 22428 raft_consensus.cc:740] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:12.301427 22428 consensus_queue.cc:260] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.302786 22428 raft_consensus.cc:3060] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.307682 23111 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:12.301076 22325 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:12.316195 27290 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.325723 22428 raft_consensus.cc:2468] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:12.326244 27507 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.326457 22473 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:12.331130 27507 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.331712 27354 raft_consensus.cc:2804] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:12.236238 22504 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.332499 27354 raft_consensus.cc:697] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:12.333564 27354 consensus_queue.cc:237] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:12.334383 22329 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33176 (request call id 266) took 12053 ms (client timeout 15000 ms). Trace:
I20260709 13:08:12.334681 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:12.338286 22504 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.344079 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:12.344812 22575 raft_consensus.cc:3055] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:12.345148 22575 raft_consensus.cc:740] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:12.345952 22575 consensus_queue.cc:260] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.347055 22575 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.362846 27174 consensus_queue.cc:1048] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:12.364001 27203 raft_consensus.cc:993] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:12.364595 27221 raft_consensus.cc:1081] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:12.364362 27174 consensus_queue.cc:1048] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:12.373878 27472 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:12.374660 27472 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.376303 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:12.334403 27507 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:12.380115 27472 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:12.380628 22432 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 14: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:12.381338 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:12.382278 22508 raft_consensus.cc:2393] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:12.384774 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.385591 22432 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:08:12.386960 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:12.388046 27290 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.389662 27472 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:12.390158 27472 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:12.390573 27472 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.375227 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:12.392138 22579 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:12.392086 22575 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:12.394275 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.401862 22432 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:08:12.408373 27452 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:12.410310 22474 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:12.411975 27354 raft_consensus.cc:2804] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:12.410617 27452 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:12.398355 27371 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.415050 27452 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.415722 27472 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.420550 27371 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.414283 27354 raft_consensus.cc:697] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:12.421104 27472 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:12.422204 27354 consensus_queue.cc:237] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.430022 27452 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.432796 27452 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:12.467156 22316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 189589us
I20260709 13:08:12.327540 22325 catalog_manager.cc:5697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:12.336829 22329 rpcz_store.cc:269] 0709 13:08:00.281287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.281478 (+   191us) service_pool.cc:224] Handling call
0709 13:08:12.334322 (+12052844us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:11.209186 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:11.232671 (+ 23485us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:11.232713 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:08:11.232732 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:11.233792 (+  1060us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:11.233878 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:11.233907 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:08:11.234916 (+  1009us) tablet.cc:701] Row locks acquired
0709 13:08:11.234931 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:08:11.235101 (+   170us) write_op.cc:270] Start()
0709 13:08:11.235219 (+   118us) write_op.cc:276] Timestamp: P: 1783602491235048 usec, L: 0
0709 13:08:11.235240 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:11.235904 (+   664us) log.cc:844] Serialized 4853 byte log entry
0709 13:08:11.546266 (+310362us) op_driver.cc:464] REPLICATION: finished
0709 13:08:11.783267 (+237001us) write_op.cc:301] APPLY: starting
0709 13:08:11.783356 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:11.814847 (+ 31491us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:11.814943 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:12.072199 (+257256us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:12.072450 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:08:12.100607 (+ 28157us) write_op.cc:312] APPLY: finished
0709 13:08:12.137948 (+ 37341us) log.cc:844] Serialized 113 byte log entry
0709 13:08:12.145712 (+  7764us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.152862 (+  7150us) write_op.cc:454] Released schema lock
0709 13:08:12.187041 (+ 34179us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:12.219137 (+ 32096us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.219169 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2157268,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":228750,"apply.run_cpu_time_us":18583,"apply.run_wall_time_us":416285,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54335,"num_ops":12,"prepare.queue_time_us":208028,"prepare.run_cpu_time_us":18052,"prepare.run_wall_time_us":120338,"raft.queue_time_us":50649,"raft.run_cpu_time_us":9821,"raft.run_wall_time_us":203119,"replication_time_us":270712,"thread_start_us":244507,"threads_started":4,"wal-append.queue_time_us":100671}]]}
I20260709 13:08:12.486238 22503 raft_consensus.cc:1240] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:12.489845 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:12.491008 22425 raft_consensus.cc:3060] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.388974 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:12.494930 22500 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 14: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:12.504693 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:12.505472 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:12.506429 22575 raft_consensus.cc:3060] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.512673 27342 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.513768 27342 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.514825 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:12.517365 27342 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.523465 27346 consensus_queue.cc:1059] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:12.517129 22427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51860
I20260709 13:08:12.476048 22325 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 13 to 16, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 16 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:12.539355 22325 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 10 to 12, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 12 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.533479 22427 raft_consensus.cc:606] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Received request to transfer leadership
I20260709 13:08:12.541080 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:12.544625 22578 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:12.540977 27346 raft_consensus.cc:3055] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:12.561371 22474 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:12.557662 27346 raft_consensus.cc:740] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:12.578794 27346 consensus_queue.cc:260] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.581246 27200 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.583222 27200 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.586860 22502 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.593108 22325 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 12 to 14, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 14 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:12.599745 27200 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.613196 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:12.614522 22504 raft_consensus.cc:2393] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 10: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:12.618556 22579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:08:12.619277 23077 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:12.619556 22579 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:12.620178 22579 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.622591 27174 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.622895 22578 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:12.622913 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:12.608696 27346 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.624689 27174 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.640033 27174 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.645145 22425 raft_consensus.cc:2468] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:12.658619 22575 raft_consensus.cc:2468] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:12.660025 22474 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:12.661242 27452 raft_consensus.cc:2804] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:12.657859 22325 catalog_manager.cc:5697] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 8 to 11, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:12.629572 27342 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:08:12.662758 27452 raft_consensus.cc:697] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:12.733443 22502 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:12.739198 22582 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:12.746054 27354 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:12.750911 27408 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:08:12.754753 27363 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.760666 27371 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:12.762521 27371 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.755492 27363 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.765290 27363 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.767546 27371 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:12.772751 27354 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:12.773772 22431 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 10.
I20260709 13:08:12.780198 27473 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.779814 27354 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.780795 27473 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.783087 27354 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.778265 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:12.788024 22579 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.797187 22573 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:12.797878 22582 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:12.802520 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:12.803501 22578 raft_consensus.cc:2393] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 11: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:12.812711 27174 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.815377 27174 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:12.728802 22325 catalog_manager.cc:5697] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 5 to 13, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 13 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.761790 27452 consensus_queue.cc:237] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.825681 22325 catalog_manager.cc:5697] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:12.826684 23077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.828560 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:12.829720 27473 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:12.832592 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:12.833220 23110 raft_consensus.cc:2368] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:08:12.835094 22473 leader_election.cc:400] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:08:12.835148 22399 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:12.835536 22473 leader_election.cc:403] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.836323 27221 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.836601 27467 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.840677 22579 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:12.845230 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:12.846817 27473 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:12.840091 22325 catalog_manager.cc:5697] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 6 to 9, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 9 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.847707 27473 raft_consensus.cc:697] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:12.831833 27200 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.849679 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:12.849932 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.850319 23110 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.848901 27473 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.833352 23111 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:08:12.858212 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:12.857724 22547 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:12.867417 22428 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:08:12.867906 27354 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.869354 23110 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:12.867496 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:12.873116 22431 raft_consensus.cc:3055] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:12.873847 22431 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:12.870193 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:12.867707 27472 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:12.879426 27472 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.879878 27472 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.868607 27354 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.885641 27354 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.875062 27371 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:08:12.875259 22431 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.898784 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:12.901585 27467 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:08:12.914978 22432 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:12.910724 27200 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.915992 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:12.916795 22507 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.919579 27153 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.924750 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:12.926843 22503 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:12.925979 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:12.931320 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 61212.2us
I20260709 13:08:12.913093 27342 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:12.933670 22427 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:12.934190 27342 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:12.934748 27342 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.935104 22325 catalog_manager.cc:5697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 12 to 13, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 13 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.936821 22425 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:12.942061 22431 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.942883 22428 raft_consensus.cc:2393] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 14: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:12.920341 27153 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.947237 27153 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:12.949658 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:12.950402 22575 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:12.952775 27342 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:12.955425 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:12.959702 22579 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.956446 22575 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:12.964300 22425 raft_consensus.cc:1275] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 17 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:12.966645 23110 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:12.958819 22474 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:12.977818 27200 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.978229 27200 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.978582 27200 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.972100 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:12.972350 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.973747 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.937973 22325 catalog_manager.cc:5697] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 4 to 8, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 8 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:12.974851 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:12.956372 22507 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:12.982132 22424 raft_consensus.cc:3060] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.975610 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.977610 27363 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:12.969066 27472 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.985461 22579 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:12.977470 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:12.987831 22429 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:12.988590 22545 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:12.989570 27479 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:12.989476 27354 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:12.990233 27479 raft_consensus.cc:697] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:12.991228 27479 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:12.991942 22426 raft_consensus.cc:1275] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:12.992990 22427 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:12.994771 22325 catalog_manager.cc:5697] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 3 to 7, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 6 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:12.998446 22424 raft_consensus.cc:2468] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:13.006166 22575 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:13.003872 22427 raft_consensus.cc:1275] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:13.006738 22432 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:13.004348 27153 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:13.007472 27153 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:13.001955 27342 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:13.014338 22503 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:13.015244 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:13.016178 23111 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 14: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:13.017607 27153 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:13.019326 22431 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:13.020323 23076 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:13.021559 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:13.022203 22573 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.021653 27174 raft_consensus.cc:2804] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:13.025039 27174 raft_consensus.cc:697] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:13.025593 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:13.026271 22503 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:13.026005 27174 consensus_queue.cc:237] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:13.032620 22472 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:13.044512 22573 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:08:13.052263 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:13.053009 22427 raft_consensus.cc:3060] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.044342 27528 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:13.057031 27200 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.060808 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:13.061231 27342 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:13.062568 27524 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:13.064815 27528 consensus_queue.cc:1048] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:13.069772 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:13.076779 22578 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:08:13.039535 27153 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:08:13.073817 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:13.072715 27354 consensus_queue.cc:1048] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 13:08:13.085003 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48016.1us
I20260709 13:08:13.087559 22474 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:13.089205 27478 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:13.089522 22379 auto_rebalancer.cc:893] Removing replace marker failed: Replica e32ba8e6132b4f8e98a99066b6fffe05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:13.090257 27478 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:13.090590 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:08:13.093245 22379 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f4d35c45e33c4336b33461cdbe7f7b6f already in progress
I20260709 13:08:13.098716 22502 raft_consensus.cc:2393] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:08:13.098604 22379 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f4d35c45e33c4336b33461cdbe7f7b6f already in progress
I20260709 13:08:13.098307 27478 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.102852 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:13.103477 22425 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.089148 27528 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:13.107340 27528 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:13.107811 27528 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.111289 27452 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:13.121009 22427 raft_consensus.cc:2468] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:13.133312 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:13.136312 22425 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
I20260709 13:08:13.137544 27484 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:13.093957 27354 raft_consensus.cc:2804] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.138103 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:13.143592 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:13.161077 23111 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.140995 27452 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:13.093524 27342 consensus_queue.cc:1048] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:13.138397 27472 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:13.175014 22546 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:13.163764 27354 raft_consensus.cc:697] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:08:13.184151 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.187438 27155 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.187131 27452 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:13.187855 27533 log.cc:927] Time spent T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:08:13.190963 27354 consensus_queue.cc:237] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.216713 27371 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:13.217360 27371 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.188032 27155 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:13.222177 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 105768us
I20260709 13:08:13.226485 27371 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:13.234510 27540 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:13.234591 27492 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:13.235747 27492 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:13.236732 27492 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.238128 27492 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.257929 27155 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:13.260057 27528 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.266384 23111 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
W20260709 13:08:13.275573 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 102427us
W20260709 13:08:13.295838 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 68823.3us
I20260709 13:08:13.260057 27200 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:13.298512 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 123597us
I20260709 13:08:13.236646 27478 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:13.300729 27478 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:13.303869 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:13.304646 22431 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:13.304951 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:13.311628 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:13.296921 27540 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:13.317739 27473 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.354609 22503 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:13.362082 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:13.362843 22576 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.378046 22577 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:13.389230 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:13.393196 22396 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:13.409854 22433 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:13.421205 27550 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.422050 27550 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:13.423211 27550 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:13.403690 27540 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:13.436609 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:13.437386 22499 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:13.445416 27472 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.445971 27472 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.446367 27472 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.460759 27528 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:13.378821 27473 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:13.464628 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 82273us
I20260709 13:08:13.468556 22503 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:13.495378 22576 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:13.509377 22503 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:13.514863 22579 raft_consensus.cc:2393] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 8: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:08:13.515987 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 203638us
I20260709 13:08:13.521204 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:13.508664 27354 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:08:13.523542 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 134420us
I20260709 13:08:13.561854 22474 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:13.564370 27555 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.564929 27555 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.565281 27555 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.568583 27561 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.569284 27561 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.571661 27561 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:13.576910 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:13.577993 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:13.578680 22430 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:08:13.580598 27548 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:08:13.595528 22472 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:13.607072 22427 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:13.607491 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:13.608124 22575 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 8.
I20260709 13:08:13.598889 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:13.617355 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 60376.6us
I20260709 13:08:13.611788 22504 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 7.
I20260709 13:08:13.649124 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
W20260709 13:08:13.653054 22397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.670221 22504 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:13.705554 27543 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:13.654006 27528 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:13.562927 27354 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:13.654500 27200 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.712724 27547 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.193s
I20260709 13:08:13.725729 22399 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
W20260709 13:08:13.730234 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 57483.4us
W20260709 13:08:13.747108 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 74708.7us
I20260709 13:08:13.719707 27528 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:13.725872 27200 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.758774 27528 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:13.785156 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 61289.6us
I20260709 13:08:13.779680 27473 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:13.800650 27560 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.801214 27560 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:13.803675 27560 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:13.805225 27558 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:08:13.799199 27303 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:13.815385 27303 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.815775 27303 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.820747 27542 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.821442 27542 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:13.836421 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 88341.9us
W20260709 13:08:13.837390 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 111733us
I20260709 13:08:13.839371 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:13.840260 23105 raft_consensus.cc:2393] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 14: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:13.847193 27303 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.853204 27555 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.856211 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:13.857472 22425 raft_consensus.cc:2393] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 9: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
W20260709 13:08:13.825971 27563 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:08:13.872531 27567 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.127s	user 0.000s	sys 0.003s
I20260709 13:08:13.885368 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:13.893460 23105 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:13.894729 27472 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.894872 22425 raft_consensus.cc:1275] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:13.895351 22433 raft_consensus.cc:2393] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:13.898238 27303 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:13.901288 27414 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.901594 27354 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:13.903379 27542 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:13.829583 27543 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:08:13.911077 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 258200us
I20260709 13:08:13.912993 27507 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:08:13.913120 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:13.913887 27414 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.914780 22502 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 17.
I20260709 13:08:13.915913 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:13.898228 27555 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:13.916239 27414 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:13.913556 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:13.926052 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:13.914983 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:13.907456 27472 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:13.935489 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:13.936156 22502 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 15.
I20260709 13:08:13.924650 27507 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.925917 27560 consensus_queue.cc:1048] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:13.932994 22431 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:13.933598 22425 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:13.934188 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:13.944334 22424 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:08:13.938731 27572 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:13.939580 27562 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:13.940793 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:13.947100 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:13.945035 22430 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:13.947767 22427 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:08:13.946405 27452 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:08:13.951175 27543 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.958834 27452 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:13.959182 27572 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:13.960938 22574 raft_consensus.cc:1275] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:13.947113 27562 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.961601 27562 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:13.962551 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:13.963315 22574 raft_consensus.cc:2368] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:08:13.966784 22472 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:13.961499 27572 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:13.972378 22396 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:13.979558 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:13.980232 22576 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.974913 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:13.957198 27507 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:13.970402 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:13.972357 27354 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:13.985333 27478 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.990218 22577 raft_consensus.cc:2393] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 12: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:13.991343 22472 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:13.993764 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:13.994635 22472 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:13.990149 27354 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:13.994365 22575 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 14.
I20260709 13:08:13.991798 27478 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.001061 27478 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.002835 27552 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:14.003446 27552 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:14.004374 27552 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:14.033912 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:13.969408 27452 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:13.991766 27200 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:14.038338 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:14.007855 27354 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.008191 27467 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:14.049110 27577 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:13.994637 27548 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:08:14.038421 27555 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.056108 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:14.056926 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:14.057160 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:14.057765 22504 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 14.
I20260709 13:08:14.045325 27467 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.059072 27467 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.062795 27562 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:14.063966 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:14.065282 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:14.068333 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:14.072322 23076 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:14.069722 22582 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:14.087080 22574 raft_consensus.cc:1275] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:14.088790 27581 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.052147 27478 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:14.070185 27507 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:14.091051 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:14.153098 27567 log.cc:927] Time spent T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:14.062947 27528 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:14.094692 27581 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.172444 22576 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:14.212703 22499 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.224161 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:14.224828 22504 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.240001 22474 leader_election.cc:400] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12.
I20260709 13:08:14.212558 27581 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.205624 27562 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:14.244640 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:14.201498 27478 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:14.198585 27528 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:14.336627 27580 consensus_queue.cc:1048] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:08:14.349820 23107 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:14.351240 27550 raft_consensus.cc:493] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:14.351886 27550 raft_consensus.cc:515] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:14.359234 22499 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 9.
I20260709 13:08:14.345516 27585 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:14.375898 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 131325us
I20260709 13:08:14.362365 27548 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:14.361502 27550 leader_election.cc:290] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:14.394665 22577 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:14.401822 27587 log.cc:927] Time spent T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:14.402312 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:14.403540 22576 raft_consensus.cc:2368] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9.
I20260709 13:08:14.373095 27573 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:08:14.386809 27543 consensus_queue.cc:1048] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:14.387013 27585 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:14.391695 27467 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:14.431427 27543 consensus_queue.cc:1243] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer 10c2f471167442c0b75d8cd50ed8c40c log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:14.453543 22506 raft_consensus.cc:2368] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 15. Current term is 16.
I20260709 13:08:14.485308 27585 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:14.486232 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 403832us
I20260709 13:08:14.491866 27581 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:14.494710 27581 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:14.498175 22399 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:14.508258 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:14.513818 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:14.515640 22576 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.513816 22505 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:14.518036 23111 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:14.518335 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:14.522485 23105 raft_consensus.cc:2368] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 17. Current term is 18.
I20260709 13:08:14.532187 22504 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 18.
I20260709 13:08:14.522120 27550 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:14.545815 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:14.546030 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:14.546608 22505 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.546783 22504 raft_consensus.cc:2368] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 17. Current term is 18.
I20260709 13:08:14.551100 27550 raft_consensus.cc:697] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:14.552171 27550 consensus_queue.cc:237] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:14.558753 22579 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:14.562299 22576 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 16.
W20260709 13:08:14.562948 27598 log.cc:927] Time spent T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:08:14.597841 22427 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:14.601788 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:14.585601 22474 leader_election.cc:400] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9.
I20260709 13:08:14.603252 22474 leader_election.cc:403] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.604318 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:14.605587 22427 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 16: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:14.600728 22576 pending_rounds.cc:85] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 7
I20260709 13:08:14.607069 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089498054d24ce99c46fe9be74f8589" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:14.607733 22431 raft_consensus.cc:3060] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.606139 22576 pending_rounds.cc:107] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:08:14.608698 22576 raft_consensus.cc:2889] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.608768 22428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:14.611378 22428 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.625370 22425 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:14.625893 22505 raft_consensus.cc:2468] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 15.
I20260709 13:08:14.635766 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:14.635859 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:14.639508 22581 raft_consensus.cc:2393] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 16: Already voted for candidate e32ba8e6132b4f8e98a99066b6fffe05 in this term.
I20260709 13:08:14.606382 27577 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 8. Current term is 9.
W20260709 13:08:14.644984 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 105109us
I20260709 13:08:14.652398 22431 raft_consensus.cc:2468] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 18.
I20260709 13:08:14.653234 23076 leader_election.cc:304] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:14.633946 27153 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:14.624500 27583 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:08:14.660768 27492 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:14.703364 27492 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:14.705614 27492 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:14.710680 22399 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:14.711582 27230 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:14.712149 27230 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:14.681456 27581 raft_consensus.cc:2804] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:08:14.731192 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 84513.9us
I20260709 13:08:14.746945 22430 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:14.686014 27484 consensus_queue.cc:1059] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
W20260709 13:08:14.752750 27354 consensus_meta.cc:287] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.004s
I20260709 13:08:14.689566 27153 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:14.750089 27581 raft_consensus.cc:697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:14.855849 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:14.713142 27230 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:14.859521 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 206377us
W20260709 13:08:14.854979 27607 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:08:14.768611 27492 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:08:14.903553 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 44640.7us
I20260709 13:08:14.905682 27150 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:14.906296 27150 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:14.913429 22398 leader_election.cc:400] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 17. Current term is 18.
I20260709 13:08:14.913821 22398 leader_election.cc:403] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.922344 27150 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:14.925828 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58706 (request call id 2402) took 1015 ms. Trace:
I20260709 13:08:14.926319 22499 rpcz_store.cc:276] 0709 13:08:13.910550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.910672 (+   122us) service_pool.cc:224] Handling call
0709 13:08:14.925670 (+1014998us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400218ed4. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f006cd8b571 00007f006ce262fa 00007f0071de7b17 00007f006b3626d4 00007f006b362662 00007f006b362591 00007f006b36250c 00007f006b3617c2 00007f006b15d48c 00007f006b15c8c6 00007f006b15c26f
0709 13:08:14.925773 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672627456}
I20260709 13:08:14.907460 27408 raft_consensus.cc:3055] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:14.930308 27408 raft_consensus.cc:740] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:14.931201 27408 consensus_queue.cc:260] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:14.861585 27546 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.289s
I20260709 13:08:14.933297 27492 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:14.935590 27492 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:14.932335 27408 raft_consensus.cc:3060] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.944036 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:14.946270 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:14.922833 27581 consensus_queue.cc:237] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:14.860432 27354 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:14.960848 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 52516.6us
W20260709 13:08:14.971302 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 287743us
I20260709 13:08:14.914824 27555 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:14.961915 27615 log.cc:927] Time spent T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:14.988137 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:14.990447 22503 raft_consensus.cc:1240] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:14.992647 23111 raft_consensus.cc:1240] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:15.002432 27153 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:15.003101 27153 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.003603 27153 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:15.004352 27204 raft_consensus.cc:2749] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 17. Current term is 18.
W20260709 13:08:15.005137 27606 log.cc:927] Time spent T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:08:15.006132 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:15.010314 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:15.014206 27575 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:15.020159 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 48118.2us
I20260709 13:08:15.021659 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:15.027074 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 418820us
I20260709 13:08:15.022984 22428 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:15.062335 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:15.064248 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.066459 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:15.071447 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 43623.4us
I20260709 13:08:14.993269 27555 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:15.078354 22474 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:15.071074 27612 log.cc:927] Time spent T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:08:15.070302 27155 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.149016 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:15.052685 27573 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:08:15.153750 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 75501.2us
I20260709 13:08:15.184842 22396 leader_election.cc:400] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 17 pre-election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 17. Current term is 18.
I20260709 13:08:15.079777 27524 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 13:08:15.179176 27607 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:15.187791 27558 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:15.163455 27619 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.263094 22545 leader_election.cc:400] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 15. Current term is 16.
I20260709 13:08:15.263550 22545 leader_election.cc:403] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.231076 27467 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:15.266799 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 200159us
I20260709 13:08:15.180413 27155 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:15.313920 22398 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:15.268232 27558 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:15.333127 22424 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:15.336529 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:15.321597 27408 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:15.332142 27153 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:15.361322 27632 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:15.362018 27632 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:15.352923 27599 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:15.365157 27599 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:15.367385 27599 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:15.368007 27599 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 15. Current term is 16.
I20260709 13:08:15.339411 27550 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.361032 27408 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:15.385366 27558 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:15.388867 27555 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:15.389648 27580 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:15.390410 27625 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:15.401497 22573 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:15.404263 27577 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:15.404927 27577 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:15.406054 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:15.407635 27155 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:15.409643 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:15.369859 27632 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:15.411545 27577 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:15.415882 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:15.417543 23076 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:15.431991 27617 raft_consensus.cc:2804] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:15.432689 27617 raft_consensus.cc:697] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:15.433787 27617 consensus_queue.cc:237] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:15.451009 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:15.434471 27354 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:15.453871 27528 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:15.494710 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:15.493904 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:15.500806 22474 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:15.505640 27626 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.510241 27643 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:15.510951 27643 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:15.532267 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 334643us
I20260709 13:08:15.534910 27408 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:15.536108 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:15.531808 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 266287us
I20260709 13:08:15.493119 27354 consensus_queue.cc:1059] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:08:15.553272 22580 raft_consensus.cc:1275] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:15.556958 22396 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.553718 27643 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:15.497824 27528 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:15.567312 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 308896us
I20260709 13:08:15.571076 22426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
W20260709 13:08:15.552551 27581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.006s	sys 0.011s
I20260709 13:08:15.574093 27528 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:15.570165 27492 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:15.595093 22474 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:15.594635 27581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.007s	sys 0.012s
I20260709 13:08:15.617009 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:15.619315 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:15.627462 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:15.631655 22546 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.651214 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:15.651460 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:15.652179 22430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:15.652606 22431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:15.653115 22396 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.653421 22433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:15.654066 27576 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.655411 27528 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:15.659860 22396 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.665738 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:15.671684 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:15.672914 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 101216us
I20260709 13:08:15.677007 22502 raft_consensus.cc:1275] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:15.687842 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add2d1ead99b44f6b4c0bb7f2fa9857a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:15.691735 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:15.680967 27543 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.701327 22399 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.714275 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:15.715716 27638 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.714881 27150 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.700810 27649 consensus_queue.cc:1048] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:08:15.754014 22502 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:08:15.757711 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 43526.2us
W20260709 13:08:15.759282 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 127777us
I20260709 13:08:15.760080 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.760987 27574 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.760877 27561 consensus_queue.cc:1048] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:15.766331 27573 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.767053 22399 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.766381 27585 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:15.769444 27585 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:15.770428 27585 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:15.771378 27558 consensus_queue.cc:1059] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:15.768643 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 92030.6us
I20260709 13:08:15.776136 27472 raft_consensus.cc:3055] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:15.776600 27484 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.777753 27649 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:15.780083 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:15.781404 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:15.782665 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:15.783104 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:15.783926 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:15.776574 27472 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:15.792343 22545 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.794508 22545 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.795710 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.796681 22573 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:15.799587 27664 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.796705 27155 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.803123 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.807550 22546 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:15.815748 27639 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.789376 27472 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:15.820510 27472 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.808110 27155 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.797945 27643 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.829605 27641 raft_consensus.cc:3055] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:15.830086 27641 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:15.830899 27641 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:15.831977 27641 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.887809 22325 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43642 (request call id 136) took 6150 ms. Trace:
I20260709 13:08:15.917984 22428 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:15.922719 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:15.923532 27492 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:08:15.991130 22331 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 11 to 14, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 14 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:15.993204 22331 catalog_manager.cc:5697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:15.995936 22331 catalog_manager.cc:5697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 12 to 13, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.020277 22331 catalog_manager.cc:5697] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:15.901861 22325 rpcz_store.cc:276] 0709 13:08:09.737115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.738552 (+  1437us) service_pool.cc:224] Handling call
0709 13:08:15.887689 (+6149137us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:13.564578 (+     0us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069c5bc85 00007f0069c5c6a2 00007f006c9ce1db 00007f006c9c9aaf 00007f0069d180ac 00007f0072b72ab9 00007f0069d3469b 00007f0069d3293f 00007f0069d32455 00007f007085716c
0709 13:08:13.779897 (+215319us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:13.809094 (+ 29197us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:13.809152 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:08:13.809166 (+    14us) tablet.cc:662] Decoding operations
0709 13:08:13.810431 (+  1265us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:13.810530 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:13.810561 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:08:13.811888 (+  1327us) tablet.cc:701] Row locks acquired
0709 13:08:13.811938 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:08:13.812118 (+   180us) write_op.cc:270] Start()
0709 13:08:13.812345 (+   227us) write_op.cc:276] Timestamp: P: 1783602493812047 usec, L: 0
0709 13:08:13.812379 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:08:13.898932 (+ 86553us) log.cc:844] Serialized 5474 byte log entry
0709 13:08:14.665821 (+766889us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b180032bf00. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0072bfdde1 00007f0072c0a5b1 00007f0069d353f3 00007f0069d377c1 00007f0069d37779 00007f0069d37709 00007f0069d376d1 00007f0069d369cd 000000000038f354 000000000038f199 00007f0069d1883a
0709 13:08:15.017303 (+351482us) op_driver.cc:464] REPLICATION: finished
0709 13:08:15.361565 (+344262us) write_op.cc:301] APPLY: starting
0709 13:08:15.361689 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:15.480289 (+118600us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:15.491458 (+ 11169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:15.583738 (+ 92280us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:15.680926 (+ 97188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:08:15.689521 (+  8595us) write_op.cc:312] APPLY: finished
0709 13:08:15.692067 (+  2546us) log.cc:844] Serialized 129 byte log entry
0709 13:08:15.692271 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.692420 (+   149us) write_op.cc:454] Released schema lock
0709 13:08:15.692523 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:15.692951 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.692979 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":584625,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":326947,"apply.run_cpu_time_us":20830,"apply.run_wall_time_us":348327,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62703,"num_ops":14,"prepare.queue_time_us":501596,"prepare.run_cpu_time_us":17408,"prepare.run_wall_time_us":296801,"raft.queue_time_us":303963,"raft.run_cpu_time_us":14129,"raft.run_wall_time_us":214690,"replication_time_us":1204749,"spinlock_wait_cycles":51501056,"thread_start_us":1028936,"threads_started":4,"wal-append.queue_time_us":189824}]]}
I20260709 13:08:16.027521 22331 catalog_manager.cc:5697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.045816 22331 catalog_manager.cc:5697] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 11, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 11 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.047755 22331 catalog_manager.cc:5697] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.049171 22331 catalog_manager.cc:5697] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 13, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.077647 22331 catalog_manager.cc:5697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 13, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.079268 22331 catalog_manager.cc:5697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 14, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 14 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.081745 22331 catalog_manager.cc:5697] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.083745 22573 raft_consensus.cc:1240] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:16.084787 22428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:16.087049 22425 raft_consensus.cc:1275] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:16.089073 22425 pending_rounds.cc:85] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Aborting all ops after (but not including) 10
I20260709 13:08:16.089494 22425 pending_rounds.cc:107] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:16.089721 22425 raft_consensus.cc:2889] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.084515 22331 catalog_manager.cc:5697] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 14, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 14 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.092345 22331 catalog_manager.cc:5697] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 8, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 8 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.089016 22428 raft_consensus.cc:606] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:16.093518 22331 catalog_manager.cc:5697] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 13, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.102453 22331 catalog_manager.cc:5697] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.103933 22331 catalog_manager.cc:5697] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 9 to 12, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.106106 22331 catalog_manager.cc:5697] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 11, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:16.107492 22331 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:16.115831 27672 log.cc:927] Time spent T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.100s	user 0.003s	sys 0.000s
W20260709 13:08:16.140184 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 44537.7us
I20260709 13:08:16.169301 27578 consensus_queue.cc:1048] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:08:16.189668 27674 log.cc:927] Time spent T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 13:08:16.270025 22424 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:16.271710 27573 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:16.291347 22424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:16.293988 22424 raft_consensus.cc:606] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:16.301152 22506 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:16.301578 22506 pending_rounds.cc:85] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting all ops after (but not including) 6
I20260709 13:08:16.301815 22506 pending_rounds.cc:107] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:16.302043 22506 raft_consensus.cc:2889] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.305590 27585 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:16.344937 22494 tablet_service.cc:1558] Processing DeleteTablet for tablet ee6d9e2f597948e7b4670b3606ebf448 with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:16.345435 22498 tablet_service.cc:1558] Processing DeleteTablet for tablet 06de1406fed544b39bf6d0ab441df770 with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:16.357336 27629 raft_consensus.cc:993] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:16.357991 27629 raft_consensus.cc:1081] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Signalling peer e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:16.359764 22424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:16.360242 22506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:58706
I20260709 13:08:16.360936 22424 raft_consensus.cc:606] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:16.361400 22424 raft_consensus.cc:614] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:16.360885 22506 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.364375 22506 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.373067 22424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:16.373821 22424 raft_consensus.cc:606] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:16.374264 22424 raft_consensus.cc:614] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:16.384830 22429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:16.385433 22429 raft_consensus.cc:606] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:16.419811 22506 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:16.428853 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:16.430771 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:16.438408 22506 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:16.427028 27686 tablet_replica.cc:333] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:08:16.443246 27686 raft_consensus.cc:2243] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:16.441468 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:16.445886 22573 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.451033 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:16.451952 22429 raft_consensus.cc:3055] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:16.452253 22429 raft_consensus.cc:740] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:16.454643 27686 raft_consensus.cc:2272] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:16.455689 27230 raft_consensus.cc:993] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:16.456269 27636 raft_consensus.cc:1081] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Signalling peer e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:16.458940 22506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:58706
I20260709 13:08:16.458662 22573 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:16.469801 22474 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:16.467234 22506 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.470705 22506 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.463210 22429 consensus_queue.cc:260] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:16.481769 27686 ts_tablet_manager.cc:1916] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:16.484494 22429 raft_consensus.cc:3060] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.489919 22506 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:16.481081 27641 raft_consensus.cc:2804] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:16.495175 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:16.495779 22432 raft_consensus.cc:3055] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:16.496068 22432 raft_consensus.cc:740] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:16.498994 22506 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:16.499884 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:16.501649 23107 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.498544 22432 consensus_queue.cc:260] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:16.495112 27641 raft_consensus.cc:697] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:16.508229 22432 raft_consensus.cc:3060] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.510859 27641 consensus_queue.cc:237] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:16.522518 23107 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:16.523886 22473 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:16.524243 22432 raft_consensus.cc:2468] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:16.525784 27621 raft_consensus.cc:2804] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:16.526750 27621 raft_consensus.cc:697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:16.527525 27621 consensus_queue.cc:237] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:16.559617 22429 raft_consensus.cc:2468] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:16.572964 27686 ts_tablet_manager.cc:1929] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:08:16.573623 27686 log.cc:1199] T 06de1406fed544b39bf6d0ab441df770 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/06de1406fed544b39bf6d0ab441df770
I20260709 13:08:16.596012 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 06de1406fed544b39bf6d0ab441df770 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:16.594455 27686 tablet_replica.cc:333] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:08:16.633715 27686 raft_consensus.cc:2243] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:16.640595 27686 raft_consensus.cc:2272] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:16.646827 27153 raft_consensus.cc:993] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:16.647454 27153 raft_consensus.cc:1081] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:16.652223 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:08:16.652869 22573 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.653165 22573 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.656905 22331 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43174 (request call id 257) took 4187 ms. Trace:
I20260709 13:08:16.663668 22573 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:16.666357 22573 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:16.666891 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:16.667515 22429 raft_consensus.cc:3055] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:16.667785 22429 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:16.668502 22429 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:16.657570 22331 rpcz_store.cc:276] 0709 13:08:12.470172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.476900 (+  6728us) service_pool.cc:224] Handling call
0709 13:08:16.656810 (+4179910us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:16.270984 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:16.314390 (+ 43406us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:16.314429 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:08:16.314446 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:16.361183 (+ 46737us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:16.361684 (+   501us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:16.361720 (+    36us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:08:16.363147 (+  1427us) tablet.cc:701] Row locks acquired
0709 13:08:16.363168 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:16.363345 (+   177us) write_op.cc:270] Start()
0709 13:08:16.363464 (+   119us) write_op.cc:276] Timestamp: P: 1783602496363292 usec, L: 0
0709 13:08:16.363484 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:16.381250 (+ 17766us) log.cc:844] Serialized 7080 byte log entry
0709 13:08:16.429376 (+ 48126us) op_driver.cc:464] REPLICATION: finished
0709 13:08:16.432132 (+  2756us) write_op.cc:301] APPLY: starting
0709 13:08:16.432218 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:16.551176 (+118958us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:16.551278 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:16.603699 (+ 52421us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:16.604009 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:08:16.604055 (+    46us) write_op.cc:312] APPLY: finished
0709 13:08:16.604439 (+   384us) log.cc:844] Serialized 164 byte log entry
0709 13:08:16.605407 (+   968us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:16.605595 (+   188us) write_op.cc:454] Released schema lock
0709 13:08:16.605655 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:16.606078 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:16.606105 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34243,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":2486,"apply.run_cpu_time_us":25521,"apply.run_wall_time_us":173920,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79439,"num_ops":18,"prepare.queue_time_us":138006,"prepare.run_cpu_time_us":5917,"prepare.run_wall_time_us":123768,"replication_time_us":65724,"spinlock_wait_cycles":16384,"thread_start_us":131309,"threads_started":2}]]}
I20260709 13:08:16.670151 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:16.649529 22326 catalog_manager.cc:5697] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 8 to 11, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 11 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.670720 22506 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.682227 27686 ts_tablet_manager.cc:1916] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:16.669585 22429 raft_consensus.cc:3060] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.727480 22506 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
I20260709 13:08:16.729043 22545 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:16.732331 22429 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
I20260709 13:08:16.737423 27643 raft_consensus.cc:2804] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:16.738076 27643 raft_consensus.cc:697] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:16.738976 27643 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:16.822230 22327 catalog_manager.cc:5697] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.842041 27686 ts_tablet_manager.cc:1929] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:08:16.842612 27686 log.cc:1199] T ee6d9e2f597948e7b4670b3606ebf448 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/ee6d9e2f597948e7b4670b3606ebf448
I20260709 13:08:16.844627 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet ee6d9e2f597948e7b4670b3606ebf448 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:16.846422 22327 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 9 to 10, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.866842 22327 catalog_manager.cc:5697] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.869949 22327 catalog_manager.cc:5697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.872656 22327 catalog_manager.cc:5697] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 11 to 12, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 12 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.876068 22327 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:16.926052 22498 tablet_service.cc:1558] Processing DeleteTablet for tablet 06de1406fed544b39bf6d0ab441df770 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:16.927654 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 06de1406fed544b39bf6d0ab441df770 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
W20260709 13:08:16.951956 22326 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33176 (request call id 265) took 33661 ms (client timeout 15000 ms). Trace:
I20260709 13:08:16.953418 22429 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:16.955116 27200 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:16.955829 22498 tablet_service.cc:1558] Processing DeleteTablet for tablet ee6d9e2f597948e7b4670b3606ebf448 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:16.958114 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet ee6d9e2f597948e7b4670b3606ebf448 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
W20260709 13:08:16.952432 22326 rpcz_store.cc:269] 0709 13:07:43.290844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.291150 (+   306us) service_pool.cc:224] Handling call
0709 13:07:43.879222 (+588072us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b5400230190. stack: 00007f0069d03343 00007f0069d03240 00007f00696921d4 00007f00733d0304 00007f00733d0299 00007f0069bbddb1 00007f0069cfe640 00007f0072bd5b76 00007f0072cdfc3e 00007f00711a02a4 00007f00711a0232 00007f00711a0161 00007f00711a00dc 00007f007119f392 00007f006b15d48c 00007f006b15c8c6
0709 13:08:16.951836 (+33072614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:16.689558 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:16.690078 (+   520us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:16.690108 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:08:16.690126 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:16.690428 (+   302us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:16.690479 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:16.690510 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:16.690700 (+   190us) tablet.cc:701] Row locks acquired
0709 13:08:16.690717 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:16.690850 (+   133us) write_op.cc:270] Start()
0709 13:08:16.690948 (+    98us) write_op.cc:276] Timestamp: P: 1783602496690811 usec, L: 0
0709 13:08:16.690969 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:16.691583 (+   614us) log.cc:844] Serialized 533 byte log entry
0709 13:08:16.708876 (+ 17293us) op_driver.cc:464] REPLICATION: finished
0709 13:08:16.709345 (+   469us) write_op.cc:301] APPLY: starting
0709 13:08:16.709424 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:16.710226 (+   802us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:16.710325 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:16.710998 (+   673us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:16.711169 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:16.711213 (+    44us) write_op.cc:312] APPLY: finished
0709 13:08:16.711402 (+   189us) log.cc:844] Serialized 25 byte log entry
0709 13:08:16.711572 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:16.711660 (+    88us) write_op.cc:454] Released schema lock
0709 13:08:16.711697 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:16.712089 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:16.712116 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54166,"reported_tablets":51,"spinlock_wait_cycles":39501568,"child_traces":[["op",{"apply.queue_time_us":237,"apply.run_cpu_time_us":2699,"apply.run_wall_time_us":2699,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":2301,"prepare.run_wall_time_us":2300,"replication_time_us":17760}]]}
I20260709 13:08:16.983469 23107 raft_consensus.cc:1275] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:16.985222 27528 consensus_queue.cc:1048] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:16.996297 22331 catalog_manager.cc:5697] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 13 to 17, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 17 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.006119 22573 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:17.007918 27528 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:17.017195 22331 catalog_manager.cc:5697] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.026322 22331 catalog_manager.cc:5697] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 12, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 12 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.028210 22331 catalog_manager.cc:5697] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 11, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 11 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.077929 22327 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33162 (request call id 247) took 10143 ms. Trace:
I20260709 13:08:17.080978 22331 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 11 to 15, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 15 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.088346 22429 raft_consensus.cc:1275] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:17.089866 27200 consensus_queue.cc:1048] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:17.078451 22327 rpcz_store.cc:276] 0709 13:08:06.934312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.948461 (+ 14149us) service_pool.cc:224] Handling call
0709 13:08:17.077846 (+10129385us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:16.936739 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:16.937267 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:16.937301 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:08:16.937318 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:16.938049 (+   731us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:16.938099 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:16.938135 (+    36us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:16.938618 (+   483us) tablet.cc:701] Row locks acquired
0709 13:08:16.938635 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:16.938780 (+   145us) write_op.cc:270] Start()
0709 13:08:16.938889 (+   109us) write_op.cc:276] Timestamp: P: 1783602496938735 usec, L: 0
0709 13:08:16.938905 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:08:16.939525 (+   620us) log.cc:844] Serialized 2454 byte log entry
0709 13:08:16.946804 (+  7279us) op_driver.cc:464] REPLICATION: finished
0709 13:08:16.949809 (+  3005us) write_op.cc:301] APPLY: starting
0709 13:08:16.949915 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:16.958677 (+  8762us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:16.958769 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:16.969153 (+ 10384us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:16.969399 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:08:16.969450 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:16.969733 (+   283us) log.cc:844] Serialized 65 byte log entry
0709 13:08:16.969893 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:16.969997 (+   104us) write_op.cc:454] Released schema lock
0709 13:08:16.970038 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:17.004433 (+ 34395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:17.004462 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":906697,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":1988,"apply.run_cpu_time_us":9355,"apply.run_wall_time_us":54563,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25104,"num_ops":6,"prepare.queue_time_us":512,"prepare.run_cpu_time_us":3127,"prepare.run_wall_time_us":9811,"replication_time_us":7763}]]}
I20260709 13:08:17.083465 22331 catalog_manager.cc:5697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 14 to 16, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 16 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.099851 22331 catalog_manager.cc:5697] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 12 to 13, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 13 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.104260 22331 catalog_manager.cc:5697] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 12 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.105935 22331 catalog_manager.cc:5697] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 9 to 14, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 14 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.108582 22331 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 9 to 15, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 15 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.110352 22331 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 10 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 12 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.112392 22331 catalog_manager.cc:5697] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 9, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 9 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.115981 22331 catalog_manager.cc:5697] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 12 to 14, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 14 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.117420 22331 catalog_manager.cc:5697] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 14 to 15, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 15 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.126354 22504 consensus_queue.cc:237] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:17.209285 22573 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:08:17.211023 22473 consensus_peers.cc:597] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4293c025258b4f61abd2346d38a2752b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:17.211715 27528 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:17.213254 22432 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:17.214910 27528 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:17.368937 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 62914.8us
I20260709 13:08:17.372239 27528 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.436159 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:17.426944 27707 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:17.435472 27664 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.416425 27528 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:17.466383 22424 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:17.463019 27664 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:17.456122 27707 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:17.522992 27702 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 13:08:17.529878 27528 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:17.553587 27703 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:08:17.555383 27664 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:17.555976 27707 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:17.561022 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:17.561905 22573 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:08:17.564986 22399 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:17.566182 27713 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:17.566596 27713 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:17.566946 27713 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.590512 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:17.591270 22506 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:17.593097 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:17.594802 22506 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:17.595889 27711 raft_consensus.cc:2955] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:17.605695 22545 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:17.617805 22432 raft_consensus.cc:2955] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:17.617715 27643 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.622558 27643 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.622931 27643 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.617530 27716 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:08:17.631256 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:17.632067 22505 raft_consensus.cc:2393] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 in current term 11: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:17.658965 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:17.671761 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" is_pre_election: true
I20260709 13:08:17.677567 22327 catalog_manager.cc:5697] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 13 to 14, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 14 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } }
I20260709 13:08:17.681593 27713 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:17.682735 22424 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:17.701586 22472 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:17.707408 27711 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.707828 27711 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.704114 27643 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:17.708163 27711 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:17.729008 22328 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43642 (request call id 135) took 25110 ms (client timeout 15000 ms). Trace:
W20260709 13:08:17.732087 22328 rpcz_store.cc:269] 0709 13:07:52.618430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.618749 (+   319us) service_pool.cc:224] Handling call
0709 13:08:17.728801 (+25110052us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137,"reported_tablets":28}
I20260709 13:08:17.731918 22580 raft_consensus.cc:2393] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:17.735539 27713 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:17.740620 27643 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:17.741415 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:17.741765 27726 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:08:17.738567 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:17.757920 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:17.759843 22580 raft_consensus.cc:2368] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12.
I20260709 13:08:17.763381 22429 raft_consensus.cc:3060] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.770879 22399 leader_election.cc:400] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12.
I20260709 13:08:17.771272 22399 leader_election.cc:403] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:17.775332 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:17.784662 22577 raft_consensus.cc:2955] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:17.816063 22429 raft_consensus.cc:2468] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:17.829741 27722 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12.
I20260709 13:08:17.816493 27731 ts_tablet_manager.cc:933] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:17.831979 22546 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:17.839749 27585 raft_consensus.cc:2804] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:17.841868 27585 raft_consensus.cc:697] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:17.842875 22577 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:17.842790 27585 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:17.815490 27711 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:17.850172 22505 raft_consensus.cc:2368] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12.
W20260709 13:08:17.852334 22330 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43642 (request call id 134) took 45031 ms (client timeout 15000 ms). Trace:
W20260709 13:08:17.853499 22330 rpcz_store.cc:269] 0709 13:07:32.804947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.805564 (+   617us) service_pool.cc:224] Handling call
0709 13:08:17.834046 (+45028482us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20855,"reported_tablets":27,"spinlock_wait_cycles":9600}
I20260709 13:08:17.855468 22396 leader_election.cc:400] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12.
I20260709 13:08:17.864387 27711 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:17.877933 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:17.877992 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:17.879690 22429 raft_consensus.cc:2393] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:17.887120 22472 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:17.889974 27732 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.914989 27731 tablet_copy_client.cc:323] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:08:17.917230 22518 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 4293c025258b4f61abd2346d38a2752b from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:08:17.917891 22518 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 4293c025258b4f61abd2346d38a2752b from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-4293c025258b4f61abd2346d38a2752b
I20260709 13:08:17.968104 22329 catalog_manager.cc:5697] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 12 to 13, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.969070 22518 tablet_copy_source_session.cc:215] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:17.975607 22505 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:17.978114 22547 consensus_peers.cc:597] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9bc53a10833c40d7b01be713f425dfcc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:17.983322 22429 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:17.987936 27643 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:17.993278 27715 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:17.990749 22329 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.999468 27731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4293c025258b4f61abd2346d38a2752b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.002055 22329 catalog_manager.cc:5697] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 11 to 16, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 16 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:18.034351 27715 raft_consensus.cc:2955] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.041237 22506 raft_consensus.cc:2955] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.043762 22327 catalog_manager.cc:5697] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 7, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 8 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.057893 22325 catalog_manager.cc:5697] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 10 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 12 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.061127 22325 catalog_manager.cc:5697] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 15 to 18, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 18 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.059278 22327 catalog_manager.cc:5697] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 9 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.068303 22506 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:18.077796 22325 catalog_manager.cc:5697] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 10 to 15, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 15 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.096554 22329 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33176 (request call id 267) took 4043 ms. Trace:
I20260709 13:08:18.099087 22498 tablet_service.cc:1558] Processing DeleteTablet for tablet ee6d9e2f597948e7b4670b3606ebf448 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:18.103896 27731 tablet_copy_client.cc:806] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:18.104660 27731 tablet_copy_client.cc:670] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:18.109351 27731 tablet_copy_client.cc:538] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:18.114320 22429 raft_consensus.cc:2955] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.121362 27731 tablet_bootstrap.cc:492] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:18.096870 22329 rpcz_store.cc:276] 0709 13:08:14.052940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.053400 (+   460us) service_pool.cc:224] Handling call
0709 13:08:18.096457 (+4043057us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:18.006770 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:18.007295 (+   525us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:18.007329 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:08:18.007346 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:18.007872 (+   526us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:18.007924 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:18.007949 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:18.008261 (+   312us) tablet.cc:701] Row locks acquired
0709 13:08:18.008280 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:18.008428 (+   148us) write_op.cc:270] Start()
0709 13:08:18.008556 (+   128us) write_op.cc:276] Timestamp: P: 1783602498008385 usec, L: 0
0709 13:08:18.008578 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:18.009234 (+   656us) log.cc:844] Serialized 1293 byte log entry
0709 13:08:18.020489 (+ 11255us) op_driver.cc:464] REPLICATION: finished
0709 13:08:18.020917 (+   428us) write_op.cc:301] APPLY: starting
0709 13:08:18.021000 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:18.022782 (+  1782us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:18.022887 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:18.027400 (+  4513us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:18.027563 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:18.027606 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:18.027821 (+   215us) log.cc:844] Serialized 41 byte log entry
0709 13:08:18.027990 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.028094 (+   104us) write_op.cc:454] Released schema lock
0709 13:08:18.028134 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:18.028496 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.028524 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7560,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":238,"apply.run_cpu_time_us":5202,"apply.run_wall_time_us":7499,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12552,"num_ops":3,"prepare.queue_time_us":995,"prepare.run_cpu_time_us":2720,"prepare.run_wall_time_us":2719,"replication_time_us":11758}]]}
I20260709 13:08:18.156090 22327 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.189316 22573 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:18.191295 22473 consensus_peers.cc:597] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: add2d1ead99b44f6b4c0bb7f2fa9857a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:18.199863 22432 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:18.205858 27732 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:18.208024 27732 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:18.229863 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet ee6d9e2f597948e7b4670b3606ebf448 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:18.232755 22331 catalog_manager.cc:5697] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 13 to 14, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 14 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:18.237145 22325 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43642 (request call id 137) took 2132 ms. Trace:
I20260709 13:08:18.253818 22325 rpcz_store.cc:276] 0709 13:08:16.103664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.103848 (+   184us) service_pool.cc:224] Handling call
0709 13:08:18.235473 (+2131625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:18.104087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:18.104633 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:18.104669 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:08:18.104690 (+    21us) tablet.cc:662] Decoding operations
0709 13:08:18.107073 (+  2383us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:18.107119 (+    46us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:18.107154 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:18.107464 (+   310us) tablet.cc:701] Row locks acquired
0709 13:08:18.107482 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:18.107651 (+   169us) write_op.cc:270] Start()
0709 13:08:18.107765 (+   114us) write_op.cc:276] Timestamp: P: 1783602498107600 usec, L: 0
0709 13:08:18.107785 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:18.108411 (+   626us) log.cc:844] Serialized 1293 byte log entry
0709 13:08:18.110540 (+  2129us) op_driver.cc:464] REPLICATION: finished
0709 13:08:18.118287 (+  7747us) write_op.cc:301] APPLY: starting
0709 13:08:18.118373 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:18.120019 (+  1646us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:18.120120 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:18.143574 (+ 23454us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:18.143768 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:18.143809 (+    41us) write_op.cc:312] APPLY: finished
0709 13:08:18.145333 (+  1524us) log.cc:844] Serialized 41 byte log entry
0709 13:08:18.148780 (+  3447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.148870 (+    90us) write_op.cc:454] Released schema lock
0709 13:08:18.148910 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:18.149275 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.149302 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20792,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":7539,"apply.run_cpu_time_us":5246,"apply.run_wall_time_us":30901,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12552,"num_ops":3,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":2864,"prepare.run_wall_time_us":4622,"replication_time_us":2599,"thread_start_us":38184,"threads_started":1}]]}
I20260709 13:08:18.267988 27641 raft_consensus.cc:2955] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.277125 22580 raft_consensus.cc:2955] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.302759 22429 raft_consensus.cc:2955] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.334331 22327 catalog_manager.cc:5697] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.342186 22580 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:18.405028 22432 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:18.417989 22506 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:08:18.418462 22547 consensus_peers.cc:597] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07e24d8dba0542d7a1428819c63159f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:18.424816 27585 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:18.433619 22506 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:18.435353 27585 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:18.438599 22432 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:18.440549 27715 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:18.443058 27715 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:18.499148 27731 tablet_bootstrap.cc:492] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:18.502279 27731 tablet_bootstrap.cc:492] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:18.503140 27731 ts_tablet_manager.cc:1403] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.382s	user 0.039s	sys 0.023s
I20260709 13:08:18.509986 27756 ts_tablet_manager.cc:933] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:18.587550 27731 raft_consensus.cc:359] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:18.588670 27731 raft_consensus.cc:740] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:18.589490 27731 consensus_queue.cc:260] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:08:18.659379 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 72987.9us
I20260709 13:08:18.659950 27756 tablet_copy_client.cc:323] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:08:18.665711 27643 raft_consensus.cc:2955] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:08:18.710186 27752 log.cc:927] Time spent T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:18.726907 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 9bc53a10833c40d7b01be713f425dfcc from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:08:18.727406 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 9bc53a10833c40d7b01be713f425dfcc from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-9bc53a10833c40d7b01be713f425dfcc
W20260709 13:08:18.728688 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44315.1us
I20260709 13:08:18.729923 22432 raft_consensus.cc:2955] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.743376 27731 ts_tablet_manager.cc:1434] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.240s	user 0.008s	sys 0.009s
I20260709 13:08:18.755189 22502 raft_consensus.cc:2955] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.758234 22592 tablet_copy_source_session.cc:215] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:18.762961 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:18.775770 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 73937.5us
I20260709 13:08:18.791615 22518 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-4293c025258b4f61abd2346d38a2752b received from {username='slave'} at 127.0.0.1:49792
I20260709 13:08:18.792142 22518 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-4293c025258b4f61abd2346d38a2752b on tablet 4293c025258b4f61abd2346d38a2752b with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:18.810567 27756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc53a10833c40d7b01be713f425dfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.809836 22327 catalog_manager.cc:5697] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:18.852097 27731 ts_tablet_manager.cc:933] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:18.853418 22429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:18.854082 22429 raft_consensus.cc:606] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:18.867933 22502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:08:18.868754 22502 raft_consensus.cc:606] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:18.888406 27756 tablet_copy_client.cc:806] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:18.889155 27756 tablet_copy_client.cc:670] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:18.894209 22432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:18.894886 22432 raft_consensus.cc:606] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:18.900384 22432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:18.901028 22432 raft_consensus.cc:606] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:18.907060 22432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:18.907688 22432 raft_consensus.cc:606] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:18.909552 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:18.911361 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:18.933732 27756 tablet_copy_client.cc:538] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:18.941488 27731 tablet_copy_client.cc:323] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:08:18.944078 22518 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet add2d1ead99b44f6b4c0bb7f2fa9857a from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:08:18.944686 22518 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet add2d1ead99b44f6b4c0bb7f2fa9857a from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-add2d1ead99b44f6b4c0bb7f2fa9857a
I20260709 13:08:18.950013 27756 tablet_bootstrap.cc:492] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:18.954308 22518 tablet_copy_source_session.cc:215] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:18.960587 27731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add2d1ead99b44f6b4c0bb7f2fa9857a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.030644 27731 tablet_copy_client.cc:806] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:19.035274 27731 tablet_copy_client.cc:670] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:19.040848 27731 tablet_copy_client.cc:538] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:19.053849 27772 ts_tablet_manager.cc:933] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:19.067339 27731 tablet_bootstrap.cc:492] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:19.076556 27772 tablet_copy_client.cc:323] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:08:19.079147 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 07e24d8dba0542d7a1428819c63159f5 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:08:19.079741 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 07e24d8dba0542d7a1428819c63159f5 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-07e24d8dba0542d7a1428819c63159f5
I20260709 13:08:19.101055 22592 tablet_copy_source_session.cc:215] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:19.109906 27772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e24d8dba0542d7a1428819c63159f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.131670 27756 tablet_bootstrap.cc:492] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:19.152640 27772 tablet_copy_client.cc:806] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:19.153324 27772 tablet_copy_client.cc:670] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:19.158993 27756 tablet_bootstrap.cc:492] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:19.159756 27772 tablet_copy_client.cc:538] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:19.159910 27756 ts_tablet_manager.cc:1403] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.211s	user 0.035s	sys 0.007s
I20260709 13:08:19.185957 27756 raft_consensus.cc:359] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:19.186872 27756 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:19.187548 27756 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:19.202428 27772 tablet_bootstrap.cc:492] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:19.218566 27722 raft_consensus.cc:993] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:19.219208 27303 raft_consensus.cc:993] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:19.219233 27712 raft_consensus.cc:1081] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:19.219666 27303 raft_consensus.cc:1081] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:19.221877 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:08:19.222532 22573 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.222936 22573 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.229281 27756 ts_tablet_manager.cc:1434] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 13:08:19.237135 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-9bc53a10833c40d7b01be713f425dfcc received from {username='slave'} at 127.0.0.1:55062
I20260709 13:08:19.237632 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-9bc53a10833c40d7b01be713f425dfcc on tablet 9bc53a10833c40d7b01be713f425dfcc with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:19.237795 22581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:08:19.238380 22581 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.238765 22581 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.254088 22573 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:19.258611 22573 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:19.251735 22581 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:19.259347 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:19.294867 22429 raft_consensus.cc:3055] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:19.295244 22429 raft_consensus.cc:740] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:19.260893 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:19.296089 22502 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.296430 23110 raft_consensus.cc:1217] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 13:08:19.296192 22581 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:19.303068 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:19.303709 22424 raft_consensus.cc:3055] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:19.304003 22424 raft_consensus.cc:740] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:19.304808 22424 consensus_queue.cc:260] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:19.305948 22424 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.312155 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:19.312894 22508 raft_consensus.cc:3060] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.330739 22424 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 17.
I20260709 13:08:19.332556 22429 consensus_queue.cc:260] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:19.334355 22429 raft_consensus.cc:3060] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.334811 22546 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:19.350695 22502 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:19.352866 22505 raft_consensus.cc:1240] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:19.353932 22545 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:19.358647 22429 raft_consensus.cc:2468] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:19.368731 27758 raft_consensus.cc:993] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:19.369307 27758 raft_consensus.cc:1081] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:19.371986 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:08:19.372669 22580 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.373034 22580 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.373397 27762 raft_consensus.cc:2804] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:19.380753 27761 raft_consensus.cc:2804] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:19.381312 27761 raft_consensus.cc:697] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:19.382153 27761 consensus_queue.cc:237] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:19.379805 22580 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:19.382051 27762 raft_consensus.cc:697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 17 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:19.405282 22580 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:19.407159 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:19.407757 23107 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.427340 23107 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:08:19.429133 22547 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:19.440562 22508 raft_consensus.cc:2468] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 17.
W20260709 13:08:19.449399 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47031.7us
I20260709 13:08:19.462999 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:19.462806 27762 consensus_queue.cc:237] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:19.463641 22429 raft_consensus.cc:3055] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:19.463980 22429 raft_consensus.cc:740] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:19.464695 22429 consensus_queue.cc:260] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:19.465969 22429 raft_consensus.cc:3060] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.470381 27230 raft_consensus.cc:993] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:19.470930 27230 raft_consensus.cc:1081] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:19.473191 22429 raft_consensus.cc:2468] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:08:19.448405 27643 raft_consensus.cc:2804] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:19.475248 27643 raft_consensus.cc:697] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:19.476186 27643 consensus_queue.cc:237] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:19.488076 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:08:19.488703 22580 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.489055 22580 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.495863 22580 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:19.506758 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 43710.4us
I20260709 13:08:19.516038 22580 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:19.518059 23107 raft_consensus.cc:1217] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:08:19.518814 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:19.519428 22429 raft_consensus.cc:3055] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:19.519719 22429 raft_consensus.cc:740] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:19.520411 22429 consensus_queue.cc:260] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:19.520872 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:19.521528 22429 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.521494 23107 raft_consensus.cc:3060] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.540359 23107 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:19.542119 22547 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:19.545370 22429 raft_consensus.cc:2468] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:19.547492 27782 raft_consensus.cc:2804] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:19.553148 27782 raft_consensus.cc:697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:19.554188 27782 consensus_queue.cc:237] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:19.567533 22329 catalog_manager.cc:5697] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 11 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.569860 22329 catalog_manager.cc:5697] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 16 to 17, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 17 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.592875 27772 tablet_bootstrap.cc:492] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:19.593873 27772 tablet_bootstrap.cc:492] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:19.594712 27772 ts_tablet_manager.cc:1403] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.393s	user 0.038s	sys 0.013s
I20260709 13:08:19.598088 27772 raft_consensus.cc:359] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:19.599045 27772 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:19.628865 27731 tablet_bootstrap.cc:492] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:19.629920 27731 tablet_bootstrap.cc:492] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:19.633045 27731 ts_tablet_manager.cc:1403] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.566s	user 0.054s	sys 0.020s
I20260709 13:08:19.599795 27772 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:19.653820 27731 raft_consensus.cc:359] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:19.662312 27731 raft_consensus.cc:740] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:19.665987 27731 consensus_queue.cc:260] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:19.665297 27772 ts_tablet_manager.cc:1434] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.003s
I20260709 13:08:19.673452 27775 raft_consensus.cc:993] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:19.674621 27621 raft_consensus.cc:1081] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:19.674939 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-07e24d8dba0542d7a1428819c63159f5 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:08:19.675426 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-07e24d8dba0542d7a1428819c63159f5 on tablet 07e24d8dba0542d7a1428819c63159f5 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:19.678032 27731 ts_tablet_manager.cc:1434] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:08:19.680276 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49184
I20260709 13:08:19.680902 22580 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.681280 22580 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.704392 22580 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:19.706670 22518 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-add2d1ead99b44f6b4c0bb7f2fa9857a received from {username='slave'} at 127.0.0.1:49792
I20260709 13:08:19.707171 22518 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-add2d1ead99b44f6b4c0bb7f2fa9857a on tablet add2d1ead99b44f6b4c0bb7f2fa9857a with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:19.707305 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:19.707921 22429 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.702477 22329 catalog_manager.cc:5697] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 6 to 7, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 7 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.714820 22429 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:19.725567 22546 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:19.726136 27641 raft_consensus.cc:1064] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:19.718294 22580 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:19.726464 27762 raft_consensus.cc:2804] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:19.727065 27762 raft_consensus.cc:697] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:19.727906 27762 consensus_queue.cc:237] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:19.728060 22329 catalog_manager.cc:5697] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 12 to 13, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 13 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.741220 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:19.741832 22508 raft_consensus.cc:3055] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:19.742134 22508 raft_consensus.cc:740] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:19.742445 27641 consensus_queue.cc:237] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:19.742813 22508 consensus_queue.cc:260] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:19.743959 22508 raft_consensus.cc:3060] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.764464 22508 raft_consensus.cc:2468] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:19.811183 23107 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:19.811858 22581 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:19.812929 27776 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:19.814620 27641 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:19.822618 22429 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:19.824513 27641 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:19.837881 22329 catalog_manager.cc:5697] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 12 to 13, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 13 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.867233 27711 raft_consensus.cc:2955] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:19.877386 23110 raft_consensus.cc:2955] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:19.899839 22429 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 17 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:19.903203 27762 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:19.911192 22329 catalog_manager.cc:5697] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 7 to 8, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:19.912526 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:19.926535 22581 raft_consensus.cc:2955] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:19.941902 23112 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:19.942646 27643 raft_consensus.cc:1064] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:19.946125 27643 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:19.949931 27715 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:08:19.962504 22428 raft_consensus.cc:1275] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:19.967100 27715 consensus_queue.cc:1048] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:19.969343 27792 log.cc:927] Time spent T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.066s	user 0.000s	sys 0.006s
I20260709 13:08:19.979383 23107 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:19.979511 22502 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:19.994217 22428 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:19.984153 27762 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:08:20.027911 22428 raft_consensus.cc:2955] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:20.035175 27761 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:20.036594 27715 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:20.131359 22502 consensus_queue.cc:237] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:20.146153 22428 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:20.147848 27775 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:20.148797 22508 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:20.150404 22432 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:20.164275 22508 raft_consensus.cc:1275] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:20.166232 22428 raft_consensus.cc:1275] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:20.167876 27803 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:20.169960 27803 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:20.183218 23110 raft_consensus.cc:1217] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:08:20.196288 23110 raft_consensus.cc:1275] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:20.196174 27200 raft_consensus.cc:2955] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:20.204427 27711 consensus_queue.cc:1048] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:20.216595 23107 raft_consensus.cc:2955] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:20.227686 22427 raft_consensus.cc:2955] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:20.228708 27800 consensus_queue.cc:1048] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:20.229581 27643 consensus_queue.cc:1048] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:20.281003 23112 raft_consensus.cc:1217] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:08:20.291524 23107 raft_consensus.cc:1275] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:20.305619 22325 catalog_manager.cc:5697] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 8 to 9, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 8 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:20.316582 27815 consensus_queue.cc:1048] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:20.317121 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 50133.5us
I20260709 13:08:20.339850 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4293c025258b4f61abd2346d38a2752b with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:20.389730 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 63964.7us
I20260709 13:08:20.420158 22506 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:20.456401 27797 log.cc:927] Time spent T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:08:20.605611 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 55609.6us
W20260709 13:08:20.608644 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 91925.2us
W20260709 13:08:20.670280 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 110462us
W20260709 13:08:20.672353 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 110562us
I20260709 13:08:20.673033 22428 raft_consensus.cc:1275] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:20.675206 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 212981us
W20260709 13:08:20.676395 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 155947us
W20260709 13:08:20.681156 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 121914us
I20260709 13:08:20.689934 27802 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:08:20.711161 27811 log.cc:927] Time spent T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:08:20.441113 27818 raft_consensus.cc:2955] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:20.779542 27827 log.cc:927] Time spent T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:08:20.816606 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 44482.9us
W20260709 13:08:20.818063 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 203665us
W20260709 13:08:20.826586 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 116840us
W20260709 13:08:20.825280 27829 log.cc:927] Time spent T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:08:20.832571 22502 raft_consensus.cc:2955] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:20.934844 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 45824.3us
I20260709 13:08:20.959514 27855 raft_consensus.cc:1064] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:20.963415 27855 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:21.025673 23107 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:21.026458 23110 raft_consensus.cc:2955] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.027783 27775 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:21.047710 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 53451.2us
I20260709 13:08:21.064205 22426 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:21.079459 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 67406.1us
I20260709 13:08:21.098557 27854 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:21.113109 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 102629us
I20260709 13:08:21.120797 27819 consensus_queue.cc:1048] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:08:21.124588 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 109783us
I20260709 13:08:21.145982 27841 raft_consensus.cc:1064] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:21.158710 22424 raft_consensus.cc:2955] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.164141 27841 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:21.181865 22573 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:21.204137 27775 raft_consensus.cc:2955] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.213201 22427 raft_consensus.cc:2955] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.227594 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet 4293c025258b4f61abd2346d38a2752b with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:49180
I20260709 13:08:21.241920 27711 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:08:21.289431 23107 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:21.292703 27761 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:21.299249 23112 raft_consensus.cc:2955] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.323536 22503 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:21.327467 27643 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:21.306317 22327 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.349351 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:21.362380 22424 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:21.380417 27870 tablet_replica.cc:333] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:08:21.381903 27870 raft_consensus.cc:2243] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:21.389537 27870 raft_consensus.cc:2272] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:21.400278 27870 ts_tablet_manager.cc:1916] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:21.421052 22580 raft_consensus.cc:2955] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.423913 27761 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:21.468168 22577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:08:21.468891 22577 raft_consensus.cc:606] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:21.489078 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 47391.2us
I20260709 13:08:21.516758 23112 raft_consensus.cc:2955] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.519027 27844 raft_consensus.cc:2955] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.537501 22503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:08:21.538226 22503 raft_consensus.cc:606] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:21.544170 22503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdfa7f3695964682a28952992553f739"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:08:21.544799 22503 raft_consensus.cc:606] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:21.547664 22427 raft_consensus.cc:2955] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:21.555231 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 44338.5us
I20260709 13:08:21.557320 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:21.559018 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:21.555140 22331 catalog_manager.cc:5697] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.627238 22503 consensus_queue.cc:237] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:21.636435 23112 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:21.639721 22329 catalog_manager.cc:5697] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.598328 27870 ts_tablet_manager.cc:1929] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 13:08:21.652395 22429 raft_consensus.cc:1275] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:21.638782 27854 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:08:21.657138 27870 log.cc:1199] T 4293c025258b4f61abd2346d38a2752b P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/4293c025258b4f61abd2346d38a2752b
I20260709 13:08:21.676055 22576 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:21.666528 27711 consensus_queue.cc:1048] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:08:21.716765 22506 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:21.721680 27876 raft_consensus.cc:993] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower e32ba8e6132b4f8e98a99066b6fffe05 to start an election
I20260709 13:08:21.730001 23107 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:21.729743 27800 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:21.734213 27876 raft_consensus.cc:1081] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Signalling peer e32ba8e6132b4f8e98a99066b6fffe05 to start an election
I20260709 13:08:21.736220 27762 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:21.737986 22427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:51866
I20260709 13:08:21.738576 23112 raft_consensus.cc:2955] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.738603 22427 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.745695 22427 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.754711 27761 raft_consensus.cc:2955] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.757954 23109 raft_consensus.cc:2955] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.759299 27878 raft_consensus.cc:2955] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.760231 22429 raft_consensus.cc:2955] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.708307 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet 4293c025258b4f61abd2346d38a2752b (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
W20260709 13:08:21.762682 22318 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 54491.8us
I20260709 13:08:21.785393 22503 raft_consensus.cc:2955] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.804186 22427 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:21.807116 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:21.807783 22504 raft_consensus.cc:3055] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:21.808087 22504 raft_consensus.cc:740] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:21.807394 22329 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 9 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.810384 22427 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:21.811311 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:21.811862 22580 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.809921 22329 catalog_manager.cc:5697] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 11 to 12, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.827880 27762 raft_consensus.cc:993] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: : Instructing follower e32ba8e6132b4f8e98a99066b6fffe05 to start an election
I20260709 13:08:21.828423 27762 raft_consensus.cc:1081] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Signalling peer e32ba8e6132b4f8e98a99066b6fffe05 to start an election
I20260709 13:08:21.832237 22427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:51870
I20260709 13:08:21.832948 22427 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.833369 22427 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.808889 22504 consensus_queue.cc:260] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:21.841182 22504 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.846508 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet add2d1ead99b44f6b4c0bb7f2fa9857a with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:21.836601 22508 raft_consensus.cc:2955] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:21.858745 22580 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:21.862977 22399 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:21.866367 22427 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:21.872589 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:21.872709 27851 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:21.873423 27851 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:21.874323 27851 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:21.875864 22504 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:21.878422 22503 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.884599 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:21.885219 23109 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.902614 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bc53a10833c40d7b01be713f425dfcc with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51860
I20260709 13:08:21.907032 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet add2d1ead99b44f6b4c0bb7f2fa9857a with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:49180
I20260709 13:08:21.908430 27870 tablet_replica.cc:333] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:08:21.909560 27870 raft_consensus.cc:2243] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:21.910359 27870 raft_consensus.cc:2272] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:21.910892 23109 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:21.915108 27870 ts_tablet_manager.cc:1916] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:21.906577 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:21.916934 22580 raft_consensus.cc:3055] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:21.923020 27880 tablet_replica.cc:333] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:21.927671 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9bc53a10833c40d7b01be713f425dfcc with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:21.937243 22427 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:21.943406 22503 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
I20260709 13:08:21.944183 22508 raft_consensus.cc:1240] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:21.947638 27800 consensus_queue.cc:1059] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:21.948730 22396 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:21.950050 27828 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:21.950630 27828 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:21.951599 27828 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:21.917294 22580 raft_consensus.cc:740] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:21.969569 22580 consensus_queue.cc:260] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:21.971243 22580 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.979437 22329 catalog_manager.cc:5697] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 12 to 13, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.006107 27878 raft_consensus.cc:993] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:22.006793 27855 raft_consensus.cc:1081] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:22.008862 22577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdfa7f3695964682a28952992553f739"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49184
I20260709 13:08:22.009531 22577 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:22.009905 22577 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.012346 27880 raft_consensus.cc:2243] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.013365 27880 raft_consensus.cc:2272] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.019347 22580 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 12.
W20260709 13:08:22.020063 27762 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:08:22.026945 27880 ts_tablet_manager.cc:1916] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:22.036247 22329 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 11 to 12, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 12 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.046240 22577 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:22.050525 22427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:22.051235 22427 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.059015 27870 ts_tablet_manager.cc:1929] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:08:22.059540 27870 log.cc:1199] T add2d1ead99b44f6b4c0bb7f2fa9857a P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/add2d1ead99b44f6b4c0bb7f2fa9857a
I20260709 13:08:22.060933 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:22.061568 22504 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:22.061842 22504 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:22.062547 22504 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:22.063589 22504 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.070399 22576 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:22.073686 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet add2d1ead99b44f6b4c0bb7f2fa9857a (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:22.078016 23109 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:22.078498 27880 ts_tablet_manager.cc:1929] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:08:22.079130 27880 log.cc:1199] T 9bc53a10833c40d7b01be713f425dfcc P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/9bc53a10833c40d7b01be713f425dfcc
I20260709 13:08:22.079533 22506 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:22.079627 27761 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:22.082576 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet 9bc53a10833c40d7b01be713f425dfcc (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:22.084875 27761 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:22.087253 27800 raft_consensus.cc:2955] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:22.097838 22504 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 16.
I20260709 13:08:22.105823 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 07e24d8dba0542d7a1428819c63159f5 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:22.106293 22545 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:22.105316 23109 raft_consensus.cc:2955] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:22.107625 27762 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:22.108355 27762 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:22.109279 27762 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:22.111651 22506 raft_consensus.cc:2955] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:22.112587 22577 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:22.125793 22327 catalog_manager.cc:5697] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 10 to 11, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:22.128598 22427 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 16.
I20260709 13:08:22.150744 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet 07e24d8dba0542d7a1428819c63159f5 with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:51860
I20260709 13:08:22.151734 27880 tablet_replica.cc:333] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:22.152777 27880 raft_consensus.cc:2243] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.153601 27880 raft_consensus.cc:2272] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.160138 27880 ts_tablet_manager.cc:1916] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:22.194975 22329 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 15 to 16, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 16 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.207094 27880 ts_tablet_manager.cc:1929] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 13:08:22.207715 27880 log.cc:1199] T 07e24d8dba0542d7a1428819c63159f5 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/07e24d8dba0542d7a1428819c63159f5
I20260709 13:08:22.211078 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet 07e24d8dba0542d7a1428819c63159f5 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:22.280432 22504 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:22.282305 27826 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:22.333170 22576 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:22.346334 27851 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:22.350039 22504 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:22.355327 27828 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:22.495304 23109 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:22.502542 27826 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:22.537456 22427 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:22.545058 27841 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:22.560091 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:22.567667 22580 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:22.620093 27828 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:22.625878 22504 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:22.628261 27762 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:22.684533 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 63875.7us
W20260709 13:08:22.730983 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44513us
W20260709 13:08:22.880741 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 85736.2us
W20260709 13:08:22.984115 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 94829.1us
W20260709 13:08:23.019117 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 99119.2us
I20260709 13:08:23.041937 22424 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:23.049036 23112 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:23.054170 22504 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:23.057776 27851 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:23.061372 27895 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:23.097340 27895 raft_consensus.cc:2955] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 7 to 10, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:23.123956 27889 log.cc:927] Time spent T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.051s	user 0.014s	sys 0.000s
I20260709 13:08:23.118175 22503 raft_consensus.cc:2955] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 7 to 10, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:23.140240 23112 raft_consensus.cc:2955] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 7 to 10, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:23.162034 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1dcd5807b34a410c9196ed1b6e80ace3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.176081 22331 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 7 to 10, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 12 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:23.331007 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dcd5807b34a410c9196ed1b6e80ace3 with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49180
I20260709 13:08:23.390022 27909 tablet_replica.cc:333] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:08:23.391295 27909 raft_consensus.cc:2243] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:23.391987 27909 raft_consensus.cc:2272] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:23.406296 27909 ts_tablet_manager.cc:1916] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:23.441875 27909 ts_tablet_manager.cc:1929] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:08:23.442494 27909 log.cc:1199] T 1dcd5807b34a410c9196ed1b6e80ace3 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/1dcd5807b34a410c9196ed1b6e80ace3
I20260709 13:08:23.444648 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet 1dcd5807b34a410c9196ed1b6e80ace3 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:23.504705 22424 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:08:23.556368 22398 consensus_peers.cc:597] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 634877efa82d48ea9055feb74030391f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:23.558854 22577 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:23.560946 27895 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:23.561507 22503 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:23.563406 27851 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:23.655679 27851 raft_consensus.cc:2955] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:23.657325 22504 raft_consensus.cc:2955] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:23.678490 22576 raft_consensus.cc:2955] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:23.707475 22327 catalog_manager.cc:5697] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:23.715600 22503 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:08:23.765728 22473 consensus_peers.cc:597] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c88522d64a9464ea79df0c6a6aa9652. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:23.788586 22577 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:23.802254 27897 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:08:23.820665 22424 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:23.822585 27897 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:23.879316 27855 raft_consensus.cc:2955] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:23.906803 22426 raft_consensus.cc:2955] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:23.924290 22577 raft_consensus.cc:2955] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:23.925943 22424 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:23.927117 22331 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 12 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.957796 22577 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:23.960124 27902 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:08:23.961189 22398 consensus_peers.cc:597] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 109ad37fc4fb45618b11eb81e3b2c7d2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:23.968746 22503 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:23.970820 27895 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:08:24.014391 22577 raft_consensus.cc:2955] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:24.012320 27902 raft_consensus.cc:2955] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:24.053504 27919 ts_tablet_manager.cc:933] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
I20260709 13:08:24.054134 22325 catalog_manager.cc:5697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:24.068672 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:24.077751 22503 raft_consensus.cc:2955] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:24.087182 27919 tablet_copy_client.cc:323] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.1:43859
I20260709 13:08:24.089481 22443 tablet_copy_service.cc:140] P e32ba8e6132b4f8e98a99066b6fffe05: Received BeginTabletCopySession request for tablet 634877efa82d48ea9055feb74030391f from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:34614)
I20260709 13:08:24.090229 22443 tablet_copy_service.cc:161] P e32ba8e6132b4f8e98a99066b6fffe05: Beginning new tablet copy session on tablet 634877efa82d48ea9055feb74030391f from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:34614: session id = 9cea93fb03e04e48a6dabc4094ee7c93-634877efa82d48ea9055feb74030391f
I20260709 13:08:24.092056 22424 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:24.119342 22443 tablet_copy_source_session.cc:215] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:24.131536 27919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634877efa82d48ea9055feb74030391f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.147840 22576 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:08:24.149300 22398 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff0a64e3152c4ccbbff4e78b6e82db2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:24.149746 27892 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:24.168692 22503 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:24.175833 27892 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:24.199919 27922 ts_tablet_manager.cc:933] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:24.203167 27895 raft_consensus.cc:2955] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:24.212694 22576 raft_consensus.cc:2955] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:24.215270 22508 raft_consensus.cc:2955] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:24.225143 27919 tablet_copy_client.cc:806] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:24.228237 27919 tablet_copy_client.cc:670] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:24.257923 27919 tablet_copy_client.cc:538] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:24.262328 22331 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 14 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.360673 27922 tablet_copy_client.cc:323] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:08:24.393829 22518 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 2c88522d64a9464ea79df0c6a6aa9652 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:08:24.394501 22518 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 2c88522d64a9464ea79df0c6a6aa9652 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-2c88522d64a9464ea79df0c6a6aa9652
I20260709 13:08:24.414652 22577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:08:24.415464 22577 raft_consensus.cc:606] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:24.420753 22426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:24.421379 22426 raft_consensus.cc:606] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:24.425922 27926 ts_tablet_manager.cc:933] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
I20260709 13:08:24.431032 27919 tablet_bootstrap.cc:492] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:24.438231 22424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:24.449193 22424 raft_consensus.cc:606] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Received request to transfer leadership to TS e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:24.450709 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:24.452416 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:24.441299 22518 tablet_copy_source_session.cc:215] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:24.460690 27922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c88522d64a9464ea79df0c6a6aa9652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.467803 27800 raft_consensus.cc:993] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: : Instructing follower e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:24.468346 27800 raft_consensus.cc:1081] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Signalling peer e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:24.471601 22508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:58708
I20260709 13:08:24.472239 22508 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:24.475409 22508 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.482971 22508 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:24.485747 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:24.486471 22424 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.493484 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:24.494181 22576 raft_consensus.cc:3055] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:24.494505 22576 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:24.487847 22508 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:24.497622 22576 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:24.498890 22576 raft_consensus.cc:3060] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.514178 22424 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:24.520115 22472 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:24.521844 22576 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:24.525146 27855 raft_consensus.cc:2804] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:24.525708 27855 raft_consensus.cc:697] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:24.526628 27855 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:24.564836 27926 tablet_copy_client.cc:323] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.1:43859
I20260709 13:08:24.864209 22443 tablet_copy_service.cc:140] P e32ba8e6132b4f8e98a99066b6fffe05: Received BeginTabletCopySession request for tablet 109ad37fc4fb45618b11eb81e3b2c7d2 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:34614)
I20260709 13:08:24.868580 22443 tablet_copy_service.cc:161] P e32ba8e6132b4f8e98a99066b6fffe05: Beginning new tablet copy session on tablet 109ad37fc4fb45618b11eb81e3b2c7d2 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:34614: session id = 9cea93fb03e04e48a6dabc4094ee7c93-109ad37fc4fb45618b11eb81e3b2c7d2
W20260709 13:08:24.943662 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 53050us
I20260709 13:08:24.957312 27922 tablet_copy_client.cc:806] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
W20260709 13:08:24.972240 27943 log.cc:927] Time spent T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:08:24.988821 22325 catalog_manager.cc:5697] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 12 to 13, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.010620 27922 tablet_copy_client.cc:670] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:25.034633 22443 tablet_copy_source_session.cc:215] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:25.053160 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 128950us
W20260709 13:08:25.060298 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 168616us
W20260709 13:08:25.119781 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 56286.2us
W20260709 13:08:25.124629 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 171643us
W20260709 13:08:25.136292 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 153317us
I20260709 13:08:25.169402 27970 ts_tablet_manager.cc:933] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
I20260709 13:08:25.181104 27922 tablet_copy_client.cc:538] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:25.194571 27966 raft_consensus.cc:993] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
W20260709 13:08:25.197048 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 111905us
I20260709 13:08:25.209393 27926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109ad37fc4fb45618b11eb81e3b2c7d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.219379 22578 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:25.225445 27939 raft_consensus.cc:1081] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Signalling peer e47a624c3ddb48c5a8947ac0b3e71f84 to start an election
I20260709 13:08:25.234311 22508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
 from {username='slave'} at 127.0.0.1:58706
I20260709 13:08:25.234901 22508 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.235272 22508 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.237502 27922 tablet_bootstrap.cc:492] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:25.266378 22432 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:25.289439 22508 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:25.311602 22508 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:25.289239 27970 tablet_copy_client.cc:323] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.1:43859
I20260709 13:08:25.318436 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:25.319047 22575 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.297210 27956 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:25.324697 27957 raft_consensus.cc:993] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:25.325433 27958 raft_consensus.cc:1081] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:25.339819 22575 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:08:25.340381 22443 tablet_copy_service.cc:140] P e32ba8e6132b4f8e98a99066b6fffe05: Received BeginTabletCopySession request for tablet ff0a64e3152c4ccbbff4e78b6e82db2a from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:34614)
I20260709 13:08:25.341073 22443 tablet_copy_service.cc:161] P e32ba8e6132b4f8e98a99066b6fffe05: Beginning new tablet copy session on tablet ff0a64e3152c4ccbbff4e78b6e82db2a from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:34614: session id = 9cea93fb03e04e48a6dabc4094ee7c93-ff0a64e3152c4ccbbff4e78b6e82db2a
I20260709 13:08:25.344081 22474 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:25.345290 27961 raft_consensus.cc:2804] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:25.346040 27961 raft_consensus.cc:697] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:25.346936 27961 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:25.350647 27934 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:25.353833 22429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:25.354108 22575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:08:25.356966 22429 raft_consensus.cc:3055] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:25.357141 22575 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.357780 22575 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.357347 22429 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:25.358655 22429 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:25.360177 22429 raft_consensus.cc:3060] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.363854 27926 tablet_copy_client.cc:806] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:25.386392 22443 tablet_copy_source_session.cc:215] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:25.372663 27926 tablet_copy_client.cc:670] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:25.399364 27919 tablet_bootstrap.cc:492] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:25.399799 22575 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:25.406596 22429 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:08:25.414907 27970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0a64e3152c4ccbbff4e78b6e82db2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.415556 22576 raft_consensus.cc:1240] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Rejecting Update request from peer e32ba8e6132b4f8e98a99066b6fffe05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:25.420951 27919 tablet_bootstrap.cc:492] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:25.422060 27919 ts_tablet_manager.cc:1403] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.991s	user 0.049s	sys 0.007s
I20260709 13:08:25.429991 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:25.430660 22424 raft_consensus.cc:3055] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:25.430958 22424 raft_consensus.cc:740] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:25.431834 22424 consensus_queue.cc:260] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:25.433799 22575 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:25.440335 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:25.441339 23112 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.458673 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.500578 27926 tablet_copy_client.cc:538] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:25.448874 27892 consensus_queue.cc:1059] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:08:25.511638 22424 raft_consensus.cc:3060] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.525447 23112 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:25.530385 22547 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:25.581081 22424 raft_consensus.cc:2468] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:25.556576 27800 raft_consensus.cc:2804] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:25.592881 27800 raft_consensus.cc:697] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:25.594040 27800 consensus_queue.cc:237] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:25.590917 27919 raft_consensus.cc:359] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:25.632354 27926 tablet_bootstrap.cc:492] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:25.641006 22327 catalog_manager.cc:5697] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 14 to 15, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 15 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.622617 27919 raft_consensus.cc:740] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:25.665472 27919 consensus_queue.cc:260] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:25.668242 27919 ts_tablet_manager.cc:1434] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.246s	user 0.003s	sys 0.005s
I20260709 13:08:25.678956 22443 tablet_copy_service.cc:342] P e32ba8e6132b4f8e98a99066b6fffe05: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-634877efa82d48ea9055feb74030391f received from {username='slave'} at 127.0.0.1:34614
I20260709 13:08:25.679471 22443 tablet_copy_service.cc:434] P e32ba8e6132b4f8e98a99066b6fffe05: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-634877efa82d48ea9055feb74030391f on tablet 634877efa82d48ea9055feb74030391f with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:25.647855 27970 tablet_copy_client.cc:806] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:25.681671 27970 tablet_copy_client.cc:670] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:25.690224 27970 tablet_copy_client.cc:538] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:25.764658 27970 tablet_bootstrap.cc:492] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:25.790766 22426 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:25.796406 27899 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:25.797334 22329 catalog_manager.cc:5697] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 11 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.840947 23107 raft_consensus.cc:1217] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:08:25.842448 22579 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:25.859722 27948 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:25.992009 27922 tablet_bootstrap.cc:492] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:25.999706 27926 tablet_bootstrap.cc:492] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:26.000608 27922 tablet_bootstrap.cc:492] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:26.000783 27926 tablet_bootstrap.cc:492] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:26.001567 27922 ts_tablet_manager.cc:1403] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.764s	user 0.051s	sys 0.016s
I20260709 13:08:26.004770 27926 ts_tablet_manager.cc:1403] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.373s	user 0.039s	sys 0.007s
I20260709 13:08:26.015683 27922 raft_consensus.cc:359] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:08:26.050078 27985 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:08:26.034219 27922 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:26.063441 27922 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:26.066681 27922 ts_tablet_manager.cc:1434] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 13:08:26.070442 27926 raft_consensus.cc:359] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:26.071367 27926 raft_consensus.cc:740] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:26.075660 22518 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-2c88522d64a9464ea79df0c6a6aa9652 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:08:26.076169 22518 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-2c88522d64a9464ea79df0c6a6aa9652 on tablet 2c88522d64a9464ea79df0c6a6aa9652 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:26.087699 23107 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:26.090634 27970 tablet_bootstrap.cc:492] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:26.072060 27926 consensus_queue.cc:260] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:26.092818 27970 tablet_bootstrap.cc:492] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:26.094905 27970 ts_tablet_manager.cc:1403] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.333s	user 0.034s	sys 0.010s
I20260709 13:08:26.094941 27926 ts_tablet_manager.cc:1434] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.082s	user 0.001s	sys 0.004s
I20260709 13:08:26.099830 22443 tablet_copy_service.cc:342] P e32ba8e6132b4f8e98a99066b6fffe05: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-109ad37fc4fb45618b11eb81e3b2c7d2 received from {username='slave'} at 127.0.0.1:34614
I20260709 13:08:26.100348 22443 tablet_copy_service.cc:434] P e32ba8e6132b4f8e98a99066b6fffe05: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-109ad37fc4fb45618b11eb81e3b2c7d2 on tablet 109ad37fc4fb45618b11eb81e3b2c7d2 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:26.104166 27970 raft_consensus.cc:359] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:26.109117 22426 raft_consensus.cc:1275] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:26.113960 27800 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:26.121212 27844 consensus_queue.cc:1048] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:26.111775 27970 raft_consensus.cc:740] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:26.131762 27970 consensus_queue.cc:260] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:26.150576 23107 raft_consensus.cc:1217] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:08:26.183705 27970 ts_tablet_manager.cc:1434] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.000s
I20260709 13:08:26.186343 22443 tablet_copy_service.cc:342] P e32ba8e6132b4f8e98a99066b6fffe05: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-ff0a64e3152c4ccbbff4e78b6e82db2a received from {username='slave'} at 127.0.0.1:34614
I20260709 13:08:26.186808 22443 tablet_copy_service.cc:434] P e32ba8e6132b4f8e98a99066b6fffe05: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-ff0a64e3152c4ccbbff4e78b6e82db2a on tablet ff0a64e3152c4ccbbff4e78b6e82db2a with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:26.263370 23107 raft_consensus.cc:1217] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 13:08:26.341863 27892 raft_consensus.cc:1064] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:26.349754 27892 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:26.374800 23107 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:26.375650 22503 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:26.377763 27939 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:26.378664 22579 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:26.379736 27939 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:26.396595 27953 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:26.460206 27991 raft_consensus.cc:2955] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:26.464262 22579 raft_consensus.cc:2955] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:26.486739 23110 raft_consensus.cc:2955] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:26.492093 22503 raft_consensus.cc:2955] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:26.525233 22325 catalog_manager.cc:5697] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:26.616235 23110 raft_consensus.cc:1217] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:08:26.739111 27934 raft_consensus.cc:1064] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:26.741429 27934 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:26.771283 27939 raft_consensus.cc:1064] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:26.774080 27939 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:26.818900 23110 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:26.857381 27892 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:26.860560 22575 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:26.861142 22503 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:26.863418 27953 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:26.867614 23110 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:26.869822 22579 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:26.876837 27992 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:26.872900 27948 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:08:26.880121 22424 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:26.880359 27899 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:26.925987 22424 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:26.930747 23112 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:26.936269 27953 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:26.933851 27934 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:08:26.973227 27991 raft_consensus.cc:2955] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:26.989485 27992 raft_consensus.cc:2955] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:26.991117 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:27.003393 22506 raft_consensus.cc:2955] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.021250 23110 raft_consensus.cc:2955] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.042282 22327 catalog_manager.cc:5697] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 10 to 11, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.057549 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 634877efa82d48ea9055feb74030391f with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:27.084072 22498 tablet_service.cc:1558] Processing DeleteTablet for tablet 634877efa82d48ea9055feb74030391f with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:27.091737 22327 catalog_manager.cc:5697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.094997 23110 raft_consensus.cc:2955] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.114784 27899 raft_consensus.cc:2955] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.132143 22579 raft_consensus.cc:2955] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.138592 22576 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:27.143532 28011 tablet_replica.cc:333] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:08:27.145413 28011 raft_consensus.cc:2243] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.146507 28011 raft_consensus.cc:2272] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.171571 28011 ts_tablet_manager.cc:1916] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:27.174939 27953 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:27.192760 27939 raft_consensus.cc:1064] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:27.218463 22573 raft_consensus.cc:2955] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.220455 22576 raft_consensus.cc:2955] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.221616 23110 raft_consensus.cc:2955] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.230590 27939 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:27.232977 22506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:08:27.237905 22506 raft_consensus.cc:606] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:27.216882 22325 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.290424 22425 raft_consensus.cc:2955] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.299234 23107 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 LEARNER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:27.305259 27991 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:27.313055 22506 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:27.315231 22508 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:27.317425 27892 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:27.316226 22432 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:27.324656 22576 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:27.326779 22576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:08:27.327391 22576 raft_consensus.cc:606] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:27.331568 23110 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:27.333209 22503 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:27.333326 27953 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:27.337810 27953 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:27.349176 27892 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:27.349982 28011 ts_tablet_manager.cc:1929] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:08:27.350572 28011 log.cc:1199] T 634877efa82d48ea9055feb74030391f P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/634877efa82d48ea9055feb74030391f
I20260709 13:08:27.353417 23112 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:27.361016 27948 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:27.361989 22503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:08:27.362625 22503 raft_consensus.cc:606] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:27.362578 23112 raft_consensus.cc:2955] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.364038 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:27.367370 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:27.361989 27892 raft_consensus.cc:2955] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:27.489394 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 133471us
I20260709 13:08:27.527712 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 109ad37fc4fb45618b11eb81e3b2c7d2 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:27.530470 27897 raft_consensus.cc:2955] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.535856 27992 raft_consensus.cc:2955] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.541993 23107 raft_consensus.cc:2955] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:27.551487 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 129391us
I20260709 13:08:27.572724 22573 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:27.572948 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 634877efa82d48ea9055feb74030391f (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
W20260709 13:08:27.606393 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 88758.7us
I20260709 13:08:27.608697 23107 raft_consensus.cc:2955] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.631476 22325 catalog_manager.cc:5697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 9 to 10, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.664297 22504 raft_consensus.cc:2955] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:27.663576 22506 raft_consensus.cc:2955] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:27.706806 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 68161.2us
W20260709 13:08:27.730870 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 53157.6us
W20260709 13:08:27.777839 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 105599us
W20260709 13:08:27.778955 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 55363.9us
I20260709 13:08:27.712801 28013 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:08:27.901319 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 105462us
I20260709 13:08:27.923846 22579 raft_consensus.cc:2955] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:27.936703 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 94823us
W20260709 13:08:28.004043 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 74822.7us
I20260709 13:08:28.006175 28023 raft_consensus.cc:993] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower e32ba8e6132b4f8e98a99066b6fffe05 to start an election
I20260709 13:08:28.008500 28020 raft_consensus.cc:1081] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Signalling peer e32ba8e6132b4f8e98a99066b6fffe05 to start an election
I20260709 13:08:28.030210 22315 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2c88522d64a9464ea79df0c6a6aa9652 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:28.034667 22331 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 9 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 12 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:28.042380 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 103648us
I20260709 13:08:28.047904 22426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:51866
I20260709 13:08:28.048552 22426 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.048916 22426 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.113262 22426 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:28.114356 22425 raft_consensus.cc:1240] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.119794 22426 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:28.140801 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:28.141665 22505 raft_consensus.cc:3055] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.141988 22505 raft_consensus.cc:740] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:28.142937 22505 consensus_queue.cc:260] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:28.145893 28035 raft_consensus.cc:993] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:28.146709 28013 raft_consensus.cc:1081] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:28.144255 22505 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.156440 22579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49184
I20260709 13:08:28.156993 22579 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.157305 22579 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.168612 22579 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:28.180397 22505 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:28.197582 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:28.198190 23110 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.204504 22579 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:28.215788 28012 raft_consensus.cc:993] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: : Instructing follower 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:08:28.216389 28012 raft_consensus.cc:1081] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Signalling peer 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:08:28.212785 22575 raft_consensus.cc:2955] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:28.228700 22327 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.235544 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c88522d64a9464ea79df0c6a6aa9652 with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51860
I20260709 13:08:28.237941 23110 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 13.
I20260709 13:08:28.254781 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:28.255388 22508 raft_consensus.cc:3055] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.255702 22508 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:28.256466 22508 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:28.258160 22508 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.275511 22508 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:28.278517 22396 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:28.280257 28031 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:28.280875 28031 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:28.281843 28031 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:28.283815 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:28.284567 23110 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.301282 28055 tablet_replica.cc:333] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:28.327577 28055 raft_consensus.cc:2243] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.302232 23107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5"
dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:59024
I20260709 13:08:28.304350 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet 109ad37fc4fb45618b11eb81e3b2c7d2 with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49180
I20260709 13:08:28.328522 28055 raft_consensus.cc:2272] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.328296 22424 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:28.309634 22545 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:28.334404 23107 raft_consensus.cc:493] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.334863 23107 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.335383 28053 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:28.336221 28053 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:28.313383 23110 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:28.345325 28053 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:28.351186 23107 raft_consensus.cc:515] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:28.353243 23112 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:28.357450 22505 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:28.375720 23110 raft_consensus.cc:1240] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.380499 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.386847 23107 leader_election.cc:290] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:28.387897 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:28.388386 22575 raft_consensus.cc:3055] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.388672 22575 raft_consensus.cc:740] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:28.388865 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24d8dba0542d7a1428819c63159f5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:28.389490 22505 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.391433 28055 ts_tablet_manager.cc:1916] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:28.360118 28047 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:08:28.389411 22575 consensus_queue.cc:260] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:28.399209 22505 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:08:28.400699 23076 leader_election.cc:304] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:28.401782 28033 raft_consensus.cc:2804] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:28.402299 28033 raft_consensus.cc:697] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:28.384810 22327 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 12 to 13, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 13 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.403177 28033 consensus_queue.cc:237] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:28.418720 27892 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:28.424729 28050 consensus_queue.cc:1059] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:28.428370 28057 tablet_replica.cc:333] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:08:28.433835 28057 raft_consensus.cc:2243] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.442282 22575 raft_consensus.cc:3060] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.461054 22575 raft_consensus.cc:2468] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:08:28.456291 28057 raft_consensus.cc:2272] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.472203 28057 ts_tablet_manager.cc:1916] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:28.490010 28029 raft_consensus.cc:2955] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:28.495026 23110 raft_consensus.cc:2955] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:28.548823 22331 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 12 to 13, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.533375 22505 raft_consensus.cc:2955] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:28.570611 28055 ts_tablet_manager.cc:1929] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:08:28.571175 28055 log.cc:1199] T 2c88522d64a9464ea79df0c6a6aa9652 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/2c88522d64a9464ea79df0c6a6aa9652
I20260709 13:08:28.572983 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet 2c88522d64a9464ea79df0c6a6aa9652 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:28.558264 22325 catalog_manager.cc:5697] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 12 to 13, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 13 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.613778 22327 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 11 to 12, VOTER 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) evicted. New cstate: current_term: 14 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:28.617841 28057 ts_tablet_manager.cc:1929] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 13:08:28.618968 22316 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff0a64e3152c4ccbbff4e78b6e82db2a with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:28.638510 28057 log.cc:1199] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/109ad37fc4fb45618b11eb81e3b2c7d2
I20260709 13:08:28.672399 22564 tablet_service.cc:1558] Processing DeleteTablet for tablet ff0a64e3152c4ccbbff4e78b6e82db2a with delete_type TABLET_DATA_TOMBSTONED (TS 10c2f471167442c0b75d8cd50ed8c40c not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:49180
I20260709 13:08:28.674782 22505 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:28.680962 28031 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:28.700590 28057 tablet_replica.cc:333] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:08:28.701108 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet 109ad37fc4fb45618b11eb81e3b2c7d2 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:28.725531 28057 raft_consensus.cc:2243] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.729477 28057 raft_consensus.cc:2272] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.748771 28057 ts_tablet_manager.cc:1916] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:28.748915 23110 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:28.757586 28040 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:28.778618 22508 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:28.781811 28040 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:28.806756 23112 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:28.808331 28029 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:28.867061 28057 ts_tablet_manager.cc:1929] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:08:28.867599 28057 log.cc:1199] T ff0a64e3152c4ccbbff4e78b6e82db2a P 10c2f471167442c0b75d8cd50ed8c40c: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/wals/ff0a64e3152c4ccbbff4e78b6e82db2a
I20260709 13:08:28.871029 22318 catalog_manager.cc:5028] TS 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): tablet ff0a64e3152c4ccbbff4e78b6e82db2a (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:28.881979 22505 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:28.883673 22579 raft_consensus.cc:1275] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:28.886478 28022 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:28.892081 28033 consensus_queue.cc:1048] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:29.696702 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:29.893064 22575 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:29.947746 22508 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:29.950006 28053 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:29.957746 22426 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:29.960968 28012 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:29.972675 22547 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 314cf48b748f4bcd8768227cd02627af. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.014287 22424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:30.014914 22424 raft_consensus.cc:606] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Received request to transfer leadership to TS 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:30.019235 22573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:08:30.019932 22573 raft_consensus.cc:606] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:30.025269 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 66077.7us
I20260709 13:08:30.033751 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:30.035573 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:30.044821 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 87951.5us
W20260709 13:08:30.063753 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 44099.7us
I20260709 13:08:30.077028 28012 raft_consensus.cc:993] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: : Instructing follower 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:08:30.077597 28012 raft_consensus.cc:1081] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Signalling peer 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:08:30.080065 23110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba"
dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:59024
I20260709 13:08:30.080889 23110 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.081393 23110 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.093928 28072 raft_consensus.cc:993] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:30.094470 28072 raft_consensus.cc:1081] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:30.096551 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49188
I20260709 13:08:30.097163 22573 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.097498 22573 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.104717 22573 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:30.089946 23110 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:30.119668 22425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:30.120281 22425 raft_consensus.cc:3055] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:30.120630 22425 raft_consensus.cc:740] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:30.121445 22425 consensus_queue.cc:260] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:30.122642 22425 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.124989 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:30.125629 23112 raft_consensus.cc:3060] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.127547 28076 raft_consensus.cc:2955] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:30.135073 22426 raft_consensus.cc:2955] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:30.139390 22573 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:30.139904 23110 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:30.137550 23112 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
I20260709 13:08:30.141891 22424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:30.163455 22424 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.154361 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:30.169101 22575 raft_consensus.cc:3055] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:30.169570 22575 raft_consensus.cc:740] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:30.170517 22575 consensus_queue.cc:260] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:30.159538 22325 catalog_manager.cc:5697] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.175662 22575 raft_consensus.cc:3060] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.190435 22547 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:30.192718 28076 raft_consensus.cc:2804] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:30.193516 28076 raft_consensus.cc:697] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:30.194461 28076 consensus_queue.cc:237] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:30.212415 22575 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 16.
I20260709 13:08:30.212900 22424 raft_consensus.cc:2468] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 16.
I20260709 13:08:30.224903 23077 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:30.225906 28080 raft_consensus.cc:2804] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:30.226485 28080 raft_consensus.cc:697] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:30.227422 28080 consensus_queue.cc:237] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:30.321938 22425 raft_consensus.cc:2468] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
W20260709 13:08:30.328770 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 94034.1us
I20260709 13:08:30.435170 22508 raft_consensus.cc:2955] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:30.435973 22575 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:30.494112 22327 catalog_manager.cc:5697] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 15 to 16, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 16 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:30.516068 22547 consensus_peers.cc:597] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fdfa7f3695964682a28952992553f739. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.516062 22505 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:30.538779 22329 catalog_manager.cc:5697] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 14 to 15, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 15 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.540584 28076 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:30.619436 28097 ts_tablet_manager.cc:933] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:30.627076 22432 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:30.666062 28050 raft_consensus.cc:2955] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:30.673256 22508 raft_consensus.cc:2955] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:30.675895 28097 tablet_copy_client.cc:323] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:08:30.682737 22575 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:30.686523 22329 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 13, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 16 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.708936 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 314cf48b748f4bcd8768227cd02627af from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:08:30.709609 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 314cf48b748f4bcd8768227cd02627af from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-314cf48b748f4bcd8768227cd02627af
I20260709 13:08:30.718382 22592 tablet_copy_source_session.cc:215] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:30.733785 22547 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64165ef33c5441ef8b91a67653951961. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.734570 22504 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:30.735967 28099 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:30.745287 23112 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:30.753942 28087 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:30.754137 28076 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:30.767894 22426 raft_consensus.cc:1275] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:30.774053 22426 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:30.774101 28097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314cf48b748f4bcd8768227cd02627af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:30.797993 28099 consensus_queue.cc:1048] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:30.802212 28050 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:30.812832 22426 raft_consensus.cc:2955] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:30.844144 22426 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:30.844858 28087 raft_consensus.cc:2955] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:30.848259 28075 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:30.870736 22575 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:30.870846 22508 raft_consensus.cc:2955] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:30.874931 22425 raft_consensus.cc:2955] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:30.895186 22327 catalog_manager.cc:5697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.014673 22504 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:31.020212 28050 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:31.021729 22426 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:31.033479 28050 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:31.043545 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 67419.1us
I20260709 13:08:31.045545 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:31.097236 28087 raft_consensus.cc:2955] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:31.054423 28097 tablet_copy_client.cc:806] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:31.101186 28097 tablet_copy_client.cc:670] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:31.103256 22575 raft_consensus.cc:1275] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:31.141743 22327 catalog_manager.cc:5697] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 7, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 11 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.156419 22432 raft_consensus.cc:2955] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:31.163733 22504 raft_consensus.cc:2955] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:31.165863 28112 consensus_queue.cc:1048] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:31.167022 22547 consensus_peers.cc:597] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c3eb92518c7460abd36818ae39be5a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.167116 28097 tablet_copy_client.cc:538] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:31.173161 28117 ts_tablet_manager.cc:933] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:31.193307 28097 tablet_bootstrap.cc:492] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:31.249215 28120 ts_tablet_manager.cc:933] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:31.239362 28117 tablet_copy_client.cc:323] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:08:31.255448 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet fdfa7f3695964682a28952992553f739 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:08:31.256047 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet fdfa7f3695964682a28952992553f739 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-fdfa7f3695964682a28952992553f739
I20260709 13:08:31.275815 22592 tablet_copy_source_session.cc:215] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:31.293975 28117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdfa7f3695964682a28952992553f739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.326592 28120 tablet_copy_client.cc:323] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:08:31.329483 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 64165ef33c5441ef8b91a67653951961 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:08:31.330114 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 64165ef33c5441ef8b91a67653951961 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-64165ef33c5441ef8b91a67653951961
I20260709 13:08:31.332321 28117 tablet_copy_client.cc:806] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:31.333088 28117 tablet_copy_client.cc:670] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:31.338413 28117 tablet_copy_client.cc:538] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:31.343638 22592 tablet_copy_source_session.cc:215] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:31.346964 28120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64165ef33c5441ef8b91a67653951961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.354365 28117 tablet_bootstrap.cc:492] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:31.393791 28097 tablet_bootstrap.cc:492] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:31.394868 28097 tablet_bootstrap.cc:492] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:31.396239 28097 ts_tablet_manager.cc:1403] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.203s	user 0.029s	sys 0.008s
I20260709 13:08:31.423034 28097 raft_consensus.cc:359] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:31.424027 28097 raft_consensus.cc:740] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:31.424826 28097 consensus_queue.cc:260] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:31.449069 28097 ts_tablet_manager.cc:1434] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:08:31.481653 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-314cf48b748f4bcd8768227cd02627af received from {username='slave'} at 127.0.0.1:55062
I20260709 13:08:31.482280 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-314cf48b748f4bcd8768227cd02627af on tablet 314cf48b748f4bcd8768227cd02627af with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:31.507617 28097 ts_tablet_manager.cc:933] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:31.508864 23109 raft_consensus.cc:1217] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:08:31.581260 28120 tablet_copy_client.cc:806] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:31.584789 28120 tablet_copy_client.cc:670] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:31.595824 28097 tablet_copy_client.cc:323] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:08:31.602205 28120 tablet_copy_client.cc:538] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:31.606949 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 7c3eb92518c7460abd36818ae39be5a0 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:08:31.607602 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 7c3eb92518c7460abd36818ae39be5a0 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-7c3eb92518c7460abd36818ae39be5a0
I20260709 13:08:31.579268 28117 tablet_bootstrap.cc:492] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:31.620744 22592 tablet_copy_source_session.cc:215] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:31.631815 28117 tablet_bootstrap.cc:492] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:31.635759 28117 ts_tablet_manager.cc:1403] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.282s	user 0.041s	sys 0.013s
I20260709 13:08:31.638182 28120 tablet_bootstrap.cc:492] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:31.658615 28097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3eb92518c7460abd36818ae39be5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.654038 28117 raft_consensus.cc:359] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:31.670785 28117 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:31.673727 28117 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:31.679785 28117 ts_tablet_manager.cc:1434] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:08:31.703814 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-fdfa7f3695964682a28952992553f739 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:08:31.704311 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-fdfa7f3695964682a28952992553f739 on tablet fdfa7f3695964682a28952992553f739 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:31.729224 28097 tablet_copy_client.cc:806] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:31.730196 28097 tablet_copy_client.cc:670] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:31.734100 28097 tablet_copy_client.cc:538] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:31.745874 28097 tablet_bootstrap.cc:492] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:31.883967 28120 tablet_bootstrap.cc:492] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:31.885357 28120 tablet_bootstrap.cc:492] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:31.886317 28120 ts_tablet_manager.cc:1403] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.248s	user 0.038s	sys 0.008s
I20260709 13:08:31.893142 23109 raft_consensus.cc:1217] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.12->[16.13-16.13]   Dedup: 16.13->[]
I20260709 13:08:31.927660 28120 raft_consensus.cc:359] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:31.941519 28120 raft_consensus.cc:740] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:31.942477 28120 consensus_queue.cc:260] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:31.957787 28120 ts_tablet_manager.cc:1434] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:08:31.973387 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-64165ef33c5441ef8b91a67653951961 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:08:31.973886 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-64165ef33c5441ef8b91a67653951961 on tablet 64165ef33c5441ef8b91a67653951961 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:31.975059 28097 tablet_bootstrap.cc:492] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:31.978008 28097 tablet_bootstrap.cc:492] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:31.979624 28097 ts_tablet_manager.cc:1403] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.234s	user 0.038s	sys 0.013s
I20260709 13:08:31.992128 28097 raft_consensus.cc:359] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:31.994220 28097 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:31.995127 28097 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:32.001964 28097 ts_tablet_manager.cc:1434] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:08:32.004125 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-7c3eb92518c7460abd36818ae39be5a0 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:08:32.004654 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-7c3eb92518c7460abd36818ae39be5a0 on tablet 7c3eb92518c7460abd36818ae39be5a0 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:32.023357 23112 raft_consensus.cc:1217] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 13:08:32.103695 28050 raft_consensus.cc:1064] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:32.108357 28050 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:32.179539 22432 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:32.181969 28099 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:32.184969 22507 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:32.191699 28050 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:32.205371 23112 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:32.207093 28099 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:32.252770 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:32.319694 23109 raft_consensus.cc:1217] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:08:32.344341 28130 raft_consensus.cc:1064] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:32.347687 28130 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:32.368371 22426 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:32.392370 28099 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:08:32.412449 22506 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:32.442826 28130 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:08:32.460855 22577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
mode: GRACEFUL
new_leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:08:32.461512 22577 raft_consensus.cc:606] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Received request to transfer leadership to TS e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:32.468326 23112 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:32.470059 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:32.471756 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:32.496799 28099 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:32.507782 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 54217.2us
I20260709 13:08:32.537988 28130 raft_consensus.cc:2955] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:32.544435 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 52534.8us
I20260709 13:08:32.550174 22432 raft_consensus.cc:2955] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:32.625443 23110 raft_consensus.cc:2955] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:32.624192 22331 catalog_manager.cc:5697] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:32.874284 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 435869us
I20260709 13:08:32.882293 28129 raft_consensus.cc:1064] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
W20260709 13:08:32.962122 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 84273.7us
W20260709 13:08:32.966250 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 310245us
W20260709 13:08:33.011566 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.103928 28129 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:33.202807 22508 raft_consensus.cc:2955] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.217833 28099 raft_consensus.cc:1064] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:33.239387 28099 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:33.245546 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.313566 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.324581 22579 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:33.377928 28050 raft_consensus.cc:993] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c: : Instructing follower e32ba8e6132b4f8e98a99066b6fffe05 to start an election
I20260709 13:08:33.379163 28050 raft_consensus.cc:1081] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Signalling peer e32ba8e6132b4f8e98a99066b6fffe05 to start an election
W20260709 13:08:33.396624 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 49193.3us
I20260709 13:08:33.318322 28165 raft_consensus.cc:2955] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.407325 23109 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:33.409512 23109 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:33.419618 28153 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:33.422710 28153 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:33.452929 22508 raft_consensus.cc:2955] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.455700 22507 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:33.457581 22505 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:08:33.458024 28171 log.cc:927] Time spent T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.003s
I20260709 13:08:33.477519 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:33.478754 28173 log.cc:927] Time spent T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:08:33.478197 22426 raft_consensus.cc:2955] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.481256 28129 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:33.471091 28153 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:08:33.551156 22426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
 from {username='slave'} at 127.0.0.1:51870
I20260709 13:08:33.552028 22426 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:33.552414 22426 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.566694 22425 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:33.601745 22426 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:33.658749 22325 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index 13 to 14, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.664834 28128 raft_consensus.cc:2955] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.687610 23112 raft_consensus.cc:2955] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.711114 23105 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:33.713027 22577 consensus_queue.cc:237] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:33.734902 28160 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:33.745942 28179 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:33.754225 22426 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:33.753553 22502 raft_consensus.cc:2955] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.765298 22505 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:33.775267 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:33.776038 22576 raft_consensus.cc:3055] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:33.776351 22576 raft_consensus.cc:740] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:33.777222 22576 consensus_queue.cc:260] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:33.778334 22576 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.778539 28050 raft_consensus.cc:2955] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.772768 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:33.787914 22507 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.787628 28099 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:33.793190 22424 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:33.810071 22429 raft_consensus.cc:1240] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:33.815807 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4d35c45e33c4336b33461cdbe7f7b6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:08:33.809051 23105 raft_consensus.cc:2955] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.811156 23109 raft_consensus.cc:2955] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:33.852777 23107 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:33.859063 28161 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:33.900539 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 50694.1us
W20260709 13:08:33.909409 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 82703.8us
I20260709 13:08:33.931994 22424 raft_consensus.cc:1275] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:33.917662 28099 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:08:33.969326 28161 consensus_queue.cc:1048] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:33.991094 22507 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:08:34.028791 22506 raft_consensus.cc:2955] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.032147 22576 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e32ba8e6132b4f8e98a99066b6fffe05 in term 11.
I20260709 13:08:34.078467 22396 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:08:34.115866 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 62058.4us
I20260709 13:08:34.124641 28147 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:34.125344 28147 raft_consensus.cc:697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Leader. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:34.126262 28147 consensus_queue.cc:237] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:34.139258 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 82837.3us
W20260709 13:08:34.146631 28195 log.cc:927] Time spent T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:34.148326 28161 raft_consensus.cc:2955] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.154170 28162 raft_consensus.cc:2955] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.172585 22507 raft_consensus.cc:2955] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.180349 22432 raft_consensus.cc:2955] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.206974 22426 raft_consensus.cc:2955] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.217921 22425 raft_consensus.cc:2955] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.254374 23109 raft_consensus.cc:2955] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.254457 22327 catalog_manager.cc:5697] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 4 to 10, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 13 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.258412 22327 catalog_manager.cc:5697] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 7 to 8, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } attrs { replace: true } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.290262 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 314cf48b748f4bcd8768227cd02627af with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:34.322465 23107 raft_consensus.cc:2955] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.347245 22577 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:34.388880 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d35c45e33c4336b33461cdbe7f7b6f with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51860
I20260709 13:08:34.397423 22507 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:34.407429 28183 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:34.416822 22331 catalog_manager.cc:5697] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.438421 23112 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:34.442245 28129 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:34.445212 28050 raft_consensus.cc:2955] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 LEADER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.451155 22507 raft_consensus.cc:2955] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.457448 28206 tablet_replica.cc:333] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:34.454255 22325 catalog_manager.cc:5697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: term changed from 10 to 11, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1). New cstate: current_term: 11 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.466311 22325 catalog_manager.cc:5697] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index 9 to 10, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.471479 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fdfa7f3695964682a28952992553f739 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:34.488596 22327 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 14 to 15, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 16 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.488902 23107 raft_consensus.cc:2955] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.495584 22498 tablet_service.cc:1558] Processing DeleteTablet for tablet 314cf48b748f4bcd8768227cd02627af with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:34.501097 28206 raft_consensus.cc:2243] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:34.519443 28206 raft_consensus.cc:2272] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:34.523272 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet fdfa7f3695964682a28952992553f739 with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:51860
I20260709 13:08:34.525349 28207 tablet_replica.cc:333] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:08:34.526576 28207 raft_consensus.cc:2243] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:34.527598 28207 raft_consensus.cc:2272] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:34.545805 28206 ts_tablet_manager.cc:1916] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:34.548525 22577 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:34.554261 22576 consensus_queue.cc:237] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:34.563360 23107 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:34.565546 23107 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:34.568658 28129 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:34.574949 28050 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:34.578171 22503 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:34.581175 22425 raft_consensus.cc:1275] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:34.584142 28130 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:34.588845 28050 consensus_queue.cc:1048] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.554185 28207 ts_tablet_manager.cc:1916] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:34.610669 28175 log.cc:927] Time spent T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: Append to log took a long time: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:08:34.612080 28050 raft_consensus.cc:2955] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.620010 28099 raft_consensus.cc:2955] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:34.644939 28174 log.cc:927] Time spent T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.059s	user 0.003s	sys 0.000s
I20260709 13:08:34.655640 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64165ef33c5441ef8b91a67653951961 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:34.657974 23107 raft_consensus.cc:2955] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.661227 23110 raft_consensus.cc:2955] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.666620 22576 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:34.669045 28168 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:34.674132 22329 catalog_manager.cc:5697] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 10 to 11, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.692620 22503 raft_consensus.cc:2955] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.702638 28207 ts_tablet_manager.cc:1929] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:08:34.704221 28207 log.cc:1199] T 314cf48b748f4bcd8768227cd02627af P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/314cf48b748f4bcd8768227cd02627af
I20260709 13:08:34.721522 22318 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c3eb92518c7460abd36818ae39be5a0 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:34.727890 22498 tablet_service.cc:1558] Processing DeleteTablet for tablet 64165ef33c5441ef8b91a67653951961 with delete_type TABLET_DATA_TOMBSTONED (TS e47a624c3ddb48c5a8947ac0b3e71f84 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:34.728945 28207 tablet_replica.cc:333] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:08:34.728858 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 314cf48b748f4bcd8768227cd02627af (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:34.731937 22507 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:34.746304 28168 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:34.762056 28206 ts_tablet_manager.cc:1929] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 13:08:34.762614 28206 log.cc:1199] T f4d35c45e33c4336b33461cdbe7f7b6f P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/f4d35c45e33c4336b33461cdbe7f7b6f
I20260709 13:08:34.764731 28206 tablet_replica.cc:333] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:34.765681 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet f4d35c45e33c4336b33461cdbe7f7b6f (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:34.782387 22425 raft_consensus.cc:2955] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.785270 28206 raft_consensus.cc:2243] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:34.786264 28206 raft_consensus.cc:2272] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:34.803507 22329 catalog_manager.cc:5697] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: config changed from index 8 to 9, VOTER e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) evicted. New cstate: current_term: 11 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:34.838305 22421 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c3eb92518c7460abd36818ae39be5a0 with delete_type TABLET_DATA_TOMBSTONED (TS e32ba8e6132b4f8e98a99066b6fffe05 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:51860
I20260709 13:08:34.851827 28207 raft_consensus.cc:2243] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:34.864619 28207 raft_consensus.cc:2272] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:34.869262 28206 ts_tablet_manager.cc:1916] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:34.887427 28207 ts_tablet_manager.cc:1916] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:34.923858 28207 ts_tablet_manager.cc:1929] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 13:08:34.924309 28207 log.cc:1199] T 64165ef33c5441ef8b91a67653951961 P e47a624c3ddb48c5a8947ac0b3e71f84: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/wals/64165ef33c5441ef8b91a67653951961
I20260709 13:08:34.929476 22315 catalog_manager.cc:5028] TS e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): tablet 64165ef33c5441ef8b91a67653951961 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:34.936748 28206 ts_tablet_manager.cc:1929] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.14
I20260709 13:08:34.937273 28206 log.cc:1199] T fdfa7f3695964682a28952992553f739 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/fdfa7f3695964682a28952992553f739
I20260709 13:08:34.938685 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet fdfa7f3695964682a28952992553f739 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:34.939216 28206 tablet_replica.cc:333] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:34.940354 28206 raft_consensus.cc:2243] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:34.949883 28206 raft_consensus.cc:2272] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:34.954259 28206 ts_tablet_manager.cc:1916] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:34.985074 28206 ts_tablet_manager.cc:1929] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 13:08:34.985466 28206 log.cc:1199] T 7c3eb92518c7460abd36818ae39be5a0 P e32ba8e6132b4f8e98a99066b6fffe05: Deleting WAL directory at /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/wals/7c3eb92518c7460abd36818ae39be5a0
I20260709 13:08:34.992406 22316 catalog_manager.cc:5028] TS e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): tablet 7c3eb92518c7460abd36818ae39be5a0 (table test-workload [id=f227fb2fd3114276ae94d94a9e5dfcc3]) successfully deleted
I20260709 13:08:35.407671 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:35.495362 22432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d46675566504843a14e59e2035629c3"
dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
mode: GRACEFUL
new_leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:33944
I20260709 13:08:35.496043 22432 raft_consensus.cc:606] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Received request to transfer leadership to TS 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:35.498644 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:35.501848 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:35.613582 28070 raft_consensus.cc:993] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: : Instructing follower 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:08:35.614204 28070 raft_consensus.cc:1081] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Signalling peer 9cea93fb03e04e48a6dabc4094ee7c93 to start an election
I20260709 13:08:35.616003 23107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d46675566504843a14e59e2035629c3"
dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
 from {username='slave'} at 127.0.0.1:59018
I20260709 13:08:35.616611 23107 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:35.616962 23107 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.643944 23107 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:35.646070 23107 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:35.646934 22432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "e32ba8e6132b4f8e98a99066b6fffe05"
I20260709 13:08:35.647557 22432 raft_consensus.cc:3055] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:35.647704 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:35.648329 22576 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.647915 22432 raft_consensus.cc:740] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e32ba8e6132b4f8e98a99066b6fffe05, State: Running, Role: LEADER
I20260709 13:08:35.649260 22432 consensus_queue.cc:260] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:35.650357 22432 raft_consensus.cc:3060] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.657989 22432 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:35.660001 23077 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05; no voters: 
I20260709 13:08:35.661712 28196 raft_consensus.cc:2804] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:35.671452 22576 raft_consensus.cc:2468] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:35.731599 28196 raft_consensus.cc:697] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:35.732779 28196 consensus_queue.cc:237] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:35.770809 22331 catalog_manager.cc:5697] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 11 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 12 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:36.192682 22426 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:36.199538 28215 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:36.203215 22576 raft_consensus.cc:1275] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:36.205164 28214 consensus_queue.cc:1048] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:36.269243 22426 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:08:36.291277 22398 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ceea8b6b718469c8d899d7f03824359. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.294168 22508 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:36.296502 28168 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:36.323946 22576 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e32ba8e6132b4f8e98a99066b6fffe05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:36.381834 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 48791.4us
W20260709 13:08:36.454550 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 112463us
I20260709 13:08:36.457890 28139 raft_consensus.cc:2955] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:08:36.483807 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 151262us
W20260709 13:08:36.484339 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 142049us
I20260709 13:08:36.491578 22507 raft_consensus.cc:2955] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:36.502878 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:36.511967 28227 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:36.532441 22503 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:08:36.559393 22473 consensus_peers.cc:597] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cba81aa4ed494a6c81cc0cf660d6d818. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.608850 22424 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:36.614209 22327 catalog_manager.cc:5697] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 13 leader_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.630700 22576 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:08:36.654735 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 73234.3us
I20260709 13:08:36.662087 22575 raft_consensus.cc:2955] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:36.667389 28140 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:36.680524 28230 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:36.701570 28167 raft_consensus.cc:2955] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:36.704965 22424 raft_consensus.cc:2955] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:36.783592 22331 catalog_manager.cc:5697] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 reported cstate change: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 15 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:36.798552 21312 tablet_server.cc:179] TabletServer@127.20.208.1:0 shutting down...
I20260709 13:08:36.826949 22575 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:08:36.818940 22546 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 13:08:36.832780 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 47408.3us
W20260709 13:08:36.841738 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 54296.4us
I20260709 13:08:36.883168 22581 raft_consensus.cc:2955] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:36.916172 28248 ts_tablet_manager.cc:933] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
W20260709 13:08:36.975304 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 113447us
W20260709 13:08:36.981977 22547 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fe7e8d85f3b4703b850c99a435d1d29. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:36.982066 22546 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.985697 22506 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:36.987831 28194 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:08:36.991564 22546 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.000882 22472 consensus_peers.cc:597] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.001745 22546 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.002480 22472 consensus_peers.cc:597] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.006439 22546 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.011273 22472 consensus_peers.cc:597] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.002466 28248 tablet_copy_client.cc:323] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.1:43859
W20260709 13:08:37.015089 22472 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.015729 22472 consensus_peers.cc:597] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.029639 22472 consensus_peers.cc:597] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.031523 22472 consensus_peers.cc:597] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.039243 22546 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.038343 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.059137 28183 raft_consensus.cc:2955] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:37.074566 22503 raft_consensus.cc:2955] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:37.098291 22331 catalog_manager.cc:5697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index -1 to 8, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 15 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
W20260709 13:08:37.104303 22472 consensus_peers.cc:597] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.110335 22546 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.113400 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.114305 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.124111 22546 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.156997 22503 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:37.185750 28256 ts_tablet_manager.cc:933] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:37.188848 22472 consensus_peers.cc:597] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.192662 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 43484us
W20260709 13:08:37.195540 22546 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.203649 22472 consensus_peers.cc:597] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.209411 22473 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78cbb90e435d471fa07712145d0b9faa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.210487 22581 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:37.210357 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.212571 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.213891 28256 tablet_copy_client.cc:323] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:08:37.213784 28140 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:08:37.216912 22518 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet cba81aa4ed494a6c81cc0cf660d6d818 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:08:37.217538 22518 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet cba81aa4ed494a6c81cc0cf660d6d818 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-cba81aa4ed494a6c81cc0cf660d6d818
W20260709 13:08:37.218123 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.218776 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.219399 22472 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:37.235854 22546 consensus_peers.cc:597] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.250782 22518 tablet_copy_source_session.cc:215] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:37.257799 28256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba81aa4ed494a6c81cc0cf660d6d818. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:37.263492 22472 consensus_peers.cc:597] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.273351 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:08:37.275458 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.276815 21312 tablet_replica.cc:333] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:37.275862 22575 raft_consensus.cc:2955] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:37.272647 28140 raft_consensus.cc:2955] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:37.286720 21312 raft_consensus.cc:2243] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.287552 21312 raft_consensus.cc:2272] T 78cbb90e435d471fa07712145d0b9faa P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.291028 21312 tablet_replica.cc:333] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:37.292029 21312 raft_consensus.cc:2243] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.292778 21312 raft_consensus.cc:2272] T 55dc1d250bfe4f2c9c577323b3736521 P e32ba8e6132b4f8e98a99066b6fffe05 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:37.299916 22546 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.295915 22331 catalog_manager.cc:5697] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index -1 to 9, NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) added. New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } } }
I20260709 13:08:37.306674 21312 tablet_replica.cc:333] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:37.307762 21312 raft_consensus.cc:2243] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:37.309227 21312 raft_consensus.cc:2272] T 634877efa82d48ea9055feb74030391f P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.336002 28256 tablet_copy_client.cc:806] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:37.336844 28256 tablet_copy_client.cc:670] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
W20260709 13:08:37.342947 22472 consensus_peers.cc:597] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.348124 28256 tablet_copy_client.cc:538] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:37.362074 21312 tablet_replica.cc:333] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:37.377884 28256 tablet_bootstrap.cc:492] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:37.404740 21312 raft_consensus.cc:2243] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.409042 21312 raft_consensus.cc:2272] T c04b0ff4c7da4211acec428ae776775a P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.437963 21312 tablet_replica.cc:333] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:37.448462 21312 raft_consensus.cc:2243] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.454732 21312 raft_consensus.cc:2272] T 4293c025258b4f61abd2346d38a2752b P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.480154 21312 tablet_replica.cc:333] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:37.485131 21312 raft_consensus.cc:2243] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.494155 21312 raft_consensus.cc:2272] T 6089498054d24ce99c46fe9be74f8589 P e32ba8e6132b4f8e98a99066b6fffe05 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.502638 21312 tablet_replica.cc:333] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:37.721220 21312 raft_consensus.cc:2243] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:37.714986 28256 log.cc:927] Time spent T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:08:37.802778 21312 raft_consensus.cc:2272] T add2d1ead99b44f6b4c0bb7f2fa9857a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.832072 28272 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:37.875628 21312 tablet_replica.cc:333] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:37.876688 21312 raft_consensus.cc:2243] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.877367 21312 raft_consensus.cc:2272] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e32ba8e6132b4f8e98a99066b6fffe05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.887814 28290 ts_tablet_manager.cc:933] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:37.846719 28272 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:37.939764 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 45612.4us
I20260709 13:08:38.008937 21312 tablet_replica.cc:333] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.013249 21312 raft_consensus.cc:2243] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.011349 28290 tablet_copy_client.cc:323] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.2:42819
I20260709 13:08:38.016901 28229 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:38.017505 28229 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:38.024956 28293 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:38.025683 28293 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:38.037811 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 65344.2us
I20260709 13:08:38.044099 21312 raft_consensus.cc:2272] T c7bfc975f9f54ea59fbab64cd3362a0d P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.047209 21312 tablet_replica.cc:333] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.048012 21312 raft_consensus.cc:2243] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:08:38.053277 22396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 104263us
I20260709 13:08:38.063382 28272 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:38.137270 21312 raft_consensus.cc:2272] T 764f8dc47e2c49648f870ba9bd1b55fc P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.137980 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:38.143776 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 105216us
I20260709 13:08:38.080128 28272 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:08:38.176133 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 108155us
I20260709 13:08:38.175571 28308 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:38.177013 28308 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:38.181244 28308 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:38.187987 28269 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:38.188691 28274 raft_consensus.cc:493] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:38.189284 28274 raft_consensus.cc:515] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.188632 28269 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.191792 28274 leader_election.cc:290] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.192771 28269 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.169345 28272 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.215737 28297 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:38.216405 28297 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:38.217242 28272 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.218513 28297 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:38.252121 21312 tablet_replica.cc:333] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.279215 28256 tablet_bootstrap.cc:492] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:38.312124 21312 raft_consensus.cc:2243] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.312505 28256 tablet_bootstrap.cc:492] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:38.312907 21312 raft_consensus.cc:2272] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.313541 28256 ts_tablet_manager.cc:1403] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.940s	user 0.057s	sys 0.027s
W20260709 13:08:38.320858 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 138551us
I20260709 13:08:38.334398 28306 ts_tablet_manager.cc:933] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:38.338752 28229 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:38.342289 21312 tablet_replica.cc:333] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.343469 21312 raft_consensus.cc:2243] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.350728 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.352391 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.353168 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.353891 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.354387 28227 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:38.355741 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.403759 21312 raft_consensus.cc:2272] T c96fcf9d065e46528b502778fede0f1f P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:38.404628 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 216838us
W20260709 13:08:38.407193 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 247104us
I20260709 13:08:38.399634 28293 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:38.434522 28196 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:38.435202 28269 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:38.435861 28269 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.436743 28308 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:38.437314 28308 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.438078 28269 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.438649 28269 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:38.439365 28308 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.439126 28269 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:38.385725 28227 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.442392 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.443876 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.445960 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.451454 22518 tablet_copy_service.cc:140] P e47a624c3ddb48c5a8947ac0b3e71f84: Received BeginTabletCopySession request for tablet 78cbb90e435d471fa07712145d0b9faa from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:49792)
I20260709 13:08:38.453876 22518 tablet_copy_service.cc:161] P e47a624c3ddb48c5a8947ac0b3e71f84: Beginning new tablet copy session on tablet 78cbb90e435d471fa07712145d0b9faa from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:49792: session id = 9cea93fb03e04e48a6dabc4094ee7c93-78cbb90e435d471fa07712145d0b9faa
I20260709 13:08:38.453878 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.448339 28139 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:38.457644 28277 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:38.459173 28227 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.460592 23109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d46675566504843a14e59e2035629c3" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.462073 23111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.462267 28294 raft_consensus.cc:493] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:38.463239 28168 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:38.463382 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.463955 28293 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:38.464493 28293 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.464869 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.466746 28293 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.439782 28304 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:38.472427 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.435169 28196 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.469671 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.479425 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.479347 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.478338 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.456027 28139 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:38.487552 21312 tablet_replica.cc:333] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.499408 21312 raft_consensus.cc:2243] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.482793 28306 tablet_copy_client.cc:323] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:08:38.507386 28196 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:38.512178 28229 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:38.512758 28311 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:38.505551 28269 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:38.506429 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.512820 28229 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.458246 28277 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.525929 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.513440 28311 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.528671 28233 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:38.468844 28304 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.529532 28233 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.531311 28304 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.531929 28233 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.505595 28139 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:38.463786 28168 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.462845 28294 raft_consensus.cc:515] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.534974 28294 leader_election.cc:290] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.537269 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.538218 28277 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.528950 28311 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.539309 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.540632 22399 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:38.542500 28256 raft_consensus.cc:359] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:38.543521 28256 raft_consensus.cc:740] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:38.544183 28304 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.517439 28229 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.524670 22398 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:38.556067 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.564064 21312 raft_consensus.cc:2272] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.572006 28168 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.581368 28285 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:38.582013 28285 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.565475 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.592429 28285 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.566385 22518 tablet_copy_source_session.cc:215] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:38.597908 22398 raft_consensus.cc:2686] T 8fecad4f2f3d49ea8a691075b31e1f96 P e32ba8e6132b4f8e98a99066b6fffe05: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:08:38.598861 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 74381.6us
I20260709 13:08:38.545979 22399 leader_election.cc:304] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:38.600728 22399 raft_consensus.cc:2686] T 4d46675566504843a14e59e2035629c3 P e32ba8e6132b4f8e98a99066b6fffe05: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:08:38.601246 22399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 55394.9us
I20260709 13:08:38.570109 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.601887 22399 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:38.603015 22399 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:38.604110 22399 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:38.563182 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.605135 28168 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:38.606775 28304 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.599952 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.607430 28304 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.607918 23110 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:38.609196 22399 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:38.611008 22399 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:38.611573 28229 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.613121 21312 tablet_replica.cc:333] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.613209 28304 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.614286 21312 raft_consensus.cc:2243] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.614905 22399 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:38.616657 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 173713us
I20260709 13:08:38.615079 21312 raft_consensus.cc:2272] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.632513 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.599963 22398 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:38.633700 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.641146 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.644114 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572a8927b7f349538a2b1f1300d659d2" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.644747 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.645684 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.645852 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.647145 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.647204 22547 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:38.649788 22547 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:38.634941 28229 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.658290 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.659614 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.660805 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.643575 28304 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.651396 28311 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:38.668617 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.668952 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 4fe7e8d85f3b4703b850c99a435d1d29 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:08:38.669529 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 4fe7e8d85f3b4703b850c99a435d1d29 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-4fe7e8d85f3b4703b850c99a435d1d29
I20260709 13:08:38.674774 28273 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.676805 21312 tablet_replica.cc:333] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.677794 21312 raft_consensus.cc:2243] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.679112 28290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cbb90e435d471fa07712145d0b9faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:38.684517 28311 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.686735 28311 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.664101 28285 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:38.695971 28285 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:38.696381 28285 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.544445 28256 consensus_queue.cc:260] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:38.699569 28256 ts_tablet_manager.cc:1434] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.386s	user 0.009s	sys 0.000s
I20260709 13:08:38.704931 22518 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-cba81aa4ed494a6c81cc0cf660d6d818 received from {username='slave'} at 127.0.0.1:49792
I20260709 13:08:38.705477 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:38.706538 22398 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:38.706725 21312 raft_consensus.cc:2272] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.708272 28229 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.709822 21312 tablet_replica.cc:333] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.710755 21312 raft_consensus.cc:2243] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.711383 21312 raft_consensus.cc:2272] T 063ac6dfc4614afb9ca68efa49225bf7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.710747 22398 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:38.713174 28139 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.715010 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:38.717571 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.705417 22518 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-cba81aa4ed494a6c81cc0cf660d6d818 on tablet cba81aa4ed494a6c81cc0cf660d6d818 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:38.729205 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f070e8e9ed4c95b36baa7f987d1fba" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.729508 22398 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:38.716395 22546 leader_election.cc:336] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:38.736909 22592 tablet_copy_source_session.cc:215] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:38.738596 28229 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.742209 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.744428 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:38.754315 28306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe7e8d85f3b4703b850c99a435d1d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:38.774722 21312 tablet_replica.cc:333] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.775715 21312 raft_consensus.cc:2243] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.776566 21312 raft_consensus.cc:2272] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.780911 28306 tablet_copy_client.cc:806] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:38.781570 28306 tablet_copy_client.cc:670] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:38.786033 28306 tablet_copy_client.cc:538] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:38.810304 28306 tablet_bootstrap.cc:492] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:38.819262 22399 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:38.828569 28285 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.830273 22573 raft_consensus.cc:2393] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 12: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:08:38.831537 22399 raft_consensus.cc:2686] T 28e7a53997c5479d8edfb755d887f72a P e32ba8e6132b4f8e98a99066b6fffe05: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:08:38.838333 22546 leader_election.cc:336] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:38.839633 28290 tablet_copy_client.cc:806] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:38.832510 22399 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:38.840610 22399 raft_consensus.cc:2686] T 0b920299a38a48b1a5c349b6f109fa9f P e32ba8e6132b4f8e98a99066b6fffe05: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:38.841462 22399 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:38.848059 21312 tablet_replica.cc:333] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.861284 21312 raft_consensus.cc:2243] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.840296 28290 tablet_copy_client.cc:670] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:38.862628 21312 raft_consensus.cc:2272] T 22a9d7ee5bd74642bb36af19c37bbd3f P e32ba8e6132b4f8e98a99066b6fffe05 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.865911 21312 tablet_replica.cc:333] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.849304 28285 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:38.851033 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:38.866987 23105 raft_consensus.cc:3060] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.873943 28290 tablet_copy_client.cc:538] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:38.876529 23105 raft_consensus.cc:2468] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:38.879519 22547 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:38.879894 28168 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.880517 28285 raft_consensus.cc:2804] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:38.881220 28285 raft_consensus.cc:697] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:38.882128 28285 consensus_queue.cc:237] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:38.880025 22399 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:38.900180 28139 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.900594 22399 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:38.901612 28139 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.901921 22399 leader_election.cc:304] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:38.902993 28168 raft_consensus.cc:2749] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.903241 22399 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:38.903895 22399 raft_consensus.cc:2686] T bd39ff0031394113b2b75f15cd7c44a4 P e32ba8e6132b4f8e98a99066b6fffe05: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:38.886994 21312 raft_consensus.cc:2243] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.905470 21312 raft_consensus.cc:2272] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.909644 28290 tablet_bootstrap.cc:492] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
I20260709 13:08:38.908321 21312 tablet_replica.cc:333] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:38.919029 22399 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e32ba8e6132b4f8e98a99066b6fffe05; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:38.920222 21312 raft_consensus.cc:2243] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.924583 28139 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:38.927697 21312 raft_consensus.cc:2272] T 69f070e8e9ed4c95b36baa7f987d1fba P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.931159 21312 tablet_replica.cc:333] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
W20260709 13:08:38.941536 23077 leader_election.cc:336] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:38.942075 23077 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:38.949489 21312 raft_consensus.cc:2243] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.959636 28215 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.957477 22327 catalog_manager.cc:5697] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 11 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:38.974079 21312 raft_consensus.cc:2272] T 1dcd5807b34a410c9196ed1b6e80ace3 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.997438 28309 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:38.998019 28309 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:39.014389 21312 tablet_replica.cc:333] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.019414 21312 raft_consensus.cc:2243] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.019977 21312 raft_consensus.cc:2272] T 06de1406fed544b39bf6d0ab441df770 P e32ba8e6132b4f8e98a99066b6fffe05 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.043916 28309 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:39.054983 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:39.052405 22546 leader_election.cc:336] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:39.061829 21312 tablet_replica.cc:333] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.055639 23105 raft_consensus.cc:1217] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:08:39.064743 22545 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:39.069773 28267 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.075744 21312 raft_consensus.cc:2243] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.112829 21312 raft_consensus.cc:2272] T 2647750dc34142bf8dd2c7a3bd334fc4 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.115847 21312 tablet_replica.cc:333] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.132983 21312 raft_consensus.cc:2243] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.134912 21312 raft_consensus.cc:2272] T 5ceea8b6b718469c8d899d7f03824359 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.169844 28306 tablet_bootstrap.cc:492] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=3 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:39.170855 28306 tablet_bootstrap.cc:492] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:39.180008 28306 ts_tablet_manager.cc:1403] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.370s	user 0.035s	sys 0.030s
I20260709 13:08:39.183456 21312 tablet_replica.cc:333] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.185210 21312 raft_consensus.cc:2243] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.200750 21312 raft_consensus.cc:2272] T 17ed109556234df2aeba1d6118cc0a95 P e32ba8e6132b4f8e98a99066b6fffe05 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.237317 28306 raft_consensus.cc:359] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:39.238247 28306 raft_consensus.cc:740] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:39.245040 28306 consensus_queue.cc:260] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:39.250420 21312 tablet_replica.cc:333] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.251497 21312 raft_consensus.cc:2243] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.252154 28306 ts_tablet_manager.cc:1434] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.072s	user 0.000s	sys 0.007s
I20260709 13:08:39.252498 21312 raft_consensus.cc:2272] T 314cf48b748f4bcd8768227cd02627af P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.268756 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-4fe7e8d85f3b4703b850c99a435d1d29 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:08:39.269263 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-4fe7e8d85f3b4703b850c99a435d1d29 on tablet 4fe7e8d85f3b4703b850c99a435d1d29 with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:39.272207 21312 tablet_replica.cc:333] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.274412 21312 raft_consensus.cc:2243] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.275171 21312 raft_consensus.cc:2272] T 64165ef33c5441ef8b91a67653951961 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.278189 21312 tablet_replica.cc:333] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.279006 21312 raft_consensus.cc:2243] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.279663 21312 raft_consensus.cc:2272] T 4ac5249f314546e6a563fe498ff87f21 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.308583 21312 tablet_replica.cc:333] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.309389 21312 raft_consensus.cc:2243] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.310508 21312 raft_consensus.cc:2272] T 03bee4af77fb4bccad7991b1429bba72 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.349923 21312 tablet_replica.cc:333] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.350709 21312 raft_consensus.cc:2243] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.360661 21312 raft_consensus.cc:2272] T 87cca3dfe6984b21bf5701f6f3b21b83 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.363500 21312 tablet_replica.cc:333] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.368767 23110 raft_consensus.cc:1217] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 13:08:39.377851 28324 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:39.378485 28324 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:39.380836 28290 tablet_bootstrap.cc:492] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:39.381819 28290 tablet_bootstrap.cc:492] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
W20260709 13:08:39.384663 22472 leader_election.cc:336] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:39.364327 21312 raft_consensus.cc:2243] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.386893 21312 raft_consensus.cc:2272] T 3cb0890d5a7741bd8793d654027263a2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.390439 28324 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:39.392760 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:39.393430 22575 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:39.396132 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:39.397347 28324 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:39.397786 28324 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:39.398206 28324 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:39.412376 28290 ts_tablet_manager.cc:1403] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.503s	user 0.037s	sys 0.019s
I20260709 13:08:39.412590 23110 raft_consensus.cc:1275] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:39.421739 28299 consensus_queue.cc:1048] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:39.423527 28290 raft_consensus.cc:359] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:39.435693 28290 raft_consensus.cc:740] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:39.453980 28290 consensus_queue.cc:260] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
W20260709 13:08:39.427340 22546 consensus_peers.cc:597] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:39.425439 21312 tablet_replica.cc:333] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.461745 21312 raft_consensus.cc:2243] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.463711 21312 raft_consensus.cc:2272] T 4fe7e8d85f3b4703b850c99a435d1d29 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.417884 28324 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:39.466792 28324 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:39.467554 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:39.470028 22573 raft_consensus.cc:3060] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:39.470317 22472 leader_election.cc:336] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:39.499980 22573 raft_consensus.cc:2468] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:39.469514 21312 tablet_replica.cc:333] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.519093 28290 ts_tablet_manager.cc:1434] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.000s
I20260709 13:08:39.522825 22474 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:39.523855 22518 tablet_copy_service.cc:342] P e47a624c3ddb48c5a8947ac0b3e71f84: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-78cbb90e435d471fa07712145d0b9faa received from {username='slave'} at 127.0.0.1:49792
I20260709 13:08:39.524688 22518 tablet_copy_service.cc:434] P e47a624c3ddb48c5a8947ac0b3e71f84: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-78cbb90e435d471fa07712145d0b9faa on tablet 78cbb90e435d471fa07712145d0b9faa with peer 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:39.524789 28302 raft_consensus.cc:2804] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:39.525380 28302 raft_consensus.cc:697] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:39.526261 28302 consensus_queue.cc:237] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:39.532236 21312 raft_consensus.cc:2243] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.549111 21312 raft_consensus.cc:2272] T ff0a64e3152c4ccbbff4e78b6e82db2a P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.563571 21312 tablet_replica.cc:333] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.564394 21312 raft_consensus.cc:2243] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.580929 21312 raft_consensus.cc:2272] T 0960e28f558c46c9bce238b59dea96f6 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.583079 22327 catalog_manager.cc:5697] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 12 to 13, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.602383 21312 tablet_replica.cc:333] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.622195 28140 raft_consensus.cc:1064] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:39.625077 28140 consensus_queue.cc:237] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:39.630106 21312 raft_consensus.cc:2243] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.631404 21312 raft_consensus.cc:2272] T ee6d9e2f597948e7b4670b3606ebf448 P e32ba8e6132b4f8e98a99066b6fffe05 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.641028 28267 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:39.641584 28267 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:39.644816 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:39.658329 21312 tablet_replica.cc:333] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.644930 28267 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:39.662156 22546 leader_election.cc:336] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:39.662681 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:39.662453 21312 raft_consensus.cc:2243] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.668871 21312 raft_consensus.cc:2272] T c9a63a987ca645719f59f026b5d252c9 P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.672066 21312 tablet_replica.cc:333] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.677366 21312 raft_consensus.cc:2243] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.679801 21312 raft_consensus.cc:2272] T 73e134e5a00e463595325b431f07a3bd P e32ba8e6132b4f8e98a99066b6fffe05 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:39.683914 22396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.699842 23110 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:39.677160 28267 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:39.706120 22575 raft_consensus.cc:1275] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:39.712499 21312 tablet_replica.cc:333] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
W20260709 13:08:39.712898 22472 consensus_peers.cc:597] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:39.713420 21312 raft_consensus.cc:2243] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.714075 21312 raft_consensus.cc:2272] T 93a148d1e8b84ad7815dcaf111f422a7 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.714205 28283 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:39.721496 28324 consensus_queue.cc:1048] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:39.721447 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 70926.8us
I20260709 13:08:39.728579 21312 tablet_replica.cc:333] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.729792 21312 raft_consensus.cc:2243] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.760636 21312 raft_consensus.cc:2272] T bcb965aeed0142a28f51999a91b1eb44 P e32ba8e6132b4f8e98a99066b6fffe05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.811231 23105 raft_consensus.cc:1217] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:08:39.816668 21312 tablet_replica.cc:333] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.818486 21312 raft_consensus.cc:2243] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.819217 21312 raft_consensus.cc:2272] T cba81aa4ed494a6c81cc0cf660d6d818 P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.821153 22575 raft_consensus.cc:2955] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:39.819430 28140 raft_consensus.cc:2955] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:39.832919 21312 tablet_replica.cc:333] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.833738 21312 raft_consensus.cc:2243] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.834432 21312 raft_consensus.cc:2272] T 572a8927b7f349538a2b1f1300d659d2 P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.837436 28296 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:39.838064 28296 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:39.840286 28296 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:39.841907 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:39.837409 21312 tablet_replica.cc:333] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.845624 21312 raft_consensus.cc:2243] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.846823 21312 raft_consensus.cc:2272] T 54dce6002cc94eb7ae9be630281c202c P e32ba8e6132b4f8e98a99066b6fffe05 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.845554 23110 raft_consensus.cc:2955] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:39.856963 21312 tablet_replica.cc:333] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.862681 21312 raft_consensus.cc:2243] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.868453 28267 raft_consensus.cc:1064] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:39.871243 28267 consensus_queue.cc:237] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:39.879106 21312 raft_consensus.cc:2272] T 61ec0e67ff314a57bb23fd055736385a P e32ba8e6132b4f8e98a99066b6fffe05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.874547 22331 catalog_manager.cc:5697] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 10 to 11, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:39.882236 21312 tablet_replica.cc:333] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.889576 21312 raft_consensus.cc:2243] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.891697 21312 raft_consensus.cc:2272] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e32ba8e6132b4f8e98a99066b6fffe05 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:39.894487 23077 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:39.914561 23077 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:39.910771 22507 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:39.918476 28296 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:39.919658 22546 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:39.921864 28267 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:08:39.928647 22546 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:39.932389 22546 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:39.922803 23110 raft_consensus.cc:1275] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:39.934705 28273 consensus_queue.cc:1048] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:39.916682 21312 tablet_replica.cc:333] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05: stopping tablet replica
I20260709 13:08:39.946267 21312 raft_consensus.cc:2243] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.946857 21312 raft_consensus.cc:2272] T e0a2c1c9e9dd4272a78e7cd3da913fad P e32ba8e6132b4f8e98a99066b6fffe05 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:39.961336 22472 consensus_peers.cc:597] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:39.963964 28296 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:39.964623 28296 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:39.972205 28273 raft_consensus.cc:2955] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:39.978413 23077 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:39.978449 22507 raft_consensus.cc:2955] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:39.981624 28296 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:39.981822 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:39.983711 22472 consensus_peers.cc:597] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:39.986068 23076 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:39.988068 28215 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:39.984248 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:40.005445 22546 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.032516 23110 raft_consensus.cc:2955] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:40.054800 22331 catalog_manager.cc:5697] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: config changed from index 8 to 9, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:40.092285 22472 consensus_peers.cc:597] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:40.106597 22472 consensus_peers.cc:597] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:40.153489 28320 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.080s	user 0.037s	sys 0.034s
W20260709 13:08:40.156127 28338 log.cc:927] Time spent T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.060s	user 0.013s	sys 0.006s
I20260709 13:08:40.160188 22575 raft_consensus.cc:1275] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:40.160785 22472 consensus_peers.cc:597] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.178081 28140 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.178675 28140 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.184826 28302 consensus_queue.cc:1048] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:40.186820 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:40.187559 23110 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:40.189042 22473 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:40.189985 28324 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.190373 28324 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.190750 28324 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:40.192945 22472 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:40.199384 28140 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:40.190546 22546 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.207841 28324 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.217011 28140 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.221300 28140 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:40.223209 28324 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:40.223702 22546 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.225956 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109ad37fc4fb45618b11eb81e3b2c7d2" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:40.226658 23110 raft_consensus.cc:3060] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:40.234151 22472 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:40.235085 22472 consensus_peers.cc:597] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.246443 28140 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:40.253253 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:40.254463 22573 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:08:40.255286 23110 raft_consensus.cc:2468] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
W20260709 13:08:40.259153 22472 leader_election.cc:336] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:40.259224 22473 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.267827 28324 raft_consensus.cc:2804] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:40.272773 28324 raft_consensus.cc:697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:40.273825 22474 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.274250 28324 consensus_queue.cc:237] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.275555 28302 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:40.276166 28302 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.276688 28302 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:40.285207 22472 consensus_peers.cc:597] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.298082 28302 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:40.308068 22472 leader_election.cc:336] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:40.311375 22398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 87141us
I20260709 13:08:40.317749 28302 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:40.318848 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:08:40.319384 22546 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.320113 22576 raft_consensus.cc:3060] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.337028 22576 raft_consensus.cc:2468] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 11.
I20260709 13:08:40.347608 28283 raft_consensus.cc:1064] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
W20260709 13:08:40.360774 22546 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.366022 22474 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.364318 28283 consensus_queue.cc:237] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.367599 28298 raft_consensus.cc:2804] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:40.368220 28298 raft_consensus.cc:697] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:40.369143 28298 consensus_queue.cc:237] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:40.378556 22331 catalog_manager.cc:5697] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 13 to 14, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 14 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:40.444695 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.450719 28324 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.451318 28324 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.453689 28324 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:40.455439 28324 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.455955 28324 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:40.460129 22575 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:40.460129 23110 raft_consensus.cc:1275] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEARNER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:40.462467 28324 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:40.467311 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:40.468071 23107 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:40.470674 28324 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:40.472326 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:40.479588 22472 consensus_peers.cc:597] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.480865 22473 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:40.482949 28140 consensus_queue.cc:1048] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:40.483498 28343 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.483984 28343 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.484334 28343 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.526702 28215 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.527410 28215 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.529851 28215 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:40.509716 28302 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.533139 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:40.531600 22331 catalog_manager.cc:5697] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 10 to 11, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 11 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.511750 28298 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.559279 28302 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.565613 28298 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:40.567299 28302 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:40.567817 28298 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:40.575192 28299 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:08:40.575306 22472 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.575925 28299 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:40.576845 22472 leader_election.cc:336] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.577308 22472 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.578042 28299 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:40.577880 28343 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.580531 28343 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:40.583123 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:40.596218 28296 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.596897 28296 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.599128 28296 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:40.616691 28343 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:40.623940 22472 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:40.624747 22472 leader_election.cc:336] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:40.626349 22472 leader_election.cc:336] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.631824 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:40.632647 22576 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
W20260709 13:08:40.634162 22472 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:40.635666 22472 consensus_peers.cc:597] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.634963 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:40.636896 22576 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
W20260709 13:08:40.641834 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 122019us
I20260709 13:08:40.644665 23079 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:40.645427 28296 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:40.645864 28296 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.646175 22474 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.646214 28296 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:40.647410 28355 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.647804 28355 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.648169 28355 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:40.652652 22546 leader_election.cc:336] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.653276 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:40.654449 23077 leader_election.cc:336] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.655176 23077 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:40.658864 28267 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.659451 28267 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:40.661455 28267 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:40.662302 22546 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.662469 28358 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.666815 28350 raft_consensus.cc:2955] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:40.675400 28355 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:40.676519 28296 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.685597 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:40.685853 28356 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.686749 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:40.700578 23107 raft_consensus.cc:3060] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.702675 22473 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.703853 28343 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:40.686072 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.704761 28296 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:40.689993 23110 raft_consensus.cc:2955] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:40.697708 22546 consensus_peers.cc:597] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:40.708395 22546 leader_election.cc:336] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.711452 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:40.712046 22573 raft_consensus.cc:3060] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:40.699777 28355 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:40.714286 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:40.717536 22576 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.719071 22573 raft_consensus.cc:2468] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
W20260709 13:08:40.716058 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.720566 23079 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:08:40.720872 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:40.721374 23077 leader_election.cc:336] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.721596 28296 raft_consensus.cc:2804] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:40.722723 28296 raft_consensus.cc:697] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
W20260709 13:08:40.725752 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:40.726449 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:40.726955 23077 leader_election.cc:336] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.729823 28296 consensus_queue.cc:237] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.732152 23107 raft_consensus.cc:2468] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:40.733630 22473 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.734818 28355 raft_consensus.cc:2804] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:40.735318 28355 raft_consensus.cc:697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:40.736090 28283 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.736709 28283 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.736195 28355 consensus_queue.cc:237] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.738911 28283 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:40.757211 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:40.757887 22502 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:40.760867 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:40.761641 23107 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:40.765452 22473 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:40.771675 28275 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.772117 28275 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.772521 28275 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.777202 22576 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:40.781055 22474 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:40.782126 28355 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:40.782773 28355 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:40.777520 22573 raft_consensus.cc:2955] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:40.783774 28355 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:40.787123 28267 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.787708 28267 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:40.787256 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.790961 28248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59018 (request call id 1389) took 3974 ms. Trace:
I20260709 13:08:40.791488 28248 rpcz_store.cc:276] 0709 13:08:36.816878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.817047 (+   169us) service_pool.cc:224] Handling call
0709 13:08:36.918289 (+101242us) ts_tablet_manager.cc:934] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859)
0709 13:08:40.790849 (+3872560us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":23745,"tablet-copy.queue_time_us":87307,"thread_start_us":102967,"threads_started":2}
I20260709 13:08:40.793015 28343 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.793782 28343 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:40.795739 23079 connection.cc:466] server connection from 127.0.0.1:59018 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59018 (request call id 1389) could send its response
I20260709 13:08:40.796381 28343 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:40.796648 28356 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.797237 28356 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.799505 28356 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:40.804677 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:40.804122 22331 catalog_manager.cc:5697] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 12 to 13, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.790004 28267 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:40.806421 22546 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.805670 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.807298 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:40.807936 22576 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:40.808547 28299 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.808940 28299 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.809337 28299 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.809571 22474 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:40.820400 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:40.855050 28299 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:40.862118 23077 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.862694 23077 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.845849 28343 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.862959 28359 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
W20260709 13:08:40.870196 22472 leader_election.cc:336] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.871397 28196 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:40.873503 22502 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
W20260709 13:08:40.875476 22472 leader_election.cc:336] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.878012 28359 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.891566 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.894150 28357 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.896713 28357 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.897236 28357 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:40.909369 22472 consensus_peers.cc:597] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.909490 23110 raft_consensus.cc:1275] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:40.910194 22472 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:40.911006 22472 consensus_peers.cc:597] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:40.864506 22329 catalog_manager.cc:5697] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 9 to 10, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
W20260709 13:08:40.914440 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 52365.5us
I20260709 13:08:40.912892 28298 consensus_queue.cc:1048] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:40.922173 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:40.923754 28267 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.927557 28267 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.923794 28358 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.928951 28358 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:40.781116 28275 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.919631 28359 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:40.933743 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:40.939148 23110 raft_consensus.cc:3060] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.934417 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:08:40.935010 23077 leader_election.cc:336] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:40.942543 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:40.942934 23107 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 8.
I20260709 13:08:40.943177 22507 raft_consensus.cc:3060] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.944573 22547 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:40.950182 28309 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:40.950358 22507 raft_consensus.cc:2468] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:08:40.950675 28309 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.951135 28309 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:40.948936 22331 catalog_manager.cc:5697] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 11 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 12 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.939599 22502 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 14.
I20260709 13:08:40.967063 23076 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:40.968295 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:40.969508 23110 raft_consensus.cc:2468] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:40.913362 28343 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.971724 22473 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:40.964497 22545 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:40.930243 28299 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:40.976953 28324 raft_consensus.cc:2804] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:40.977520 28324 raft_consensus.cc:697] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:40.978415 28324 consensus_queue.cc:237] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:40.932734 28267 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:40.980674 28354 raft_consensus.cc:2804] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:40.981230 28354 raft_consensus.cc:697] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:40.982115 28354 consensus_queue.cc:237] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:40.931015 28358 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:40.996579 28296 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:40.997063 28296 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:40.997479 28296 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.933837 28275 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:40.973708 28343 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:41.018760 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 54389us
W20260709 13:08:41.027598 22472 consensus_peers.cc:597] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.037849 22573 raft_consensus.cc:1275] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:40.996065 28357 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:41.062115 22331 catalog_manager.cc:5697] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 13 to 14, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 14 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.089133 28343 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:40.973193 28309 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:41.095715 22472 consensus_peers.cc:597] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.096302 22472 leader_election.cc:336] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.096540 28350 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:41.105217 28357 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:41.107475 28309 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:41.084215 28298 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:41.109073 28298 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:41.105006 28350 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:41.111416 28350 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:41.115998 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:41.116925 23105 raft_consensus.cc:3060] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:41.131840 23105 raft_consensus.cc:2468] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 9.
I20260709 13:08:41.134142 28296 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:41.134713 22327 catalog_manager.cc:5697] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 13 to 14, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 14 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.137277 28296 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:41.138034 28343 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:41.133615 22546 leader_election.cc:336] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:41.138928 22546 leader_election.cc:336] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.139346 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:41.140236 22546 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.141187 28367 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:41.111465 28298 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:41.143956 23077 leader_election.cc:336] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:41.159825 22472 leader_election.cc:336] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.160861 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:41.161603 22507 raft_consensus.cc:3060] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.168511 28350 consensus_queue.cc:1048] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:08:41.172686 22502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:41.173337 22502 raft_consensus.cc:606] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Received request to transfer leadership
I20260709 13:08:41.172063 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:41.173254 22507 raft_consensus.cc:2468] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 15.
I20260709 13:08:41.174348 22508 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:41.175979 23076 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:41.178305 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 65413.7us
I20260709 13:08:41.177121 22331 catalog_manager.cc:5697] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 13 to 14, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 14 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.186025 22502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:41.191963 22502 raft_consensus.cc:606] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Received request to transfer leadership
I20260709 13:08:41.178885 28359 raft_consensus.cc:2804] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:41.186991 22547 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:08:41.181106 22472 leader_election.cc:336] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.206691 28367 raft_consensus.cc:2804] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:41.207450 28367 raft_consensus.cc:697] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:41.212531 28367 consensus_queue.cc:237] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:41.216184 22472 consensus_peers.cc:597] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.216849 22472 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.216224 28273 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:41.218560 28273 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:41.199127 28359 raft_consensus.cc:697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:41.225873 28359 consensus_queue.cc:237] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:41.227769 28355 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:41.228348 28355 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:41.232061 28355 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:41.237449 28273 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:41.244244 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:41.245047 22502 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:41.271091 22545 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:41.274540 28369 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:41.274988 28369 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:41.275347 28369 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.277596 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:41.279263 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:41.279850 22576 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 9.
I20260709 13:08:41.281162 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:41.281842 22576 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 13: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
W20260709 13:08:41.282809 22472 leader_election.cc:336] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.284767 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:41.294160 22473 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ceea8b6b718469c8d899d7f03824359. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.295090 22546 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.295706 22573 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:41.296950 22331 catalog_manager.cc:5697] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 14 to 15, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 15 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.295917 22546 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:41.301323 22546 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.301986 28367 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.305299 22327 catalog_manager.cc:5697] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 8 to 9, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 9 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.315281 23112 raft_consensus.cc:1275] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:41.317298 23077 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.323576 28343 consensus_queue.cc:1048] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:41.326622 28369 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:41.328827 21312 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22454)
I20260709 13:08:41.332445 22575 raft_consensus.cc:2393] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 14: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:41.339819 22573 raft_consensus.cc:1275] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:08:41.340888 22546 leader_election.cc:336] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.344396 22474 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:41.347208 22474 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:41.333745 28367 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:41.352643 28367 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:41.354863 22474 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:41.356144 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:41.356760 22507 raft_consensus.cc:3060] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.373680 28367 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:41.354681 28355 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:41.374719 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:41.375469 22508 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 11.
I20260709 13:08:41.364737 28350 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.354096 28369 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:41.357404 28196 consensus_queue.cc:1048] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:08:41.378249 22474 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:41.378554 22503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359"
dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44050
I20260709 13:08:41.379160 22503 raft_consensus.cc:606] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Received request to transfer leadership
I20260709 13:08:41.359169 28298 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:41.381016 28298 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:41.381383 28298 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:41.386938 22507 raft_consensus.cc:2468] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:08:41.387651 28302 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:41.388825 22546 leader_election.cc:336] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.393028 22545 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:41.393931 22545 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:41.395452 28309 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:41.395833 28309 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e32ba8e6132b4f8e98a99066b6fffe05)
I20260709 13:08:41.396176 28309 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.383313 28343 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:41.402674 28369 raft_consensus.cc:2804] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:41.413960 28369 raft_consensus.cc:697] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:41.414865 28369 consensus_queue.cc:237] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:41.417464 22379 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:08:41.417955 22546 leader_election.cc:336] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:41.417953 22379 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 5ceea8b6b718469c8d899d7f03824359 already in progress
W20260709 13:08:41.419382 22379 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5ceea8b6b718469c8d899d7f03824359 already in progress
I20260709 13:08:41.441100 28309 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:41.436012 28298 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:41.468860 28309 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:41.470494 22546 leader_election.cc:336] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.469929 28298 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:41.469044 22472 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.478832 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:41.479436 22503 raft_consensus.cc:3060] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:41.481504 22546 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.487548 28298 raft_consensus.cc:993] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: : Instructing follower 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:41.488077 28298 raft_consensus.cc:1081] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Signalling peer 10c2f471167442c0b75d8cd50ed8c40c to start an election
I20260709 13:08:41.493716 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:41.494367 22577 raft_consensus.cc:3060] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:41.495879 22503 raft_consensus.cc:2468] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 12.
I20260709 13:08:41.497267 22545 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:41.501467 28309 raft_consensus.cc:2804] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:41.502053 28309 raft_consensus.cc:697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:41.502933 28309 consensus_queue.cc:237] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:41.505425 22472 consensus_peers.cc:597] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.521343 22576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359"
dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
 from {username='slave'} at 127.0.0.1:49184
I20260709 13:08:41.522068 22576 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:41.522477 22576 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.520231 22577 raft_consensus.cc:2468] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 10.
I20260709 13:08:41.528163 22327 catalog_manager.cc:5697] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 13 to 14, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 14 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:41.533396 22472 leader_election.cc:336] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.562774 23105 raft_consensus.cc:1275] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:41.568363 28298 consensus_queue.cc:1048] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:41.580037 22504 raft_consensus.cc:1275] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:41.581100 22474 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:41.581441 28369 consensus_queue.cc:1048] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:41.582705 22576 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:41.584036 28302 raft_consensus.cc:2804] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:41.600274 28302 raft_consensus.cc:697] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:41.601294 28302 consensus_queue.cc:237] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:41.607877 22576 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:41.615108 22546 leader_election.cc:336] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:41.617496 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:41.621806 22331 catalog_manager.cc:5697] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 11 to 12, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 12 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.651773 22508 raft_consensus.cc:3055] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:41.652137 22508 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:41.652909 22508 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:41.654247 22508 raft_consensus.cc:3060] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.665030 22508 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
I20260709 13:08:41.684891 22545 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:41.685688 28309 raft_consensus.cc:2804] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:41.686467 28309 raft_consensus.cc:697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:41.700712 28309 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:41.707875 22331 catalog_manager.cc:5697] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 9 to 10, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 10 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.745328 22329 catalog_manager.cc:5697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 14 to 15, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 15 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.821790 23105 raft_consensus.cc:1275] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:41.826444 23077 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111) [suppressed 321 similar messages]
W20260709 13:08:41.835880 23077 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.842906 28367 consensus_queue.cc:1048] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:41.846156 22546 consensus_peers.cc:597] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.861500 22508 raft_consensus.cc:1275] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:41.863587 28359 consensus_queue.cc:1048] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:41.909801 22546 consensus_peers.cc:597] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.994601 22546 consensus_peers.cc:597] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:41.995105 22546 consensus_peers.cc:597] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.996812 22503 raft_consensus.cc:1275] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:41.998914 22503 raft_consensus.cc:1275] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:42.005246 28367 consensus_queue.cc:1048] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:42.009452 28367 consensus_queue.cc:1048] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:42.161804 22472 consensus_peers.cc:597] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:42.163988 22576 raft_consensus.cc:1275] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:42.175009 28343 consensus_queue.cc:1048] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 13:08:42.193280 22546 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:42.197636 22547 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955): Couldn't send request to peer 9cea93fb03e04e48a6dabc4094ee7c93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ceea8b6b718469c8d899d7f03824359. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:42.284878 22472 consensus_peers.cc:597] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.295850 22546 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.330075 21312 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:42.333441 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:42.339591 22504 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:42.341111 28368 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:42.443498 22546 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.461638 22472 consensus_peers.cc:597] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.520629 22472 consensus_peers.cc:597] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.570731 22546 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.627418 22472 consensus_peers.cc:597] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.633162 22546 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.681243 22472 consensus_peers.cc:597] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.714149 22472 consensus_peers.cc:597] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.747931 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.808254 22546 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.815850 22546 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:42.815104 28394 ts_tablet_manager.cc:933] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: Initiating tablet copy from peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:42.819010 22472 consensus_peers.cc:597] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.820170 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49519.8us
W20260709 13:08:42.826119 22546 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.826783 22546 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:42.837836 28394 tablet_copy_client.cc:323] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Beginning tablet copy session from remote peer at address 127.20.208.3:40903
I20260709 13:08:42.847633 22592 tablet_copy_service.cc:140] P 10c2f471167442c0b75d8cd50ed8c40c: Received BeginTabletCopySession request for tablet 5ceea8b6b718469c8d899d7f03824359 from peer 9cea93fb03e04e48a6dabc4094ee7c93 ({username='slave'} at 127.0.0.1:55062)
I20260709 13:08:42.848238 22592 tablet_copy_service.cc:161] P 10c2f471167442c0b75d8cd50ed8c40c: Beginning new tablet copy session on tablet 5ceea8b6b718469c8d899d7f03824359 from peer 9cea93fb03e04e48a6dabc4094ee7c93 at {username='slave'} at 127.0.0.1:55062: session id = 9cea93fb03e04e48a6dabc4094ee7c93-5ceea8b6b718469c8d899d7f03824359
I20260709 13:08:42.860117 22592 tablet_copy_source_session.cc:215] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:42.864001 28394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ceea8b6b718469c8d899d7f03824359. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:42.886350 22472 consensus_peers.cc:597] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.887043 22472 consensus_peers.cc:597] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:42.930404 22472 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:42.974684 28394 tablet_copy_client.cc:806] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:42.975272 28394 tablet_copy_client.cc:670] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:42.978111 28302 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.978715 28302 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:42.991854 28367 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.992455 28367 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:42.994609 28367 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:42.999909 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:43.000650 22504 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:43.003029 28302 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:43.006067 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:43.006754 22576 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:43.009007 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:43.009837 22474 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:43.010048 28393 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:43.010542 28393 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.010882 28393 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:43.023829 22472 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:43.024691 28302 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:43.025182 28302 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.025578 28302 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.030946 28394 tablet_copy_client.cc:538] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:08:43.037122 22546 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:43.047778 22472 consensus_peers.cc:597] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:43.038964 28393 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:43.052608 28393 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:43.054188 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:43.059583 28302 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:43.062980 22504 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 14: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
W20260709 13:08:43.069530 22546 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:43.071039 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:43.071797 22576 raft_consensus.cc:2393] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 14: Already voted for candidate 10c2f471167442c0b75d8cd50ed8c40c in this term.
I20260709 13:08:43.072669 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:43.073855 28393 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:43.082397 22472 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:43.087263 28302 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:43.098454 28394 tablet_bootstrap.cc:492] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap starting.
W20260709 13:08:43.098753 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:43.089300 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:43.103497 28392 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:43.132406 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:43.240831 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 96359.7us
W20260709 13:08:43.286366 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:43.288617 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:43.302616 22546 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:43.336977 21312 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:43.383327 28394 log.cc:927] Time spent T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: Append to log took a long time: real 0.067s	user 0.004s	sys 0.000s
W20260709 13:08:43.410746 22472 consensus_peers.cc:597] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:43.423713 22546 consensus_peers.cc:597] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:43.444214 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:43.462615 22472 consensus_peers.cc:597] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:43.469149 28394 tablet_bootstrap.cc:492] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:43.471366 28394 tablet_bootstrap.cc:492] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: Bootstrap complete.
I20260709 13:08:43.473083 28394 ts_tablet_manager.cc:1403] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent bootstrapping tablet: real 0.384s	user 0.055s	sys 0.014s
W20260709 13:08:43.474720 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 82975.3us
W20260709 13:08:43.486940 22472 consensus_peers.cc:597] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:43.497116 28394 raft_consensus.cc:359] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:43.499027 28394 raft_consensus.cc:740] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Initialized, Role: LEARNER
I20260709 13:08:43.499912 28394 consensus_queue.cc:260] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: NON_VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: true } }
I20260709 13:08:43.512532 28394 ts_tablet_manager.cc:1434] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.003s
W20260709 13:08:43.547312 22472 consensus_peers.cc:597] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:43.568066 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:43.573901 22592 tablet_copy_service.cc:342] P 10c2f471167442c0b75d8cd50ed8c40c: Request end of tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-5ceea8b6b718469c8d899d7f03824359 received from {username='slave'} at 127.0.0.1:55062
I20260709 13:08:43.574608 22592 tablet_copy_service.cc:434] P 10c2f471167442c0b75d8cd50ed8c40c: ending tablet copy session 9cea93fb03e04e48a6dabc4094ee7c93-5ceea8b6b718469c8d899d7f03824359 on tablet 5ceea8b6b718469c8d899d7f03824359 with peer 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:43.609858 22472 consensus_peers.cc:597] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:43.809938 22472 consensus_peers.cc:597] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:43.902688 23107 raft_consensus.cc:1217] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Deduplicated request from leader. Original: 14.10->[15.11-15.11]   Dedup: 15.11->[]
W20260709 13:08:43.967001 23077 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.003065 22546 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.245818 22546 consensus_peers.cc:597] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.338699 21312 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:44.362272 22546 consensus_peers.cc:597] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.416211 23077 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.445739 22546 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.477062 22546 consensus_peers.cc:597] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.501605 22546 consensus_peers.cc:597] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:44.545425 28405 raft_consensus.cc:1064] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: attempting to promote NON_VOTER 9cea93fb03e04e48a6dabc4094ee7c93 to VOTER
I20260709 13:08:44.566049 28405 consensus_queue.cc:237] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:44.598172 22472 consensus_peers.cc:597] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.689378 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 49594.4us
I20260709 13:08:44.693720 23105 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEARNER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:44.693822 22502 raft_consensus.cc:1275] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:08:44.698756 22546 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:44.703392 28393 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:44.705785 28405 consensus_queue.cc:1048] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:44.712090 28412 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.712808 28412 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:44.720602 28412 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:44.722546 22546 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:44.724869 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:44.725732 22503 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:08:44.729368 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:44.730841 28412 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:44.731302 28412 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.731719 28412 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.759143 28405 raft_consensus.cc:2955] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:44.763440 28412 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:44.763686 23107 raft_consensus.cc:2955] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:44.769411 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:44.771147 22502 raft_consensus.cc:3060] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:44.776840 22546 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:44.784431 22503 raft_consensus.cc:2955] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } } }
I20260709 13:08:44.791793 22329 catalog_manager.cc:5697] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: config changed from index 9 to 12, 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:44.798321 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:44.805148 28412 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Requested vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:44.818266 22502 raft_consensus.cc:2468] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
W20260709 13:08:44.819242 22472 consensus_peers.cc:597] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:44.857622 22545 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:44.860832 28412 raft_consensus.cc:2804] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:44.861472 28412 raft_consensus.cc:697] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:44.862458 28412 consensus_queue.cc:237] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:44.928645 22472 consensus_peers.cc:597] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:44.949496 22546 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:44.956159 22546 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:44.973779 22331 catalog_manager.cc:5697] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 12 to 15, leader changed from e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 15 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:44.974962 22546 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:44.976867 22546 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.019543 22472 consensus_peers.cc:597] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:45.046728 22546 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.047438 22546 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.098832 22472 consensus_peers.cc:597] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:45.251748 22502 raft_consensus.cc:1275] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:08:45.254238 22472 consensus_peers.cc:597] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:45.256131 28412 consensus_queue.cc:1048] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:45.284811 22472 consensus_peers.cc:597] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.302878 22546 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.320405 22472 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:45.339232 21312 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:45.356426 22472 consensus_peers.cc:597] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.358668 22546 consensus_peers.cc:597] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:45.361680 22472 consensus_peers.cc:597] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.420363 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.450783 22472 consensus_peers.cc:597] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.544008 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.638515 22546 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.659027 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.696295 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.709566 22472 consensus_peers.cc:597] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.710215 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:45.972168 22546 consensus_peers.cc:597] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:46.018853 22472 consensus_peers.cc:597] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:46.022725 22546 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:46.044697 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:46.056196 22472 consensus_peers.cc:597] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:46.099133 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:46.110926 22472 consensus_peers.cc:597] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:46.267582 22472 consensus_peers.cc:597] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:46.339768 21312 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:46.387782 22472 consensus_peers.cc:597] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:46.388443 22472 consensus_peers.cc:597] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:46.525961 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 78539.1us
W20260709 13:08:46.579080 22546 consensus_peers.cc:597] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:46.611214 23077 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:46.683105 22546 consensus_peers.cc:597] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:46.706456 22546 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:46.830281 22472 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111) [suppressed 442 similar messages]
W20260709 13:08:47.004372 23077 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:47.085477 22472 consensus_peers.cc:597] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:47.156625 22546 consensus_peers.cc:597] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:47.301354 22603 debug-util.cc:398] Leaking SignalData structure 0x7b0800340540 after lost signal to thread 21315
W20260709 13:08:47.302570 22603 debug-util.cc:398] Leaking SignalData structure 0x7b080033bfc0 after lost signal to thread 22365
W20260709 13:08:47.303951 22603 debug-util.cc:398] Leaking SignalData structure 0x7b0800174400 after lost signal to thread 22532
W20260709 13:08:47.305182 22603 debug-util.cc:398] Leaking SignalData structure 0x7b08000ed700 after lost signal to thread 22606
W20260709 13:08:47.306429 22603 debug-util.cc:398] Leaking SignalData structure 0x7b08002f86e0 after lost signal to thread 23137
W20260709 13:08:47.324358 22546 consensus_peers.cc:597] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:47.340332 21312 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:47.364938 22546 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:47.453238 22546 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.462179 22546 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.462774 22546 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.492091 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.513586 22472 consensus_peers.cc:597] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.543263 22472 consensus_peers.cc:597] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.553580 22546 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:47.586742 22472 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:47.610945 22546 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.625806 22546 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.661733 22472 consensus_peers.cc:597] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:47.675529 22472 consensus_peers.cc:597] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:47.784379 22472 consensus_peers.cc:597] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.794337 22472 consensus_peers.cc:597] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.840498 22472 consensus_peers.cc:597] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.848587 22472 consensus_peers.cc:597] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.868336 22472 consensus_peers.cc:597] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.888413 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:47.920382 22472 consensus_peers.cc:597] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.120273 22546 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.124073 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.145458 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.150620 22546 consensus_peers.cc:597] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:48.247514 22546 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.263048 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.340876 21312 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:48.455343 22546 consensus_peers.cc:597] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.556007 22472 consensus_peers.cc:597] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.580549 22472 consensus_peers.cc:597] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.594659 22472 consensus_peers.cc:597] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:48.654315 22472 consensus_peers.cc:597] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:48.654371 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.722014 22472 consensus_peers.cc:597] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:48.738523 22472 consensus_peers.cc:597] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:48.764631 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.800972 22546 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.823630 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:48.947098 23077 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:48.983732 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 44141.1us
W20260709 13:08:49.341389 21312 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:49.424973 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 56511.2us
W20260709 13:08:49.446034 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 84192.1us
W20260709 13:08:49.489603 23077 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:49.934949 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 72048.3us
W20260709 13:08:49.973726 22546 consensus_peers.cc:597] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:49.997531 22546 consensus_peers.cc:597] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:49.998934 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:49.999364 22472 consensus_peers.cc:597] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:50.233261 22546 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:50.254657 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:50.341953 21312 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 22454)
I20260709 13:08:51.182871 28451 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.183679 28451 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.186743 28451 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:51.286502 28450 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.287220 28450 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.290596 28450 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.299726 28431 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:51.300377 28431 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.301303 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.302361 28431 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.310530 28431 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:51.310823 28452 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:51.311112 28431 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.311434 28452 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:51.313341 28431 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.313552 28452 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:51.335103 28429 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.336205 28429 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.338809 28429 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:51.342715 21312 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:51.344512 22546 consensus_peers.cc:597] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:51.353256 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 48073.6us
I20260709 13:08:51.364581 28450 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.365187 28450 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:51.367527 28450 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:51.385105 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.389480 28451 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:51.390118 28451 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.392186 28451 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:51.393491 28429 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:51.395581 28429 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.385994 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.407016 28429 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:51.409132 28429 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:51.409653 28429 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.411844 28429 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:51.418730 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:51.408505 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.085s	user 0.008s	sys 0.019s
W20260709 13:08:51.420274 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.009s	sys 0.019s
I20260709 13:08:51.433867 28431 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:51.434473 28431 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.436728 28431 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.455296 28450 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.455936 28450 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:51.440132 22472 leader_election.cc:336] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:51.459146 22472 leader_election.cc:336] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:51.459939 22472 leader_election.cc:336] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:51.472931 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 111699us
I20260709 13:08:51.482314 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.474942 28429 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.483323 28429 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.485107 28450 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.475849 28460 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:51.485648 28429 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:51.488633 28458 raft_consensus.cc:493] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:51.494119 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.496569 28460 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.498885 28460 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.503111 28464 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.503623 28458 raft_consensus.cc:515] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.506131 28458 leader_election.cc:290] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.508670 28462 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:51.503816 28464 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.511332 28464 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.509258 28462 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.515750 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb965aeed0142a28f51999a91b1eb44" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.518548 28462 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.520840 22473 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:51.521744 28462 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:51.524631 22473 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:51.525566 28462 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.526311 28439 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.526885 28439 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:51.532980 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:08:51.535153 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 59593.6us
I20260709 13:08:51.535998 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:08:51.538419 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 80906.2us
W20260709 13:08:51.551568 22472 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:51.552136 28467 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.552635 28467 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.554296 28467 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.551910 28439 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:51.555521 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.555953 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.557444 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.558682 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.564100 28440 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:51.564858 28440 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.567119 28440 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:51.570592 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063ac6dfc4614afb9ca68efa49225bf7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.571383 28469 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.570652 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.573354 28447 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.573904 28447 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:51.575996 28447 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:51.577271 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.572023 28469 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:51.576462 28447 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:51.593408 28447 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.595227 28472 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.595582 28447 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.595907 28472 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:51.597112 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:51.598783 28472 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:51.599411 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 60196.2us
I20260709 13:08:51.600766 22545 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:51.601970 28469 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:51.602362 28450 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.604825 28472 raft_consensus.cc:493] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:51.605368 28472 raft_consensus.cc:515] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.607419 28472 leader_election.cc:290] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.608634 28455 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:51.609268 28455 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:51.610308 23077 leader_election.cc:336] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:51.611955 28455 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:51.663825 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8dc0 after lost signal to thread 21315
W20260709 13:08:51.699863 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 89575us
W20260709 13:08:51.700937 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08003c9560 after lost signal to thread 22365
I20260709 13:08:51.613045 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.633190 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a9d7ee5bd74642bb36af19c37bbd3f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:51.736747 22529 debug-util.cc:398] Leaking SignalData structure 0x7b0800160180 after lost signal to thread 22532
I20260709 13:08:51.613591 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.620402 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.637763 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b920299a38a48b1a5c349b6f109fa9f" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.718595 28428 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.654481 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bfc975f9f54ea59fbab64cd3362a0d" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.618424 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.629806 28455 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:51.621258 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb0890d5a7741bd8793d654027263a2" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.709357 28450 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
W20260709 13:08:51.623340 21317 debug-util.cc:398] Leaking SignalData structure 0x7b080000fbe0 after lost signal to thread 22545
I20260709 13:08:51.712716 28469 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.743772 28450 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.745036 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.746661 28450 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.613888 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.739020 28428 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:51.633829 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.739763 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:51.725379 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 97509.8us
I20260709 13:08:51.750257 22573 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:08:51.618643 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.751403 28428 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:08:51.741395 23077 leader_election.cc:336] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:51.741659 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.740823 28455 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.752836 22578 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 16.
I20260709 13:08:51.742452 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.708912 28447 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.754447 28447 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:51.757014 28447 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:51.747888 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.638319 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.626358 28472 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:51.744810 28469 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:51.782922 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.784190 28469 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:51.785300 28472 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:51.790551 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.761567 28455 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.763197 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:51.764935 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:08:51.738401 22529 debug-util.cc:398] Leaking SignalData structure 0x7b080034de80 after lost signal to thread 22606
W20260709 13:08:51.769820 23077 leader_election.cc:336] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:51.793884 22529 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9620 after lost signal to thread 23137
W20260709 13:08:51.790876 22472 leader_election.cc:336] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:51.797313 22473 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:51.797863 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:51.798374 22546 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:51.725031 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 72100.7us
I20260709 13:08:51.779492 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.801131 22578 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 6.
I20260709 13:08:51.803772 28460 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.806202 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:51.807505 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:51.793881 28472 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:51.812769 28450 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.813712 28450 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:51.815282 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:51.814018 22472 consensus_peers.cc:597] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:51.817000 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:51.827824 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:51.829373 28470 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.830499 28447 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:51.831419 28447 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.833783 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764f8dc47e2c49648f870ba9bd1b55fc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.835301 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a148d1e8b84ad7815dcaf111f422a7" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.840624 28440 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:51.841226 28440 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:51.842922 22472 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111) [suppressed 324 similar messages]
I20260709 13:08:51.862660 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:51.865347 22472 consensus_peers.cc:597] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:51.865486 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.865486 28440 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:51.871743 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:51.872956 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:51.866039 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55dc1d250bfe4f2c9c577323b3736521" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:51.866168 28447 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.875355 28447 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:51.873768 28470 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:51.876240 28470 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.876736 28470 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:51.877411 28447 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:51.878041 28440 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:51.878433 28440 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:51.878764 28440 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.874143 23079 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:51.868975 23077 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:51.881126 28429 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.885099 23079 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:51.886072 28429 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:51.887007 23077 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:51.887456 23079 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:51.892730 28429 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:51.904737 22472 consensus_peers.cc:597] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:51.905776 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.908619 22545 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:51.964404 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:51.944231 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.951614 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.950853 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.920677 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:51.993120 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 84571.1us
I20260709 13:08:51.892771 28470 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:51.975188 22546 consensus_peers.cc:597] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:51.996833 22545 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:51.910821 22472 consensus_peers.cc:597] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:51.998193 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 87426.4us
I20260709 13:08:51.934474 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:51.953639 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:51.999815 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 46260us
W20260709 13:08:51.999747 22546 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.003752 22546 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.004314 22546 leader_election.cc:336] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:52.005165 22546 leader_election.cc:336] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.006193 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dce6002cc94eb7ae9be630281c202c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:52.005591 22546 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:51.993016 28447 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:52.011588 28428 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:52.006031 28472 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:52.018682 22472 consensus_peers.cc:597] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.020378 22472 consensus_peers.cc:597] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:52.005925 28443 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:52.024521 28443 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:52.024935 28443 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:52.029639 22472 consensus_peers.cc:597] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:52.036616 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:52.038206 28470 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:52.043216 28443 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:52.045876 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.046518 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:52.046728 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:52.048852 28440 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:52.056288 22546 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:52.056881 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44998.1us
W20260709 13:08:52.057432 22546 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:52.066890 22508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:52.069867 28440 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:52.079813 22474 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:52.081235 28441 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:52.082228 28443 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:52.106715 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:52.120784 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:52.123690 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:52.128824 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:52.138026 28441 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:52.139535 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:52.141211 22474 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:52.142544 28441 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:52.143906 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:52.145185 28441 raft_consensus.cc:2749] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:52.147292 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:52.148643 28441 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:52.156121 22546 leader_election.cc:336] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.156834 22546 leader_election.cc:304] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:52.157666 28447 raft_consensus.cc:2749] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:52.159222 22546 leader_election.cc:336] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.159965 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:52.162675 28447 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:52.164407 22546 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.164988 22546 leader_election.cc:336] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.165403 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:52.166183 28447 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:52.167346 22546 leader_election.cc:336] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.167852 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:52.171875 28447 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:52.175957 22472 consensus_peers.cc:597] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.175709 22546 leader_election.cc:336] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:52.177744 22546 leader_election.cc:336] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.178217 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:52.179010 28447 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:52.180249 22546 leader_election.cc:336] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.180791 22546 leader_election.cc:304] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:52.181598 28447 raft_consensus.cc:2749] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:52.182904 22546 leader_election.cc:336] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.183393 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:52.184162 28447 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:52.185575 22546 leader_election.cc:336] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.186069 22546 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:52.186815 28447 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:52.187813 22546 leader_election.cc:336] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.188290 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:52.189100 28447 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:52.192135 23079 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:52.193418 28440 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:52.199453 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:52.200775 28473 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:52.204392 23079 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:52.206555 28470 raft_consensus.cc:2749] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:52.208766 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:52.210078 28429 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:52.218672 22472 consensus_peers.cc:597] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.256630 22546 leader_election.cc:336] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:52.257251 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:52.258317 28447 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:52.263259 22472 consensus_peers.cc:597] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:52.335166 23110 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:52.337293 28455 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:52.339318 28455 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:52.339725 28455 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:08:52.343312 21312 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 22454)
I20260709 13:08:52.349817 23110 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:52.353034 28441 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:52.354190 28441 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:52.354534 28441 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:52.355356 28441 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:52.350431 28455 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:52.386184 23077 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:52.387742 23110 raft_consensus.cc:1240] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Rejecting Update request from peer e47a624c3ddb48c5a8947ac0b3e71f84 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:52.392867 28455 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:52.409232 28460 consensus_queue.cc:1059] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:52.410670 28441 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:52.522665 22472 consensus_peers.cc:597] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:52.525274 28476 raft_consensus.cc:3055] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:52.539168 28476 raft_consensus.cc:740] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
W20260709 13:08:52.573354 22546 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.574002 22546 consensus_peers.cc:597] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:52.585765 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 52075us
I20260709 13:08:52.595707 28476 consensus_queue.cc:260] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:52.597472 28476 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:52.632651 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 96196.2us
W20260709 13:08:52.637492 22546 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.646920 22472 consensus_peers.cc:597] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.652045 22472 consensus_peers.cc:597] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:52.681614 22546 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.738180 22472 consensus_peers.cc:597] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:52.777334 22472 consensus_peers.cc:597] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.808653 22546 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:52.899868 22472 consensus_peers.cc:597] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:53.210956 22472 consensus_peers.cc:597] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:53.239447 22546 consensus_peers.cc:597] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:53.272513 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:53.280465 22546 consensus_peers.cc:597] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:53.344054 21312 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 22454)
I20260709 13:08:53.402709 28472 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:53.403353 28472 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:53.405668 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:53.407406 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:53.408993 23112 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 17: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:53.405496 28472 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:53.411458 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:53.412169 22502 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 17.
I20260709 13:08:53.414664 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:53.416361 28464 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:53.416808 28464 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:53.417183 28464 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.421032 28472 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:53.421816 28472 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:53.427681 28472 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:53.429574 28464 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:53.431516 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:53.432314 23110 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 14: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:53.435645 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:53.436403 23110 raft_consensus.cc:2393] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 17: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:53.442286 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:53.442957 22502 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:08:53.443815 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:53.448963 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:53.450866 28472 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:53.451325 28472 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:53.451720 28472 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:53.453325 22507 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 17.
I20260709 13:08:53.457846 22545 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:53.458824 28478 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:53.458917 28464 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 17 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:53.468843 28478 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:53.471557 28478 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:53.463680 28472 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:53.475818 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:53.482447 28472 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:53.484228 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:53.485014 23110 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 14: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:53.492353 22507 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:08:53.502806 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:53.510125 28472 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:53.510723 28472 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:53.511650 28472 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:53.618180 22331 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 16 to 17, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 17 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:53.649333 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 47160.5us
W20260709 13:08:53.691843 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:53.824580 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 81930.1us
I20260709 13:08:53.828899 28464 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:53.829978 28464 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:53.833704 28464 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:53.841259 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:53.852317 23110 raft_consensus.cc:2393] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 7: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:53.868037 28429 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.868860 28429 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:53.871788 28429 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:53.882421 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:53.887964 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 80181.8us
I20260709 13:08:53.912714 28481 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.913324 28481 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:53.915899 28481 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:53.931221 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:53.932163 22507 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 17.
I20260709 13:08:53.934228 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:53.934957 22575 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 6.
I20260709 13:08:53.942516 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:53.943202 23110 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 7.
I20260709 13:08:53.944073 23076 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:53.945274 28480 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.945813 28480 raft_consensus.cc:493] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.946295 28480 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.949473 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:53.950287 22504 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 7.
I20260709 13:08:53.954480 22473 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:53.961644 28491 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:53.962397 28491 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.962834 28491 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:53.969128 28480 raft_consensus.cc:515] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:53.996197 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:54.003887 23110 raft_consensus.cc:1240] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:54.007171 28483 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:54.007864 28483 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:54.008345 28483 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:54.016863 22507 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:08:54.030848 22546 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:54.045893 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 47416us
I20260709 13:08:54.047286 23110 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:54.043576 28472 consensus_queue.cc:1059] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:08:54.052338 28480 leader_election.cc:290] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:54.052054 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:54.054075 22507 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.056630 28472 raft_consensus.cc:3055] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:54.057135 28472 raft_consensus.cc:740] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:54.058238 28472 consensus_queue.cc:260] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:54.059480 28472 raft_consensus.cc:3060] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.060829 28483 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:54.063512 28483 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:54.067358 22507 raft_consensus.cc:2468] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 18.
I20260709 13:08:54.081579 23076 leader_election.cc:304] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:54.086326 28491 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:54.092222 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:54.092898 22575 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:54.102599 28493 raft_consensus.cc:2804] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:54.103221 28493 raft_consensus.cc:697] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:54.104197 28493 consensus_queue.cc:237] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:54.109367 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 49342.2us
I20260709 13:08:54.110702 22507 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:54.112303 28483 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:54.114539 22546 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:54.102216 22575 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:08:54.116019 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2c58309c5440b19fa96cbeb5491c79" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:54.117051 22574 raft_consensus.cc:2410] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:08:54.117383 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:54.118571 22507 raft_consensus.cc:2368] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8.
I20260709 13:08:54.125473 28498 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:54.127807 22545 leader_election.cc:400] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8.
I20260709 13:08:54.128211 22545 leader_election.cc:403] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:08:54.134868 28498 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 7. Current term is 8.
I20260709 13:08:54.135509 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:54.139657 23105 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:54.136284 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:54.137420 22474 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:54.145361 28476 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:54.145918 28476 raft_consensus.cc:697] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:54.138411 28491 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 8 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:54.146908 28476 consensus_queue.cc:237] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:54.158501 23105 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 8.
I20260709 13:08:54.159421 22331 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 13 to 14, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 14 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:54.169718 22472 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:54.177793 22546 consensus_peers.cc:597] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:54.178578 22327 catalog_manager.cc:5697] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 17 to 18, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 18 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:54.241643 22546 consensus_peers.cc:597] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:54.251091 22331 catalog_manager.cc:5697] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:54.287248 22546 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.298509 22546 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:54.303381 22546 consensus_peers.cc:597] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:54.276022 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.317308 22546 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:54.332011 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 56814us
W20260709 13:08:54.344942 21312 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:54.383980 22472 consensus_peers.cc:597] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.401650 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.401927 22472 consensus_peers.cc:597] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.422019 22472 consensus_peers.cc:597] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.467722 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.487510 22472 consensus_peers.cc:597] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.493453 22546 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.497462 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.561429 22472 consensus_peers.cc:597] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:54.600310 23105 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:54.602015 28476 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:54.621018 23077 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:54.635533 22503 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 18 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:54.638190 28497 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:54.648357 22472 consensus_peers.cc:597] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:54.649979 22574 raft_consensus.cc:1275] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:54.651558 28491 consensus_queue.cc:1048] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:54.668202 22472 consensus_peers.cc:597] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:54.672703 22576 raft_consensus.cc:1275] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 18 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:08:54.673164 22576 pending_rounds.cc:85] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 12
I20260709 13:08:54.673409 22576 pending_rounds.cc:107] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:08:54.673672 22576 raft_consensus.cc:2889] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:54.678136 28497 consensus_queue.cc:1048] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:54.694756 22472 consensus_peers.cc:597] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:54.745708 22472 consensus_peers.cc:597] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:54.790640 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.798483 22546 consensus_peers.cc:597] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:54.820007 22546 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:54.893926 22472 consensus_peers.cc:597] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:55.013302 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 52062.2us
W20260709 13:08:55.003927 22546 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:55.045670 22472 consensus_peers.cc:597] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:55.055851 22472 consensus_peers.cc:597] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:55.061507 22546 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:55.097201 23077 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:55.195657 22472 consensus_peers.cc:597] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:55.253474 22472 consensus_peers.cc:597] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:55.289816 22472 consensus_peers.cc:597] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:55.299968 22546 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:55.345484 21312 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:55.377408 22546 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:55.389055 22472 consensus_peers.cc:597] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:55.576619 22546 consensus_peers.cc:597] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:55.689615 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:55.694770 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:55.697443 22546 consensus_peers.cc:597] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:55.840564 22472 consensus_peers.cc:597] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:56.346014 21312 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 22454)
W20260709 13:08:56.358927 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:56.433588 22546 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:56.545583 22472 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:56.621912 22472 consensus_peers.cc:597] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:56.651885 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:56.726734 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:57.346638 21312 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 22454)
I20260709 13:08:57.722770 28514 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:57.723605 28514 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:57.726076 28514 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:57.778632 28514 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:57.779422 28514 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:57.781960 28514 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:57.840211 28490 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:57.840335 28516 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:57.925940 28516 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:57.949753 28520 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:57.854231 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:57.869061 28521 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:57.952451 28521 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:57.954972 28521 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:57.890307 28519 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:57.957031 28519 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:57.959575 28519 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:57.960700 28519 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:57.961879 28524 raft_consensus.cc:493] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:57.859810 28514 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:08:57.968721 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 59381.6us
I20260709 13:08:57.848094 28517 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:57.915624 28522 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:57.985097 28520 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:57.985699 28516 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:57.994961 28523 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:57.968307 28525 raft_consensus.cc:493] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.017699 28526 raft_consensus.cc:493] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:58.036695 28525 raft_consensus.cc:515] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:58.036870 28526 raft_consensus.cc:515] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.038926 28525 leader_election.cc:290] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.039314 28526 leader_election.cc:290] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.020622 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.030813 28517 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.031771 28514 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.032716 28522 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.051752 28514 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.033638 28523 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.056607 28523 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:58.034529 28520 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.034761 28519 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.029698 28524 raft_consensus.cc:515] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.314404 28521 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.315529 28521 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:57.841274 28490 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.060050 28516 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:58.317405 28533 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.064486 28523 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.145931 28532 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.310349 28529 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
W20260709 13:08:58.163807 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 114010us
I20260709 13:08:58.317883 28521 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.294023 28543 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.319330 28523 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.291321 28538 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:58.319840 28529 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.288322 28528 raft_consensus.cc:493] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.297019 28514 raft_consensus.cc:493] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.070331 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.287948 28525 raft_consensus.cc:493] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.322436 28528 raft_consensus.cc:515] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:58.070782 28522 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.324887 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecad4f2f3d49ea8a691075b31e1f96" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:58.132004 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 98272.9us
I20260709 13:08:58.325423 28529 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.321630 28538 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.326601 28536 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.328897 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.317341 28516 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.159266 28531 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.334720 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.319126 28532 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.329648 22505 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:08:58.323180 28525 raft_consensus.cc:515] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
W20260709 13:08:58.347255 21312 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 22454)
I20260709 13:08:58.175139 28530 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.351567 28528 leader_election.cc:290] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.327234 28536 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.329862 28517 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.322463 28514 raft_consensus.cc:515] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:58.320768 28543 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.383975 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.384765 22575 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:58.372803 28522 raft_consensus.cc:493] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.372853 28529 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.443522 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.389213 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.446717 23104 raft_consensus.cc:2468] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:08:58.420724 28550 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.452379 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17ed109556234df2aeba1d6118cc0a95" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.353387 28531 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.377665 28517 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:58.383471 28528 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:58.344995 28533 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.372798 28530 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.473208 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.476554 23110 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:58.452621 28544 raft_consensus.cc:493] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.476800 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2656d4dbbd4ca1a10c904a0a12fc6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.501466 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.501925 22506 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 15.
I20260709 13:08:58.477686 22502 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 16.
I20260709 13:08:58.450906 28529 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.507368 28554 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:58.508082 28554 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.511145 28555 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:58.511826 28555 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.512689 28552 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:58.513291 28552 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.514209 28555 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.515436 28552 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.516546 28530 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.517107 28530 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.517606 28530 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.519461 28530 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.452646 28550 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.523299 28550 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.523829 28550 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.523968 28537 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:08:58.501791 28528 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.524618 28537 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.526887 28560 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.527235 28537 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.454484 28522 raft_consensus.cc:515] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:58.527495 28560 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.528826 28516 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:58.529389 28522 leader_election.cc:290] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.530791 28542 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:58.531348 28542 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.501549 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.500701 28521 raft_consensus.cc:493] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.566617 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.559412 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.567020 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.557897 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccaa43d7e2044a2b30eb79a52d79b64" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.574031 23112 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:58.559051 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.553177 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.562597 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.575917 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.558403 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.551127 28514 leader_election.cc:290] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.557334 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:08:58.555015 22472 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111) [suppressed 438 similar messages]
I20260709 13:08:58.573835 23105 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:58.549461 28532 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.578308 22582 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:08:58.577035 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.552663 28544 raft_consensus.cc:515] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:58.561950 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ec0e67ff314a57bb23fd055736385a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.558724 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.553270 28525 leader_election.cc:290] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.703919 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.704578 28542 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.704808 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.705487 28525 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.705529 23105 raft_consensus.cc:2468] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:08:58.706391 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.706185 28525 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.707028 23106 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 16.
I20260709 13:08:58.700619 28521 raft_consensus.cc:515] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:08:58.554279 28543 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.472800 28517 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.705427 23107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2c1c9e9dd4272a78e7cd3da913fad" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.722570 23105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.475553 28538 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:58.731709 22473 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:58.555132 28554 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.555138 28536 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.654714 28528 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.738077 28556 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:58.738803 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.739449 28524 leader_election.cc:290] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.745465 28531 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.747953 28556 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.749660 28556 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.748579 28560 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.524322 28550 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.750926 22503 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:08:58.752249 23076 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:58.731976 28521 leader_election.cc:290] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.754431 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a53997c5479d8edfb755d887f72a" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.803309 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06de1406fed544b39bf6d0ab441df770" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.808800 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:58.869459 28517 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:08:58.809568 28560 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:58.872983 28560 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.873420 28560 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.879462 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.880220 22503 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 11.
I20260709 13:08:58.885950 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.886225 28543 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.886773 28543 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.889642 28543 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.891374 23076 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:58.892416 28543 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:58.892939 28543 raft_consensus.cc:493] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.893478 28543 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:58.895275 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcd5807b34a410c9196ed1b6e80ace3" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.900228 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.905120 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bee4af77fb4bccad7991b1429bba72" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.909478 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4293c025258b4f61abd2346d38a2752b" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:58.916901 23112 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:08:58.918915 28544 leader_election.cc:290] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:58.920284 22546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 169883us
W20260709 13:08:58.923568 22546 consensus_peers.cc:597] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:58.942638 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 210989us
W20260709 13:08:58.926872 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08003cdbc0 after lost signal to thread 21315
W20260709 13:08:58.944581 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa6e0 after lost signal to thread 22365
I20260709 13:08:58.928195 28550 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.952754 22473 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:58.952194 28543 raft_consensus.cc:515] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.961251 28543 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.967357 28560 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.971338 28528 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:58.971951 28528 raft_consensus.cc:493] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.952034 28556 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.973366 23107 raft_consensus.cc:1240] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:58.972410 28528 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.975135 28556 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.976960 28560 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.978255 22473 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:58.972369 23106 raft_consensus.cc:1240] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:58.985432 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:58.986002 28526 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:58.988258 28526 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:58.988833 28526 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.993069 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.994787 28535 raft_consensus.cc:493] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:58.995561 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.995435 28535 raft_consensus.cc:515] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:58.997519 28535 leader_election.cc:290] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:58.997642 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:58.995739 28519 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:08:58.999384 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:59.002487 23108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:59.004782 22473 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
W20260709 13:08:59.007283 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 452251us
I20260709 13:08:59.011685 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd39ff0031394113b2b75f15cd7c44a4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:59.012719 28556 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:59.013177 28556 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:59.013581 28556 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.015482 28565 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:59.015947 28565 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:59.016312 28565 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.017764 28553 consensus_queue.cc:1059] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:59.020498 28553 consensus_queue.cc:1059] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:59.021889 28534 raft_consensus.cc:3055] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:59.022287 28534 raft_consensus.cc:740] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:59.022719 28529 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.019023 28539 raft_consensus.cc:3055] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:59.023154 28534 consensus_queue.cc:260] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.023649 28539 raft_consensus.cc:740] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:59.024955 28534 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.024688 28539 consensus_queue.cc:260] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.025961 28539 raft_consensus.cc:3060] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.030017 28525 leader_election.cc:290] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.037061 28490 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.041344 28533 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.042485 28523 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:59.045838 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08002e76c0 after lost signal to thread 22532
W20260709 13:08:59.047154 23134 debug-util.cc:398] Leaking SignalData structure 0x7b080032f220 after lost signal to thread 22606
I20260709 13:08:59.053283 28565 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:59.048367 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08001b0240 after lost signal to thread 23137
I20260709 13:08:59.057649 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:59.065914 22473 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:08:59.066809 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:59.074030 28533 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:59.074530 28533 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:59.074908 28533 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.070449 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:08:59.078666 28556 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.079748 22505 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:59.081880 28490 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:59.082311 28490 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:59.082695 28490 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.083003 23076 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:59.083269 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:59.086251 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:59.087224 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac5249f314546e6a563fe498ff87f21" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.087759 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.088335 22581 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:59.088439 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0960e28f558c46c9bce238b59dea96f6" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.089337 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.089427 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:08:59.089623 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63a987ca645719f59f026b5d252c9" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.090000 22576 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:08:59.091099 28563 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:59.091528 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cca3dfe6984b21bf5701f6f3b21b83" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.091542 28563 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:08:59.092186 28563 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.093014 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:59.094167 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:59.094691 22506 raft_consensus.cc:3060] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.095165 28565 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.090152 23106 raft_consensus.cc:2393] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 12: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:59.099066 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:59.102329 22506 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:59.108140 28528 raft_consensus.cc:515] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.108166 28533 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.156692 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ceea8b6b718469c8d899d7f03824359" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.124447 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:59.151002 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:59.158320 28528 leader_election.cc:290] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.158607 28565 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:59.053189 28526 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.112823 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:59.159209 28565 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:59.159437 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:59.159932 28565 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.160219 23106 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 14: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:59.117556 28556 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.162357 22502 raft_consensus.cc:1240] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:59.166953 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:59.169095 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.169742 22580 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 14.
I20260709 13:08:59.170011 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fcf9d065e46528b502778fede0f1f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.170290 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634877efa82d48ea9055feb74030391f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.170883 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64165ef33c5441ef8b91a67653951961" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.169771 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314cf48b748f4bcd8768227cd02627af" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.171747 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.172075 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.172686 22582 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:59.173367 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647750dc34142bf8dd2c7a3bd334fc4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.173764 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.174456 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3eb92518c7460abd36818ae39be5a0" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:59.137449 22545 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.175906 22545 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.176390 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:59.176687 28551 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.176846 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.177482 28551 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.177706 28549 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.178928 22545 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:59.179639 28539 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:59.180003 28539 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:08:59.180326 28539 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.183820 22578 raft_consensus.cc:2468] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 14.
I20260709 13:08:59.173038 28533 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.172922 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.168320 28565 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:59.185796 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 50859.3us
I20260709 13:08:59.187472 28565 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.111804 28563 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.189584 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:59.190117 28563 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:08:59.190276 22546 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:59.191998 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:59.174566 28526 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.172938 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d9e2f597948e7b4670b3606ebf448" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:08:59.203699 22580 raft_consensus.cc:2468] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:08:59.207437 23104 raft_consensus.cc:1240] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:59.208346 22474 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:59.209590 23077 leader_election.cc:336] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.209921 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:59.210122 23077 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.148355 28490 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:08:59.211066 23077 leader_election.cc:336] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.211521 23077 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:59.190805 22546 consensus_peers.cc:597] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:59.212394 28515 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:59.212872 28490 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:08:59.213099 22546 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:59.213310 28515 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:59.213852 22546 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:59.214257 22546 leader_election.cc:336] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:59.215134 22546 leader_election.cc:336] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.215209 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
W20260709 13:08:59.216154 22546 consensus_peers.cc:597] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:59.216625 22546 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.217103 22546 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.217478 22546 leader_election.cc:336] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.217816 22546 leader_election.cc:304] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:59.212651 23077 leader_election.cc:336] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.220050 23077 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:08:59.221019 23077 leader_election.cc:336] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:59.221625 23077 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:59.222055 23077 leader_election.cc:336] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.222401 23077 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.223120 28515 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:59.223273 23077 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.223799 23077 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.223963 28515 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:59.224754 23077 leader_election.cc:336] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.224915 28515 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:59.228664 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 43503.9us
I20260709 13:08:59.118942 23076 leader_election.cc:304] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:08:59.236822 28551 consensus_queue.cc:1059] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:59.238251 28549 raft_consensus.cc:2749] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:59.229776 23077 leader_election.cc:336] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.244920 28515 raft_consensus.cc:2804] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:59.245123 23077 leader_election.cc:336] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.245486 28515 raft_consensus.cc:697] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:59.241295 23079 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.246408 28515 consensus_queue.cc:237] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.247400 28527 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.247892 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.249095 28527 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.249976 23079 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:59.250886 23076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 132003us
I20260709 13:08:59.251581 28527 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:59.245682 23077 leader_election.cc:336] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:08:59.252610 23077 leader_election.cc:336] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.252959 23077 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.253628 28527 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.255239 23079 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:59.253628 23077 leader_election.cc:336] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.256299 23077 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.257017 28523 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.257390 23079 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:59.258033 23077 leader_election.cc:336] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.259039 28547 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:59.259706 28547 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.261297 28527 consensus_queue.cc:1059] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:59.261638 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.262198 23077 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:59.262478 28515 raft_consensus.cc:3055] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:59.262833 28515 raft_consensus.cc:740] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:59.263835 28548 raft_consensus.cc:3055] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:59.263592 28515 consensus_queue.cc:260] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.264200 28548 raft_consensus.cc:740] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:59.265103 28548 consensus_queue.cc:260] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.266352 28548 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.270938 23079 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.272318 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:59.272632 28523 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.275116 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d35c45e33c4336b33461cdbe7f7b6f" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:59.275960 22580 raft_consensus.cc:2393] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e47a624c3ddb48c5a8947ac0b3e71f84 in current term 14: Already voted for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in this term.
I20260709 13:08:59.278478 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.279544 28527 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:59.279887 23079 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.281121 23079 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.281863 28523 raft_consensus.cc:2804] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:59.282399 28523 raft_consensus.cc:697] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:59.283342 28523 consensus_queue.cc:237] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.284680 28547 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.286095 22576 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 17.
I20260709 13:08:59.287477 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:59.288314 22327 catalog_manager.cc:5697] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 11 to 12, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 12 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.291347 28515 raft_consensus.cc:3060] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.296648 23079 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.297955 28527 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:59.308743 28533 raft_consensus.cc:2764] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:08:59.308940 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 99071.3us
I20260709 13:08:59.309751 28533 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:59.313161 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 89827.7us
W20260709 13:08:59.314102 22472 consensus_peers.cc:597] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.314603 22472 leader_election.cc:336] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.317642 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:59.315009 22472 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.322665 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:59.323064 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:08:59.327103 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
W20260709 13:08:59.332237 22472 consensus_peers.cc:597] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:59.332837 22472 consensus_peers.cc:597] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:59.333122 22472 leader_election.cc:336] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.333349 22472 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.333946 22506 raft_consensus.cc:1240] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:59.335362 22474 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:59.335958 22472 consensus_peers.cc:597] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:59.341296 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:59.343503 22505 raft_consensus.cc:2393] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 17: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:59.344684 22506 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:59.342749 22474 leader_election.cc:304] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:59.347853 21312 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 22454)
I20260709 13:08:59.341845 28524 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.340226 28544 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.345974 28539 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.361303 28490 raft_consensus.cc:2749] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.335744 28533 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.368842 22474 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:59.369805 28526 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.370573 28539 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:08:59.374013 23104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:08:59.377094 22474 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:59.387142 23104 raft_consensus.cc:2468] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:08:59.388404 23076 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.389282 28515 consensus_queue.cc:1059] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:59.390311 28538 raft_consensus.cc:3055] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:08:59.391157 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.391628 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:59.389549 28517 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:59.393224 22474 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:08:59.396955 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 60549us
W20260709 13:08:59.397434 22472 leader_election.cc:336] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.397719 22472 leader_election.cc:304] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:59.399667 22546 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:59.395255 22547 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:08:59.401576 22474 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:59.372253 28545 consensus_queue.cc:1059] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:59.390650 28538 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:59.407155 28538 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.408672 28538 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.405709 28549 raft_consensus.cc:2804] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:59.409945 28549 raft_consensus.cc:697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:59.410763 28549 consensus_queue.cc:237] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.402482 28526 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:59.405462 28521 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.421253 22474 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:08:59.422016 28526 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:08:59.423029 28526 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.424799 28529 raft_consensus.cc:2749] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:59.425714 28529 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:59.428678 22546 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.429322 22546 consensus_peers.cc:597] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.430109 22472 leader_election.cc:336] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.430671 22472 leader_election.cc:304] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:59.433154 22472 leader_election.cc:336] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.433688 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:59.436049 22472 consensus_peers.cc:597] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.436647 22472 consensus_peers.cc:597] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.436995 22472 leader_election.cc:336] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.437295 22472 leader_election.cc:304] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.432104 28521 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:59.441819 22472 leader_election.cc:336] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.442328 22472 leader_election.cc:304] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.440961 28528 raft_consensus.cc:2749] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:59.441270 28533 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.445202 28521 raft_consensus.cc:2749] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:59.451759 22472 leader_election.cc:336] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.452234 22472 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:59.456609 22472 leader_election.cc:336] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.457079 22472 leader_election.cc:304] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.462142 28528 raft_consensus.cc:2749] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:59.461342 28525 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.469645 28523 raft_consensus.cc:3055] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:59.470192 28523 raft_consensus.cc:740] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:08:59.471134 28523 consensus_queue.cc:260] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.461036 28529 raft_consensus.cc:2749] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:59.487129 23077 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:59.493171 28523 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.507004 22331 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 16 to 17, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 17 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.522408 22507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dae4a3a8e0e4e2e97b920c88a3fb020" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:08:59.527521 22507 raft_consensus.cc:2393] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 14: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:08:59.533456 22506 raft_consensus.cc:1240] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:59.535166 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
W20260709 13:08:59.551430 22472 leader_election.cc:336] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.551918 22472 leader_election.cc:304] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.552685 28526 raft_consensus.cc:2749] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:59.552896 22472 leader_election.cc:336] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.564688 22472 leader_election.cc:304] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
W20260709 13:08:59.565742 22472 leader_election.cc:336] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.566187 22472 leader_election.cc:304] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.566946 28529 raft_consensus.cc:2749] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.567440 28526 raft_consensus.cc:2749] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:59.568496 22472 leader_election.cc:336] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:08:59.568943 22472 leader_election.cc:304] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:08:59.572698 28526 raft_consensus.cc:2749] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:59.576752 28539 consensus_queue.cc:1059] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:59.577795 28539 raft_consensus.cc:3055] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:59.578145 28539 raft_consensus.cc:740] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:59.578974 28539 consensus_queue.cc:260] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.580536 28539 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.560848 22329 catalog_manager.cc:5697] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 13 to 14, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 14 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:59.561929 28574 log.cc:927] Time spent T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:59.583184 22545 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:08:59.584039 28553 raft_consensus.cc:2749] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:59.590359 22472 consensus_peers.cc:597] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.591091 22472 consensus_peers.cc:597] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.591552 22472 consensus_peers.cc:597] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:59.592182 22472 consensus_peers.cc:597] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:59.603758 22504 raft_consensus.cc:1240] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:59.606303 22505 raft_consensus.cc:1240] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:59.612735 28555 consensus_queue.cc:1059] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:59.613580 28534 consensus_queue.cc:1059] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:59.614136 28555 raft_consensus.cc:3055] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:59.614614 28555 raft_consensus.cc:740] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:59.615068 28554 raft_consensus.cc:3055] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:59.615520 28554 raft_consensus.cc:740] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:08:59.615595 28555 consensus_queue.cc:260] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.616384 28554 consensus_queue.cc:260] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:08:59.617658 28554 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:59.626715 22472 consensus_peers.cc:597] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:59.636379 28555 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:59.650120 22472 consensus_peers.cc:597] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:59.710351 22327 catalog_manager.cc:5697] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 13 to 14, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 14 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.715132 22582 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:59.718946 28538 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:59.749125 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:59.793634 22505 raft_consensus.cc:1275] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:59.795578 28547 consensus_queue.cc:1048] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:59.810284 22582 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:59.818240 23112 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:59.822160 28555 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:59.824980 28547 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:08:59.927161 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 43591.8us
W20260709 13:08:59.927781 22472 consensus_peers.cc:597] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:59.931953 23112 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:08:59.933512 28528 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:59.938083 22504 raft_consensus.cc:1275] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:59.948163 28527 consensus_queue.cc:1048] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:59.972333 22504 raft_consensus.cc:1275] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:08:59.987509 22546 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:59.991608 28534 consensus_queue.cc:1048] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:00.022037 22582 raft_consensus.cc:1275] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:09:00.028147 28528 consensus_queue.cc:1048] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:09:00.051257 22472 consensus_peers.cc:597] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:00.093482 22546 consensus_peers.cc:597] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:00.130463 22546 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:00.184198 22472 consensus_peers.cc:597] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:00.233036 22546 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:00.465430 22546 consensus_peers.cc:597] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:00.658982 22472 consensus_peers.cc:597] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:00.692106 28534 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:09:00.692793 28534 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:00.695222 28534 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:00.704027 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:00.704795 23106 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
W20260709 13:09:00.706882 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:00.717592 22547 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:09:00.718681 28549 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:00.719158 28549 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:09:00.719620 28549 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:00.747207 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:00.753391 22472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 88536.5us
I20260709 13:09:00.770085 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:09:00.771165 22504 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:09:00.782136 28518 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.783190 28518 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:00.791432 28527 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:00.792114 28527 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:00.794325 28527 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:00.798776 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:09:00.799885 22504 raft_consensus.cc:2393] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 15: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:09:00.795904 28549 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:00.806070 28549 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:00.814752 28527 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:00.815436 28527 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:00.819281 28527 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:00.820413 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:09:00.836079 22504 raft_consensus.cc:2393] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:09:00.834525 28539 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.837579 28539 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:00.847976 28539 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:09:00.852555 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:00.880533 28539 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:09:00.886040 28539 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:00.855368 28518 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:00.851325 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:09:00.888311 28539 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:00.888090 22504 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:09:00.892999 23076 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:09:00.895715 28593 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:00.896296 28541 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.900804 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:09:00.921571 22502 raft_consensus.cc:2393] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:09:00.901659 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:09:00.902451 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:09:00.922873 22506 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
I20260709 13:09:00.923046 22505 raft_consensus.cc:2393] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c in current term 13: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:09:00.920564 28541 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:00.928602 28541 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:00.932416 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:09:00.918222 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 131830us
I20260709 13:09:00.937080 28593 raft_consensus.cc:493] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.937645 28593 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:00.966163 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:00.973452 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:00.974174 22582 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 15.
I20260709 13:09:00.975152 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:09:00.983737 23106 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 13.
I20260709 13:09:00.985591 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:00.986268 23112 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:09:01.001906 22545 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:09:01.002928 28539 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:01.003412 28539 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.003824 28539 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:01.029821 28539 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.036795 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:01.037329 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:01.037510 22580 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:09:01.038094 22573 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 12.
I20260709 13:09:01.045861 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:01.046512 22573 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:09:01.057173 28539 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:01.061772 28593 raft_consensus.cc:515] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.064126 28593 leader_election.cc:290] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:01.064890 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:09:01.065325 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:01.065521 22505 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:01.066088 23110 raft_consensus.cc:2368] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14.
I20260709 13:09:01.073632 22505 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 14.
I20260709 13:09:01.074937 23076 leader_election.cc:304] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:09:01.075827 28547 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:01.076367 28547 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.078583 28547 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:01.079151 28547 raft_consensus.cc:2804] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:01.080519 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:09:01.080685 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" is_pre_election: true
I20260709 13:09:01.081115 28547 raft_consensus.cc:697] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:09:01.081619 22506 raft_consensus.cc:2393] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 in current term 14: Already voted for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in this term.
I20260709 13:09:01.082988 23110 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:09:01.083132 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93
I20260709 13:09:01.084649 28526 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:01.085053 28526 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.085368 28526 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:01.082047 28547 consensus_queue.cc:237] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:01.094698 22546 consensus_peers.cc:597] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:01.095826 28526 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.098853 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:09:01.099148 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:09:01.099562 22580 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:01.099781 23112 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:09:01.107715 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:01.109826 22547 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:01.111164 28539 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:01.111749 28539 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:09:01.112918 28539 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.117626 22580 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:09:01.124944 22474 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:09:01.125854 28528 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:01.126391 28528 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:09:01.127341 28528 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:01.134641 22546 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:01.137135 22547 leader_election.cc:400] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14.
I20260709 13:09:01.137535 22547 leader_election.cc:403] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:01.138383 28539 raft_consensus.cc:3060] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:09:01.141291 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98509b657f84336bb26dd231a3124f1" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:09:01.142369 22327 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 12 to 13, leader changed from 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 13 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:01.156029 23112 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 15.
I20260709 13:09:01.160640 28526 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 15 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:09:01.165268 22472 consensus_peers.cc:597] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:01.168152 28596 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.168769 28596 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.174427 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:01.173166 28596 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:01.175125 23106 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 12.
I20260709 13:09:01.175516 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:01.176199 22580 raft_consensus.cc:2368] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 14. Current term is 15.
I20260709 13:09:01.177990 22473 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:09:01.178380 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:01.179333 28541 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:01.179771 28541 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.180084 28541 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:01.181473 22580 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:09:01.189949 23110 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 16.
I20260709 13:09:01.199390 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:01.200292 28595 raft_consensus.cc:2764] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:09:01.210739 28528 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.211351 28528 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.214526 28528 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:01.219659 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:01.223608 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:01.224337 23110 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 13.
I20260709 13:09:01.225585 22473 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c
I20260709 13:09:01.226994 28526 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:01.227403 28526 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.227737 28526 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:01.229022 21312 tablet_server.cc:196] TabletServer@127.20.208.1:0 shutdown complete.
I20260709 13:09:01.234191 23079 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:01.235118 28593 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:01.235534 28593 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:01.235893 28593 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:01.243464 28593 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.256318 28526 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.257648 23079 leader_election.cc:400] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 14. Current term is 15.
I20260709 13:09:01.258051 23079 leader_election.cc:403] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:01.259686 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:09:01.261298 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:09:01.261987 23110 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:01.275082 23110 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:09:01.276307 22473 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:09:01.277418 28596 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:01.278240 28596 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:09:01.279251 28596 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.283361 22506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69914642ad6d43889fea43ca1c6697f4" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:09:01.284040 22506 raft_consensus.cc:3060] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:01.188006 28541 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.292948 28541 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:01.294066 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:09:01.294687 23112 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:01.296597 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84"
I20260709 13:09:01.297395 22504 raft_consensus.cc:2368] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14.
I20260709 13:09:01.298766 23076 leader_election.cc:400] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14.
I20260709 13:09:01.299067 23076 leader_election.cc:403] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:09:01.307633 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:09:01.308321 22580 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:01.310827 22546 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:01.313748 22506 raft_consensus.cc:2468] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 16.
I20260709 13:09:01.314642 28526 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Requested vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:01.315152 22331 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 13 to 15, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 15 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:01.315689 23112 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:09:01.278273 28539 raft_consensus.cc:2749] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955) with higher term. Message: Invalid argument: T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14.
I20260709 13:09:01.319793 28595 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 14. Current term is 15.
I20260709 13:09:01.325289 28595 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819) with higher term. Message: Invalid argument: T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14.
I20260709 13:09:01.326562 22473 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 
I20260709 13:09:01.331251 22573 raft_consensus.cc:2468] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 14.
W20260709 13:09:01.333520 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 76024.5us
I20260709 13:09:01.336516 22547 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:09:01.325539 22580 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47a624c3ddb48c5a8947ac0b3e71f84 in term 14.
I20260709 13:09:01.307546 28593 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:01.337524 28549 raft_consensus.cc:2804] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:01.338279 28549 raft_consensus.cc:697] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:09:01.339143 28549 consensus_queue.cc:237] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.335469 28541 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:01.349925 22329 catalog_manager.cc:5697] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:01.352056 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:09:01.357962 22582 raft_consensus.cc:2368] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14.
I20260709 13:09:01.374078 28541 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Becoming Leader. State: Replica: e47a624c3ddb48c5a8947ac0b3e71f84, State: Running, Role: LEADER
I20260709 13:09:01.376564 28541 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.389184 23079 leader_election.cc:400] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 election: Vote denied by peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903) with higher term. Message: Invalid argument: T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cea93fb03e04e48a6dabc4094ee7c93 for earlier term 13. Current term is 14.
W20260709 13:09:01.389905 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:42819, user_credentials={real_user=slave}} blocked reactor thread for 44484.7us
I20260709 13:09:01.393013 22327 catalog_manager.cc:5697] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:01.400911 22546 consensus_peers.cc:597] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:01.401535 22546 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:01.480152 22327 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 13 to 14, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 14 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:01.481994 22327 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 reported cstate change: term changed from 12 to 14, leader changed from 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3) to e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2). New cstate: current_term: 14 leader_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:01.510466 22472 consensus_peers.cc:597] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:01.514369 22472 consensus_peers.cc:597] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:01.535287 23110 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:01.537268 28554 consensus_queue.cc:1059] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:01.538221 28554 raft_consensus.cc:3055] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:01.538563 28554 raft_consensus.cc:740] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:09:01.539379 28554 consensus_queue.cc:260] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:01.540824 28554 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:01.546682 22505 raft_consensus.cc:1240] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Rejecting Update request from peer 10c2f471167442c0b75d8cd50ed8c40c for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:01.564042 22546 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:01.577908 22579 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:01.581606 28595 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:01.620329 22472 consensus_peers.cc:597] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:01.620990 22472 consensus_peers.cc:597] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:01.631700 22546 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:01.632191 22546 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:01.653575 22546 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:01.659304 22505 raft_consensus.cc:1275] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Refusing update from remote peer 9cea93fb03e04e48a6dabc4094ee7c93: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:01.661836 28547 consensus_queue.cc:1048] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:01.665640 22546 consensus_peers.cc:597] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.691645 22472 consensus_peers.cc:597] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:01.704222 23106 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:01.706096 28608 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:09:01.723845 22546 consensus_peers.cc:597] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:01.727349 23077 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:01.744692 22504 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:01.747798 28554 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:01.757294 22573 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:01.763005 28608 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:09:01.798204 22573 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:09:01.798609 22573 pending_rounds.cc:85] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting all ops after (but not including) 11
I20260709 13:09:01.798838 22573 pending_rounds.cc:107] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:09:01.799074 22573 raft_consensus.cc:2889] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:01.801743 28526 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:09:01.825810 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:01.837622 22472 consensus_peers.cc:597] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:01.840512 22472 consensus_peers.cc:597] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:01.854517 23106 raft_consensus.cc:1275] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:01.856374 28609 consensus_queue.cc:1048] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:01.862744 23110 raft_consensus.cc:1275] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:01.876971 28541 consensus_queue.cc:1048] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:09:01.887051 22472 consensus_peers.cc:597] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:01.896396 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:01.902761 22546 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:01.943694 22472 consensus_peers.cc:597] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:01.953411 22579 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:01.964291 23106 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Refusing update from remote peer e47a624c3ddb48c5a8947ac0b3e71f84: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:02.041281 28526 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:02.055472 28608 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:02.067817 21312 tablet_server.cc:179] TabletServer@127.20.208.2:0 shutting down...
W20260709 13:09:02.087860 22472 consensus_peers.cc:597] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:02.134982 23076 consensus_peers.cc:597] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.141709 23076 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.142158 23076 consensus_peers.cc:597] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.142593 23076 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.140719 22545 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.148079 22545 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.155886 22545 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.212419 22472 consensus_peers.cc:597] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:02.243052 22473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 106259us
W20260709 13:09:02.247036 22474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 102702us
W20260709 13:09:02.266206 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:42955, user_credentials={real_user=slave}} blocked reactor thread for 89920.8us
W20260709 13:09:02.275245 23077 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:02.281590 22472 consensus_peers.cc:597] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:02.293457 22472 consensus_peers.cc:597] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:02.336040 22472 consensus_peers.cc:597] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:02.358096 23076 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.358844 23076 consensus_peers.cc:597] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.363719 23076 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.374797 23076 consensus_peers.cc:597] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.375473 23076 consensus_peers.cc:597] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.390226 23076 consensus_peers.cc:597] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.398375 22545 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.403672 22545 consensus_peers.cc:597] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.406908 22546 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:02.407423 22545 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.408871 22545 consensus_peers.cc:597] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.462175 23076 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.464296 23076 consensus_peers.cc:597] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.497082 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:02.499095 22545 consensus_peers.cc:597] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.500077 22545 consensus_peers.cc:597] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.502625 22545 consensus_peers.cc:597] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.503536 22545 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.593483 22546 consensus_peers.cc:597] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:02.631700 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:02.641544 21312 tablet_replica.cc:333] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.646190 21312 raft_consensus.cc:2243] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.646999 21312 raft_consensus.cc:2272] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.660028 21312 tablet_replica.cc:333] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.666234 21312 raft_consensus.cc:2243] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.667361 21312 raft_consensus.cc:2272] T 9bc53a10833c40d7b01be713f425dfcc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.683784 21312 tablet_replica.cc:333] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.685137 21312 raft_consensus.cc:2243] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.686775 21312 raft_consensus.cc:2272] T 78cbb90e435d471fa07712145d0b9faa P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:02.690102 22546 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:02.709146 21312 tablet_replica.cc:333] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.735632 21312 raft_consensus.cc:2243] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:09:02.735530 22472 consensus_peers.cc:597] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:02.742794 21312 raft_consensus.cc:2272] T 55dc1d250bfe4f2c9c577323b3736521 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.745412 21312 tablet_replica.cc:333] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.746297 21312 raft_consensus.cc:2243] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.746902 21312 raft_consensus.cc:2272] T a98509b657f84336bb26dd231a3124f1 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.760341 21312 tablet_replica.cc:333] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.761746 21312 raft_consensus.cc:2243] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.762547 21312 raft_consensus.cc:2272] T 6089498054d24ce99c46fe9be74f8589 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.765586 21312 tablet_replica.cc:333] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.766456 21312 raft_consensus.cc:2243] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.768350 21312 raft_consensus.cc:2272] T c04b0ff4c7da4211acec428ae776775a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:02.774871 22472 consensus_peers.cc:597] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:02.775480 21312 tablet_replica.cc:333] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.779222 21312 raft_consensus.cc:2243] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.780380 21312 raft_consensus.cc:2272] T 4293c025258b4f61abd2346d38a2752b P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.788393 21312 tablet_replica.cc:333] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.790719 21312 raft_consensus.cc:2243] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.792830 21312 raft_consensus.cc:2272] T 764f8dc47e2c49648f870ba9bd1b55fc P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.831089 21312 tablet_replica.cc:333] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.832010 21312 raft_consensus.cc:2243] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.832722 21312 raft_consensus.cc:2272] T ac2656d4dbbd4ca1a10c904a0a12fc6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:02.833496 22546 consensus_peers.cc:597] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:02.841989 21312 tablet_replica.cc:333] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.842840 21312 raft_consensus.cc:2243] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.843938 21312 raft_consensus.cc:2272] T add2d1ead99b44f6b4c0bb7f2fa9857a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.879470 21312 tablet_replica.cc:333] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.880311 21312 raft_consensus.cc:2243] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.881525 21312 raft_consensus.cc:2272] T 8fecad4f2f3d49ea8a691075b31e1f96 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.884444 21312 tablet_replica.cc:333] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.884728 28541 raft_consensus.cc:493] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:09:02.885327 28541 raft_consensus.cc:515] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:02.887578 28541 leader_election.cc:290] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:02.885341 21312 raft_consensus.cc:2243] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.893750 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:02.891131 21312 raft_consensus.cc:2272] T 0b920299a38a48b1a5c349b6f109fa9f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.903712 21312 tablet_replica.cc:333] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.904825 21312 raft_consensus.cc:2243] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.905958 21312 raft_consensus.cc:2272] T c7bfc975f9f54ea59fbab64cd3362a0d P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.911791 21312 tablet_replica.cc:333] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.917307 21312 raft_consensus.cc:2243] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.917358 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5964cb0c6d2046d4b63d976e33ff0d84" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:02.917986 21312 raft_consensus.cc:2272] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.921808 22474 leader_election.cc:304] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93
W20260709 13:09:02.922623 22474 raft_consensus.cc:2686] T 5964cb0c6d2046d4b63d976e33ff0d84 P e47a624c3ddb48c5a8947ac0b3e71f84: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:02.925450 21312 tablet_replica.cc:333] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.926347 21312 raft_consensus.cc:2243] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.926925 21312 raft_consensus.cc:2272] T f4d35c45e33c4336b33461cdbe7f7b6f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.935654 21312 tablet_replica.cc:333] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.936609 21312 raft_consensus.cc:2243] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.937184 21312 raft_consensus.cc:2272] T 2b2c58309c5440b19fa96cbeb5491c79 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.939821 21312 tablet_replica.cc:333] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.940683 21312 raft_consensus.cc:2243] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.952418 21312 raft_consensus.cc:2272] T 22a9d7ee5bd74642bb36af19c37bbd3f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.956506 21312 tablet_replica.cc:333] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.957317 21312 raft_consensus.cc:2243] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.967911 21312 raft_consensus.cc:2272] T 69914642ad6d43889fea43ca1c6697f4 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:02.969291 22546 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:02.970701 21312 tablet_replica.cc:333] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.971593 21312 raft_consensus.cc:2243] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.973166 21312 raft_consensus.cc:2272] T 109ad37fc4fb45618b11eb81e3b2c7d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.988651 21312 tablet_replica.cc:333] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.989640 21312 raft_consensus.cc:2243] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.990900 21312 raft_consensus.cc:2272] T 93a148d1e8b84ad7815dcaf111f422a7 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.993768 21312 tablet_replica.cc:333] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.994556 21312 raft_consensus.cc:2243] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.996538 21312 raft_consensus.cc:2272] T 1dcd5807b34a410c9196ed1b6e80ace3 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.999150 28541 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:03.000049 21312 tablet_replica.cc:333] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:02.999706 28541 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:03.000933 21312 raft_consensus.cc:2243] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.001796 21312 raft_consensus.cc:2272] T 5ceea8b6b718469c8d899d7f03824359 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.003378 28541 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:03.003588 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:03.007972 21312 tablet_replica.cc:333] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.009001 21312 raft_consensus.cc:2243] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.009613 21312 raft_consensus.cc:2272] T 17ed109556234df2aeba1d6118cc0a95 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.010679 22472 leader_election.cc:336] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:03.011281 22472 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:03.012068 28541 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:03.016005 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe7e8d85f3b4703b850c99a435d1d29" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:03.012435 21312 tablet_replica.cc:333] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.024688 28541 raft_consensus.cc:493] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:09:03.025322 28541 raft_consensus.cc:515] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:03.027667 28541 leader_election.cc:290] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:03.025321 21312 raft_consensus.cc:2243] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.030055 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0a64e3152c4ccbbff4e78b6e82db2a" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
W20260709 13:09:03.032177 22472 leader_election.cc:336] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:03.032661 22472 leader_election.cc:304] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:03.034386 28608 raft_consensus.cc:2749] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:03.035385 21312 raft_consensus.cc:2272] T 78e6dd3ee498418ab0eeb27b3289cdc5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.038199 21312 tablet_replica.cc:333] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.039076 21312 raft_consensus.cc:2243] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.040201 21312 raft_consensus.cc:2272] T 03bee4af77fb4bccad7991b1429bba72 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.042994 21312 tablet_replica.cc:333] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.043762 21312 raft_consensus.cc:2243] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.044322 21312 raft_consensus.cc:2272] T 87cca3dfe6984b21bf5701f6f3b21b83 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.063002 21312 tablet_replica.cc:333] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.063824 21312 raft_consensus.cc:2243] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.064730 21312 raft_consensus.cc:2272] T 07e24d8dba0542d7a1428819c63159f5 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.068351 21312 tablet_replica.cc:333] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.069118 21312 raft_consensus.cc:2243] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.069737 21312 raft_consensus.cc:2272] T 94be7e6c95554db88c30fee7a3db405f P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.072379 21312 tablet_replica.cc:333] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.073151 21312 raft_consensus.cc:2243] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.073935 21312 raft_consensus.cc:2272] T 4fe7e8d85f3b4703b850c99a435d1d29 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.076457 21312 tablet_replica.cc:333] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.077157 21312 raft_consensus.cc:2243] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.077682 21312 raft_consensus.cc:2272] T 7c3eb92518c7460abd36818ae39be5a0 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.080051 21312 tablet_replica.cc:333] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.080844 21312 raft_consensus.cc:2243] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.081599 21312 raft_consensus.cc:2272] T 4ac5249f314546e6a563fe498ff87f21 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.084224 21312 tablet_replica.cc:333] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.085048 21312 raft_consensus.cc:2243] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.085629 21312 raft_consensus.cc:2272] T ff0a64e3152c4ccbbff4e78b6e82db2a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.088246 21312 tablet_replica.cc:333] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.089039 21312 raft_consensus.cc:2243] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.089617 21312 raft_consensus.cc:2272] T 0960e28f558c46c9bce238b59dea96f6 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.091300 28541 raft_consensus.cc:493] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9cea93fb03e04e48a6dabc4094ee7c93)
I20260709 13:09:03.091817 28541 raft_consensus.cc:515] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:03.092341 21312 tablet_replica.cc:333] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.093220 21312 raft_consensus.cc:2243] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.093802 21312 raft_consensus.cc:2272] T 61ec0e67ff314a57bb23fd055736385a P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.096699 21312 tablet_replica.cc:333] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.097496 21312 raft_consensus.cc:2243] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.098083 21312 raft_consensus.cc:2272] T 6ccaa43d7e2044a2b30eb79a52d79b64 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.093880 28541 leader_election.cc:290] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:09:03.101219 22472 leader_election.cc:336] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:03.097954 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e134e5a00e463595325b431f07a3bd" candidate_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:03.105443 22473 leader_election.cc:304] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47a624c3ddb48c5a8947ac0b3e71f84; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:03.106598 28541 raft_consensus.cc:2749] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:03.109117 21312 tablet_replica.cc:333] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.110020 21312 raft_consensus.cc:2243] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.111222 21312 raft_consensus.cc:2272] T 54dce6002cc94eb7ae9be630281c202c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.114149 21312 tablet_replica.cc:333] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.114900 21312 raft_consensus.cc:2243] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.115998 21312 raft_consensus.cc:2272] T bcb965aeed0142a28f51999a91b1eb44 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.118634 21312 tablet_replica.cc:333] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.119432 21312 raft_consensus.cc:2243] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.121282 21312 raft_consensus.cc:2272] T cba81aa4ed494a6c81cc0cf660d6d818 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.124673 21312 tablet_replica.cc:333] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.125625 21312 raft_consensus.cc:2243] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.127028 21312 raft_consensus.cc:2272] T 2c88522d64a9464ea79df0c6a6aa9652 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.130227 21312 tablet_replica.cc:333] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.131186 21312 raft_consensus.cc:2243] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.132155 21312 raft_consensus.cc:2272] T 73e134e5a00e463595325b431f07a3bd P e47a624c3ddb48c5a8947ac0b3e71f84 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.135515 21312 tablet_replica.cc:333] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.136386 21312 raft_consensus.cc:2243] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.137140 21312 raft_consensus.cc:2272] T e0a2c1c9e9dd4272a78e7cd3da913fad P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.140383 21312 tablet_replica.cc:333] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.141333 21312 raft_consensus.cc:2243] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.142635 21312 raft_consensus.cc:2272] T fdfa7f3695964682a28952992553f739 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.146025 21312 tablet_replica.cc:333] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.146821 21312 raft_consensus.cc:2243] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.148236 21312 raft_consensus.cc:2272] T 572a8927b7f349538a2b1f1300d659d2 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.152227 21312 tablet_replica.cc:333] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.153299 21312 raft_consensus.cc:2243] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.154286 21312 raft_consensus.cc:2272] T c9a63a987ca645719f59f026b5d252c9 P e47a624c3ddb48c5a8947ac0b3e71f84 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.159029 21312 tablet_replica.cc:333] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84: stopping tablet replica
I20260709 13:09:03.160884 21312 raft_consensus.cc:2243] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.161994 21312 raft_consensus.cc:2272] T bdd4b2c523374ff98c16360fa254608c P e47a624c3ddb48c5a8947ac0b3e71f84 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.252902 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:03.280370 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:03.346838 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:03.365263 22546 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:03.604861 22546 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111) [suppressed 510 similar messages]
I20260709 13:09:03.793443 28593 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:03.794910 28593 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:03.799860 22546 consensus_peers.cc:597] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:03.811432 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
W20260709 13:09:03.817694 23076 leader_election.cc:336] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:03.818234 23076 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:03.820595 28593 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:03.821537 28593 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:03.842634 22546 consensus_peers.cc:597] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:03.857223 28518 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:03.858150 28518 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:03.868383 23076 leader_election.cc:336] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:03.879726 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:03.880257 23077 leader_election.cc:336] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:03.880681 23077 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:03.882959 28518 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:03.889482 28593 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.896495 28638 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:03.897725 28638 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:03.910356 28639 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:03.911260 28639 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:03.916671 28639 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:09:03.922331 22545 leader_election.cc:336] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:03.931720 22546 consensus_peers.cc:597] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:03.932322 22546 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:03.935597 28638 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:09:03.940420 22545 leader_election.cc:336] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:03.941998 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 61736.7us
I20260709 13:09:03.944895 28518 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:03.945709 28518 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:03.946322 22546 leader_election.cc:336] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:03.946853 22546 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:03.947842 28639 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:03.953742 23076 leader_election.cc:336] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:03.966087 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 54121.8us
I20260709 13:09:03.980192 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:03.980983 23106 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 14.
I20260709 13:09:03.982700 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:03.984215 28593 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:03.985146 28593 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:03.993139 23076 leader_election.cc:336] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.016644 28593 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.023844 22547 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.025460 28639 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.025947 28639 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.026320 28639 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.040597 28518 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.082973 28534 raft_consensus.cc:493] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.084031 28534 raft_consensus.cc:515] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:09:04.087252 28534 leader_election.cc:290] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.106938 28549 raft_consensus.cc:493] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.107831 28549 raft_consensus.cc:515] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:09:04.118608 28549 leader_election.cc:290] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:09:04.120107 22545 leader_election.cc:336] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:04.133421 22545 leader_election.cc:336] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.145045 28642 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.146092 28642 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.149195 28593 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:09:04.149240 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 94353.1us
I20260709 13:09:04.149989 28593 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.154064 28637 raft_consensus.cc:493] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.154561 28593 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:04.154717 28637 raft_consensus.cc:515] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:09:04.148459 28642 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.157128 28637 leader_election.cc:290] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.159538 28641 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.164834 28641 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:04.168123 22545 leader_election.cc:336] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.170275 28637 raft_consensus.cc:493] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.170995 28637 raft_consensus.cc:515] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:09:04.176069 28639 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:04.179106 23077 leader_election.cc:336] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.179570 23077 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:09:04.178694 22546 leader_election.cc:336] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.180505 22546 leader_election.cc:304] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:09:04.184455 23077 leader_election.cc:336] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.184921 23077 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.185524 28644 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:04.186470 28637 leader_election.cc:290] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.183655 28549 raft_consensus.cc:2749] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.191129 28637 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.191847 28637 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.193545 28641 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.195631 28639 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:09:04.197350 22545 leader_election.cc:336] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:04.197916 23076 leader_election.cc:336] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.199298 28549 raft_consensus.cc:493] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.202239 28549 raft_consensus.cc:515] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:09:04.203028 28637 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:09:04.203634 22545 leader_election.cc:336] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:04.204142 22545 leader_election.cc:336] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.200542 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:04.201479 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc53a10833c40d7b01be713f425dfcc" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:09:04.205576 23110 raft_consensus.cc:3060] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.207655 28534 raft_consensus.cc:493] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.208333 28534 raft_consensus.cc:515] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:09:04.210373 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cbb90e435d471fa07712145d0b9faa" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:04.210526 28534 leader_election.cc:290] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.211083 22582 raft_consensus.cc:2468] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 13.
I20260709 13:09:04.217646 22547 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.218477 28534 raft_consensus.cc:2749] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:04.219780 28549 leader_election.cc:290] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:09:04.220561 22545 leader_election.cc:336] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:04.221160 23076 leader_election.cc:336] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.228798 28641 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:04.230034 28641 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.230729 28641 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.233011 28641 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:09:04.240160 22546 leader_election.cc:336] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.240712 22546 leader_election.cc:304] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:09:04.241673 22546 consensus_peers.cc:597] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:04.242081 28639 raft_consensus.cc:2749] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:04.243876 22545 leader_election.cc:336] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.247327 23110 raft_consensus.cc:2468] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
W20260709 13:09:04.228963 23077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43859, user_credentials={real_user=slave}} blocked reactor thread for 44532.1us
W20260709 13:09:04.242147 22546 consensus_peers.cc:597] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:04.261720 22546 leader_election.cc:336] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.261618 22547 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.262198 22546 leader_election.cc:304] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.263578 28549 raft_consensus.cc:2804] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:04.264142 28549 raft_consensus.cc:697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:09:04.265282 28549 consensus_queue.cc:237] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.265755 28639 raft_consensus.cc:2749] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:04.264232 22546 leader_election.cc:336] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.268445 22546 leader_election.cc:304] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.271404 28637 raft_consensus.cc:2749] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:04.271878 23076 leader_election.cc:336] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:04.277119 22546 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:04.277729 22546 leader_election.cc:336] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.278216 22546 leader_election.cc:304] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.279428 28639 raft_consensus.cc:2749] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:04.280711 22546 leader_election.cc:336] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.281152 22546 leader_election.cc:304] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.284690 28549 raft_consensus.cc:2749] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:04.285773 22546 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:04.277096 23076 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:04.293394 22546 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:04.295418 22329 catalog_manager.cc:5697] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 14 to 15, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 15 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:04.319802 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:04.320604 23077 leader_election.cc:336] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.321075 23077 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.322146 28549 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:09:04.322064 23077 leader_election.cc:336] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.322765 28549 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.323127 23077 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.324007 28644 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:04.324266 23077 leader_election.cc:336] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.324800 23077 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.322451 28641 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.325883 28644 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:04.327023 23077 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.327452 23077 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.327792 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:04.328166 28641 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.327214 28549 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:09:04.330814 22545 leader_election.cc:336] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.331288 22545 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.332775 28549 raft_consensus.cc:2749] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.337373 28641 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.338078 28641 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.342367 28644 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.342995 28549 raft_consensus.cc:493] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.343044 28644 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.344671 28641 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.345885 28549 raft_consensus.cc:515] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:09:04.345890 28644 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:04.349195 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:04.349874 22582 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 14.
I20260709 13:09:04.351601 23079 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:09:04.353161 28644 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.353564 28644 raft_consensus.cc:493] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.353796 28549 leader_election.cc:290] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.356022 28644 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:04.364040 22546 consensus_peers.cc:597] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:04.364969 22545 leader_election.cc:336] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.366523 28641 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
W20260709 13:09:04.367285 23077 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:04.370352 23076 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.371012 23076 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.376948 28642 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:04.373822 22546 leader_election.cc:336] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.377919 22546 leader_election.cc:304] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:09:04.378203 23076 leader_election.cc:336] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.367252 28641 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.378163 28644 raft_consensus.cc:515] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.381649 28644 leader_election.cc:290] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:04.383029 28639 raft_consensus.cc:2749] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:04.388911 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e6dd3ee498418ab0eeb27b3289cdc5" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:09:04.389575 22581 raft_consensus.cc:3060] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.388284 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:04.381413 28641 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:04.401866 22581 raft_consensus.cc:2468] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 15.
I20260709 13:09:04.407850 23079 leader_election.cc:304] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
W20260709 13:09:04.408882 23076 leader_election.cc:336] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.408957 28641 raft_consensus.cc:2804] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:04.409927 28641 raft_consensus.cc:697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:09:04.410975 28641 consensus_queue.cc:237] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:04.411554 23076 leader_election.cc:336] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.412021 23076 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.412734 28644 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:04.419724 28549 raft_consensus.cc:493] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.420414 28549 raft_consensus.cc:515] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } }
I20260709 13:09:04.421885 28642 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.422533 28642 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.424937 28642 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:04.422828 28549 leader_election.cc:290] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:09:04.430958 22545 leader_election.cc:336] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.436925 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:04.438838 22581 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 17.
I20260709 13:09:04.437390 22327 catalog_manager.cc:5697] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 14 to 15, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 15 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.443866 23079 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:09:04.445693 28642 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:04.446166 28642 raft_consensus.cc:493] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.446748 28642 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:04.449909 22546 leader_election.cc:336] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.450453 22546 leader_election.cc:304] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.452395 28549 raft_consensus.cc:2749] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.454883 28549 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.455504 28549 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.458657 28549 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:04.465595 28549 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.466223 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:04.466926 23110 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 15.
I20260709 13:09:04.468492 22547 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:09:04.469753 28637 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:04.470146 28637 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.470528 28637 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:04.480232 22545 leader_election.cc:336] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:04.484328 22545 consensus_peers.cc:597] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.466264 28549 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.498917 28549 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
W20260709 13:09:04.499667 23076 leader_election.cc:336] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.501221 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:04.504837 28642 raft_consensus.cc:515] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:04.518769 23077 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:04.488241 28637 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:04.520255 22545 leader_election.cc:336] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.523054 28637 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:04.531622 22545 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.537822 28644 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.538489 28644 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.532891 23110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c88522d64a9464ea79df0c6a6aa9652" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93"
I20260709 13:09:04.533511 28639 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.539783 28639 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.541654 28644 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:04.541814 28639 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4:42955)
I20260709 13:09:04.542366 28639 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:04.543476 23110 raft_consensus.cc:3060] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.544004 23106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "10c2f471167442c0b75d8cd50ed8c40c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" is_pre_election: true
I20260709 13:09:04.553020 28641 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.553666 28641 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.555953 28641 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:04.557140 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfa7f3695964682a28952992553f739" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:09:04.557763 22581 raft_consensus.cc:3060] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:04.558339 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:04.558832 23077 leader_election.cc:336] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.565492 28642 leader_election.cc:290] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:04.569702 22545 leader_election.cc:336] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.577769 21312 tablet_server.cc:196] TabletServer@127.20.208.2:0 shutdown complete.
I20260709 13:09:04.571303 22581 raft_consensus.cc:2468] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 18.
I20260709 13:09:04.572059 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba81aa4ed494a6c81cc0cf660d6d818" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:04.578580 22582 raft_consensus.cc:2468] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 15.
W20260709 13:09:04.578971 23076 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.579502 23076 leader_election.cc:336] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:04.579972 23076 leader_election.cc:336] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.580377 23076 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:09:04.574585 22546 consensus_peers.cc:597] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:04.587253 22545 leader_election.cc:336] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.588673 28642 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:04.589278 23077 leader_election.cc:336] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.593101 22545 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c; no voters: 9cea93fb03e04e48a6dabc4094ee7c93, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:09:04.594107 22545 consensus_peers.cc:597] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.596381 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:04.596560 22546 leader_election.cc:336] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:04.594372 28637 raft_consensus.cc:2749] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:04.604513 23079 leader_election.cc:304] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.605382 28644 raft_consensus.cc:2804] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:04.605978 28644 raft_consensus.cc:697] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:09:04.607153 28644 consensus_queue.cc:237] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:04.594671 22545 consensus_peers.cc:597] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.617888 23110 raft_consensus.cc:2468] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c2f471167442c0b75d8cd50ed8c40c in term 16.
W20260709 13:09:04.623754 23076 leader_election.cc:336] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.624356 23076 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.625587 28593 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:04.626714 23076 consensus_peers.cc:597] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.623776 22547 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.629310 28639 raft_consensus.cc:2804] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:04.629880 28639 raft_consensus.cc:697] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 LEADER]: Becoming Leader. State: Replica: 10c2f471167442c0b75d8cd50ed8c40c, State: Running, Role: LEADER
I20260709 13:09:04.630913 28639 consensus_queue.cc:237] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:04.634598 23076 consensus_peers.cc:597] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.639782 22327 catalog_manager.cc:5697] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 17 to 18, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 18 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:04.641676 22545 consensus_peers.cc:597] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.675865 23076 consensus_peers.cc:597] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.675628 22329 catalog_manager.cc:5697] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c reported cstate change: term changed from 15 to 16, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3). New cstate: current_term: 16 leader_uuid: "10c2f471167442c0b75d8cd50ed8c40c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:04.691293 23076 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.704377 23076 consensus_peers.cc:597] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.715190 28641 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.715814 28641 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.718078 28641 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:04.720299 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c" is_pre_election: true
I20260709 13:09:04.721001 22581 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 8.
I20260709 13:09:04.723785 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 
I20260709 13:09:04.724799 28641 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:04.724983 23076 leader_election.cc:336] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:04.742740 28641 raft_consensus.cc:493] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:04.743357 28641 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.774127 28641 raft_consensus.cc:515] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:04.776657 28641 leader_election.cc:290] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Requested vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:04.780377 23076 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.780964 23076 consensus_peers.cc:597] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.786798 23076 consensus_peers.cc:597] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.787367 23076 leader_election.cc:336] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:04.808573 23076 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.935285 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd4b2c523374ff98c16360fa254608c" candidate_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "10c2f471167442c0b75d8cd50ed8c40c"
I20260709 13:09:04.935963 22579 raft_consensus.cc:3060] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.949322 22579 raft_consensus.cc:2468] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cea93fb03e04e48a6dabc4094ee7c93 in term 9.
I20260709 13:09:04.952251 21312 tablet_server.cc:179] TabletServer@127.20.208.3:0 shutting down...
I20260709 13:09:04.963940 23112 raft_consensus.cc:1275] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:04.972534 23079 leader_election.cc:304] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10c2f471167442c0b75d8cd50ed8c40c, 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:04.974102 28644 raft_consensus.cc:2804] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:04.974673 28644 raft_consensus.cc:697] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Becoming Leader. State: Replica: 9cea93fb03e04e48a6dabc4094ee7c93, State: Running, Role: LEADER
I20260709 13:09:04.975696 28644 consensus_queue.cc:237] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:04.984000 22545 consensus_peers.cc:597] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.984758 22545 consensus_peers.cc:597] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.985234 22545 consensus_peers.cc:597] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.985656 22545 consensus_peers.cc:597] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.991004 22545 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.992676 28637 consensus_queue.cc:1048] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:09:05.006692 23077 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:05.007771 23076 consensus_peers.cc:597] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.008530 23076 consensus_peers.cc:597] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.027156 22546 consensus_peers.cc:597] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:05.058668 22545 consensus_peers.cc:597] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.062199 23076 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.072269 22329 catalog_manager.cc:5697] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 reported cstate change: term changed from 8 to 9, leader changed from e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2) to 9cea93fb03e04e48a6dabc4094ee7c93 (127.20.208.4). New cstate: current_term: 9 leader_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:05.078899 23079 consensus_peers.cc:597] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.079593 23079 consensus_peers.cc:597] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.105715 23079 consensus_peers.cc:597] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.113031 23079 consensus_peers.cc:597] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.114698 23079 consensus_peers.cc:597] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.116083 23079 consensus_peers.cc:597] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.117605 23079 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.122723 22545 consensus_peers.cc:597] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.124539 23079 consensus_peers.cc:597] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.126928 23079 consensus_peers.cc:597] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.128892 23110 raft_consensus.cc:1275] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Refusing update from remote peer 10c2f471167442c0b75d8cd50ed8c40c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:05.130383 28655 consensus_queue.cc:1048] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:05.136852 22546 consensus_peers.cc:597] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:05.156397 23079 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.157184 23076 consensus_peers.cc:597] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.197712 22545 consensus_peers.cc:597] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.224849 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:05.225975 21312 tablet_replica.cc:333] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
W20260709 13:09:05.232904 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:05.240767 21312 raft_consensus.cc:2243] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:09:05.241586 22545 consensus_peers.cc:597] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.242229 21312 raft_consensus.cc:2272] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:05.245203 23079 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.245926 21312 tablet_replica.cc:333] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.246773 21312 raft_consensus.cc:2243] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.247844 21312 raft_consensus.cc:2272] T 9bc53a10833c40d7b01be713f425dfcc P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.258855 21312 tablet_replica.cc:333] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.259707 21312 raft_consensus.cc:2243] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.260357 21312 raft_consensus.cc:2272] T 55dc1d250bfe4f2c9c577323b3736521 P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.263010 21312 tablet_replica.cc:333] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.263733 21312 raft_consensus.cc:2243] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.264725 21312 raft_consensus.cc:2272] T 78cbb90e435d471fa07712145d0b9faa P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.267654 21312 tablet_replica.cc:333] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.268443 21312 raft_consensus.cc:2243] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.271529 21312 raft_consensus.cc:2272] T a98509b657f84336bb26dd231a3124f1 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:05.273722 23079 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.274288 21312 tablet_replica.cc:333] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.275207 21312 raft_consensus.cc:2243] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.289420 21312 raft_consensus.cc:2272] T 634877efa82d48ea9055feb74030391f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.292629 21312 tablet_replica.cc:333] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.293490 21312 raft_consensus.cc:2243] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.294215 21312 raft_consensus.cc:2272] T 764f8dc47e2c49648f870ba9bd1b55fc P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.296955 21312 tablet_replica.cc:333] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.297685 21312 raft_consensus.cc:2243] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.305474 21312 raft_consensus.cc:2272] T 4d46675566504843a14e59e2035629c3 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.308394 21312 tablet_replica.cc:333] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.309283 21312 raft_consensus.cc:2243] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.310503 21312 raft_consensus.cc:2272] T ac2656d4dbbd4ca1a10c904a0a12fc6f P 10c2f471167442c0b75d8cd50ed8c40c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:05.319871 23079 consensus_peers.cc:597] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.321280 21312 tablet_replica.cc:333] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.322302 21312 raft_consensus.cc:2243] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.323603 21312 raft_consensus.cc:2272] T c96fcf9d065e46528b502778fede0f1f P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.326489 21312 tablet_replica.cc:333] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.327093 21312 raft_consensus.cc:2243] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.327970 21312 raft_consensus.cc:2272] T 28e7a53997c5479d8edfb755d887f72a P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.330890 21312 tablet_replica.cc:333] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.331918 21312 raft_consensus.cc:2243] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.332743 21312 raft_consensus.cc:2272] T c7bfc975f9f54ea59fbab64cd3362a0d P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.335654 21312 tablet_replica.cc:333] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.336499 21312 raft_consensus.cc:2243] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.337317 21312 raft_consensus.cc:2272] T 5964cb0c6d2046d4b63d976e33ff0d84 P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.340255 21312 tablet_replica.cc:333] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.341105 21312 raft_consensus.cc:2243] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.341758 21312 raft_consensus.cc:2272] T f4d35c45e33c4336b33461cdbe7f7b6f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.344925 21312 tablet_replica.cc:333] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.345741 21312 raft_consensus.cc:2243] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.346508 21312 raft_consensus.cc:2272] T 2b2c58309c5440b19fa96cbeb5491c79 P 10c2f471167442c0b75d8cd50ed8c40c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.349933 21312 tablet_replica.cc:333] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.350808 21312 raft_consensus.cc:2243] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.352145 21312 raft_consensus.cc:2272] T 0b920299a38a48b1a5c349b6f109fa9f P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.355274 21312 tablet_replica.cc:333] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.356168 21312 raft_consensus.cc:2243] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:05.362380 23079 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.360661 21312 raft_consensus.cc:2272] T 063ac6dfc4614afb9ca68efa49225bf7 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.367908 21312 tablet_replica.cc:333] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.368983 21312 raft_consensus.cc:2243] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.369910 21312 raft_consensus.cc:2272] T bd39ff0031394113b2b75f15cd7c44a4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.373574 21312 tablet_replica.cc:333] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.374431 21312 raft_consensus.cc:2243] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.375747 21312 raft_consensus.cc:2272] T 22a9d7ee5bd74642bb36af19c37bbd3f P 10c2f471167442c0b75d8cd50ed8c40c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.385061 21312 tablet_replica.cc:333] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.385897 21312 raft_consensus.cc:2243] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.387004 21312 raft_consensus.cc:2272] T 69914642ad6d43889fea43ca1c6697f4 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.389742 21312 tablet_replica.cc:333] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.390651 21312 raft_consensus.cc:2243] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.391426 21312 raft_consensus.cc:2272] T 93a148d1e8b84ad7815dcaf111f422a7 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.395613 21312 tablet_replica.cc:333] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.396409 21312 raft_consensus.cc:2243] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.397678 21312 raft_consensus.cc:2272] T 06de1406fed544b39bf6d0ab441df770 P 10c2f471167442c0b75d8cd50ed8c40c [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.400293 21312 tablet_replica.cc:333] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.401055 21312 raft_consensus.cc:2243] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.402236 21312 raft_consensus.cc:2272] T 2647750dc34142bf8dd2c7a3bd334fc4 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:05.408591 22546 consensus_peers.cc:597] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:05.412067 21312 tablet_replica.cc:333] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.414970 21312 raft_consensus.cc:2243] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.416007 21312 raft_consensus.cc:2272] T 69f070e8e9ed4c95b36baa7f987d1fba P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.419993 21312 tablet_replica.cc:333] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.424104 21312 raft_consensus.cc:2243] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.425995 21312 raft_consensus.cc:2272] T 5ceea8b6b718469c8d899d7f03824359 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.428844 21312 tablet_replica.cc:333] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.429620 21312 raft_consensus.cc:2243] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.430832 21312 raft_consensus.cc:2272] T 314cf48b748f4bcd8768227cd02627af P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.433801 21312 tablet_replica.cc:333] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.434600 21312 raft_consensus.cc:2243] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.435300 21312 raft_consensus.cc:2272] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.438198 21312 tablet_replica.cc:333] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.457182 21312 raft_consensus.cc:2243] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.457821 21312 raft_consensus.cc:2272] T 7c3eb92518c7460abd36818ae39be5a0 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.460915 21312 tablet_replica.cc:333] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.461680 21312 raft_consensus.cc:2243] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.462946 21312 raft_consensus.cc:2272] T 4ac5249f314546e6a563fe498ff87f21 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:05.479254 22546 consensus_peers.cc:597] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:05.490918 21312 tablet_replica.cc:333] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.491802 21312 raft_consensus.cc:2243] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.496614 21312 raft_consensus.cc:2272] T 64165ef33c5441ef8b91a67653951961 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:05.500253 23076 consensus_peers.cc:597] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.504259 21312 tablet_replica.cc:333] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.506481 21312 raft_consensus.cc:2243] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:09:05.506708 23079 consensus_peers.cc:597] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.507701 21312 raft_consensus.cc:2272] T 0960e28f558c46c9bce238b59dea96f6 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.523684 21312 tablet_replica.cc:333] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.524545 21312 raft_consensus.cc:2243] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.525959 21312 raft_consensus.cc:2272] T fdfa7f3695964682a28952992553f739 P 10c2f471167442c0b75d8cd50ed8c40c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.531529 21312 tablet_replica.cc:333] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.532374 21312 raft_consensus.cc:2243] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.533601 21312 raft_consensus.cc:2272] T 87cca3dfe6984b21bf5701f6f3b21b83 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.536314 21312 tablet_replica.cc:333] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.537137 21312 raft_consensus.cc:2243] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.537753 21312 raft_consensus.cc:2272] T 07e24d8dba0542d7a1428819c63159f5 P 10c2f471167442c0b75d8cd50ed8c40c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.541016 21312 tablet_replica.cc:333] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.541839 21312 raft_consensus.cc:2243] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.542956 21312 raft_consensus.cc:2272] T 94be7e6c95554db88c30fee7a3db405f P 10c2f471167442c0b75d8cd50ed8c40c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.545656 21312 tablet_replica.cc:333] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.546357 21312 raft_consensus.cc:2243] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.547004 21312 raft_consensus.cc:2272] T 3cb0890d5a7741bd8793d654027263a2 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.549481 21312 tablet_replica.cc:333] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.550175 21312 raft_consensus.cc:2243] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.551782 21312 raft_consensus.cc:2272] T 4fe7e8d85f3b4703b850c99a435d1d29 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.557060 21312 tablet_replica.cc:333] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.557934 21312 raft_consensus.cc:2243] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.559089 21312 raft_consensus.cc:2272] T 2c88522d64a9464ea79df0c6a6aa9652 P 10c2f471167442c0b75d8cd50ed8c40c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.571517 21312 tablet_replica.cc:333] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.572829 21312 raft_consensus.cc:2243] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.575353 21312 raft_consensus.cc:2272] T ee6d9e2f597948e7b4670b3606ebf448 P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.608314 21312 tablet_replica.cc:333] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.609287 21312 raft_consensus.cc:2243] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.610642 21312 raft_consensus.cc:2272] T c9a63a987ca645719f59f026b5d252c9 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.613659 21312 tablet_replica.cc:333] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.614858 28641 raft_consensus.cc:493] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:05.630484 28641 raft_consensus.cc:515] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:05.630908 21312 raft_consensus.cc:2243] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.631999 21312 raft_consensus.cc:2272] T bcb965aeed0142a28f51999a91b1eb44 P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.633181 28641 leader_election.cc:290] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:09:05.639546 23077 leader_election.cc:336] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:05.643803 23076 leader_election.cc:336] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:05.644412 23076 leader_election.cc:304] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:05.645262 28641 raft_consensus.cc:2749] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:05.649065 21312 tablet_replica.cc:333] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.650002 21312 raft_consensus.cc:2243] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.655980 21312 raft_consensus.cc:2272] T cba81aa4ed494a6c81cc0cf660d6d818 P 10c2f471167442c0b75d8cd50ed8c40c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.658927 21312 tablet_replica.cc:333] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.659698 21312 raft_consensus.cc:2243] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.660576 21312 raft_consensus.cc:2272] T bdd4b2c523374ff98c16360fa254608c P 10c2f471167442c0b75d8cd50ed8c40c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.663532 21312 tablet_replica.cc:333] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.664182 21312 raft_consensus.cc:2243] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.665037 21312 raft_consensus.cc:2272] T 54dce6002cc94eb7ae9be630281c202c P 10c2f471167442c0b75d8cd50ed8c40c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.667856 21312 tablet_replica.cc:333] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.668592 21312 raft_consensus.cc:2243] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.669903 21312 raft_consensus.cc:2272] T 61ec0e67ff314a57bb23fd055736385a P 10c2f471167442c0b75d8cd50ed8c40c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.672761 21312 tablet_replica.cc:333] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c: stopping tablet replica
I20260709 13:09:05.673422 21312 raft_consensus.cc:2243] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.674536 21312 raft_consensus.cc:2272] T 6ccaa43d7e2044a2b30eb79a52d79b64 P 10c2f471167442c0b75d8cd50ed8c40c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:05.721122 23077 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:05.728484 23077 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:05.757381 23077 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:05.778121 28642 raft_consensus.cc:493] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:05.778787 28642 raft_consensus.cc:515] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:05.781250 28642 leader_election.cc:290] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:09:05.786936 23077 leader_election.cc:336] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:05.799883 23076 leader_election.cc:336] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:05.800370 23076 leader_election.cc:304] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:05.801151 28642 raft_consensus.cc:2749] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:05.855281 22603 debug-util.cc:398] Leaking SignalData structure 0x7b0800388ae0 after lost signal to thread 21315
W20260709 13:09:05.856519 22603 debug-util.cc:398] Leaking SignalData structure 0x7b0800340480 after lost signal to thread 22365
W20260709 13:09:05.857805 22603 debug-util.cc:398] Leaking SignalData structure 0x7b080033c0c0 after lost signal to thread 22606
W20260709 13:09:05.858987 22603 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1560 after lost signal to thread 23137
I20260709 13:09:05.875156 28642 raft_consensus.cc:493] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:05.875878 28642 raft_consensus.cc:515] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:05.885950 23077 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:05.889142 28642 leader_election.cc:290] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:09:05.895706 23076 leader_election.cc:336] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:05.896271 23076 leader_election.cc:304] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:05.897068 28642 raft_consensus.cc:2749] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:06.047080 28642 raft_consensus.cc:493] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:06.047694 28642 raft_consensus.cc:515] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.050896 28642 leader_election.cc:290] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:09:06.058386 23077 leader_election.cc:336] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:06.065080 23076 leader_election.cc:336] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:06.065649 23076 leader_election.cc:304] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:06.066438 28642 raft_consensus.cc:2749] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:06.087049 28642 raft_consensus.cc:493] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:06.087692 28642 raft_consensus.cc:515] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:06.094098 23077 leader_election.cc:336] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:06.095513 28642 leader_election.cc:290] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:09:06.124977 23076 leader_election.cc:336] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:06.125864 23076 leader_election.cc:304] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:06.127040 28642 raft_consensus.cc:2749] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:06.171141 28642 raft_consensus.cc:493] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:06.171698 28642 raft_consensus.cc:515] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.177100 28642 leader_election.cc:290] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:06.179139 28593 raft_consensus.cc:493] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:06.180132 28593 raft_consensus.cc:515] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:06.192178 23079 leader_election.cc:336] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
W20260709 13:09:06.199630 23077 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:06.203745 23077 leader_election.cc:336] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:06.204458 23077 leader_election.cc:336] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:06.205401 23077 leader_election.cc:304] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:06.207274 28642 raft_consensus.cc:2749] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:06.203089 28593 leader_election.cc:290] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:06.216030 28642 raft_consensus.cc:493] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:06.216704 28642 raft_consensus.cc:515] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.218991 28642 leader_election.cc:290] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
W20260709 13:09:06.230751 23077 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:06.231391 23076 leader_election.cc:336] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:06.232247 23076 leader_election.cc:304] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:06.233624 28642 raft_consensus.cc:2749] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:06.235091 23076 leader_election.cc:336] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:06.241478 23076 leader_election.cc:336] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:06.242014 23076 leader_election.cc:304] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:06.242798 28642 raft_consensus.cc:2749] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:06.248282 28593 raft_consensus.cc:493] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:06.248857 28593 raft_consensus.cc:515] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } attrs { replace: true } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.251858 28593 leader_election.cc:290] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:06.262946 23079 leader_election.cc:336] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
W20260709 13:09:06.269891 23077 leader_election.cc:336] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:06.274646 23077 leader_election.cc:304] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:06.277123 28593 raft_consensus.cc:2749] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:06.297029 23076 leader_election.cc:336] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:06.463418 28593 raft_consensus.cc:493] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.463999 28593 raft_consensus.cc:515] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.466544 28593 leader_election.cc:290] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:06.479950 23077 leader_election.cc:336] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:06.482537 23079 leader_election.cc:336] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.487708 23079 leader_election.cc:304] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:06.489671 28593 raft_consensus.cc:2749] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:06.516850 28593 raft_consensus.cc:493] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.517437 28593 raft_consensus.cc:515] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:06.523972 23077 leader_election.cc:336] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:06.525242 28593 leader_election.cc:290] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:06.527851 28593 raft_consensus.cc:493] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.540802 28593 raft_consensus.cc:515] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.543344 28593 leader_election.cc:290] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:06.557791 23079 leader_election.cc:336] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.558911 23079 leader_election.cc:304] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:06.565047 28593 raft_consensus.cc:2749] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:06.571995 23076 leader_election.cc:336] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:06.574947 23079 leader_election.cc:336] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.576673 23079 leader_election.cc:304] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:06.578943 28593 raft_consensus.cc:2749] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:06.588704 28642 raft_consensus.cc:493] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.589277 28642 raft_consensus.cc:515] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.592053 28642 leader_election.cc:290] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:06.617480 28642 raft_consensus.cc:493] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e47a624c3ddb48c5a8947ac0b3e71f84)
I20260709 13:09:06.618120 28642 raft_consensus.cc:515] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.617125 28593 raft_consensus.cc:493] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.622087 28593 raft_consensus.cc:515] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.620324 28642 leader_election.cc:290] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819)
I20260709 13:09:06.625285 28593 leader_election.cc:290] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:06.631991 23077 leader_election.cc:336] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:06.632634 23077 leader_election.cc:336] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:06.635183 28642 raft_consensus.cc:493] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.635843 28642 raft_consensus.cc:515] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.638542 28642 leader_election.cc:290] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:06.643517 28593 raft_consensus.cc:493] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.647135 28593 raft_consensus.cc:515] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:06.651377 23077 leader_election.cc:336] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:06.650053 23076 leader_election.cc:336] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:06.657212 23079 leader_election.cc:336] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.660816 23079 leader_election.cc:304] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:06.655685 28642 raft_consensus.cc:493] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.662052 28642 raft_consensus.cc:515] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.664500 28642 leader_election.cc:290] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:06.654134 28593 leader_election.cc:290] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
I20260709 13:09:06.665522 28644 raft_consensus.cc:2749] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:06.667855 23076 leader_election.cc:336] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:06.671456 23076 leader_election.cc:304] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:06.691061 28593 raft_consensus.cc:2749] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:06.700563 23079 leader_election.cc:336] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.719528 23079 leader_election.cc:304] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:06.720366 28662 raft_consensus.cc:493] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.722363 28662 raft_consensus.cc:515] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.724742 28662 leader_election.cc:290] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:06.718979 23076 leader_election.cc:336] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:06.733693 28663 raft_consensus.cc:2749] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:06.735797 23076 leader_election.cc:336] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
W20260709 13:09:06.730279 23077 leader_election.cc:336] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:06.757465 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 56961.1us
W20260709 13:09:06.758224 23079 leader_election.cc:336] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.758780 23079 leader_election.cc:304] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:06.764706 28662 raft_consensus.cc:2749] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:06.771750 23079 leader_election.cc:336] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.776880 23079 leader_election.cc:304] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:09:06.782158 23079 leader_election.cc:336] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.784320 23079 leader_election.cc:304] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:06.782878 28665 raft_consensus.cc:2749] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:06.785693 28662 raft_consensus.cc:2749] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:06.798096 23076 consensus_peers.cc:597] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.799928 23079 leader_election.cc:336] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.800536 23079 leader_election.cc:304] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:06.801286 28665 raft_consensus.cc:2749] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:06.807073 21312 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22603)
I20260709 13:09:06.843794 28665 raft_consensus.cc:493] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.844549 28665 raft_consensus.cc:515] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:06.853157 23077 leader_election.cc:336] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:06.854846 28665 leader_election.cc:290] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:06.860685 23076 leader_election.cc:336] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:06.861299 23076 leader_election.cc:304] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
I20260709 13:09:06.862270 28665 raft_consensus.cc:2749] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:06.866813 28662 raft_consensus.cc:493] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.867314 28662 raft_consensus.cc:515] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.869590 28662 leader_election.cc:290] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:06.876137 23077 leader_election.cc:336] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:06.877315 28665 raft_consensus.cc:493] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.878291 28665 raft_consensus.cc:515] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.882230 28665 leader_election.cc:290] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:06.884727 23079 leader_election.cc:336] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.886559 28662 raft_consensus.cc:493] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.888875 28662 raft_consensus.cc:515] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "e47a624c3ddb48c5a8947ac0b3e71f84" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42819 } attrs { replace: true } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
W20260709 13:09:06.889310 23077 leader_election.cc:336] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:06.892045 28662 leader_election.cc:290] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:06.897400 23077 leader_election.cc:336] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
W20260709 13:09:06.897346 23079 leader_election.cc:336] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.898527 23079 leader_election.cc:304] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:06.899339 28665 raft_consensus.cc:2749] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:06.899786 23079 leader_election.cc:336] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.901872 23079 leader_election.cc:304] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:06.902637 28665 raft_consensus.cc:2749] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:06.909734 23076 leader_election.cc:336] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111)
I20260709 13:09:06.910322 23076 leader_election.cc:304] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: e32ba8e6132b4f8e98a99066b6fffe05, e47a624c3ddb48c5a8947ac0b3e71f84
W20260709 13:09:06.915359 23079 leader_election.cc:336] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
I20260709 13:09:06.909178 28665 raft_consensus.cc:493] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 10c2f471167442c0b75d8cd50ed8c40c)
I20260709 13:09:06.917169 28665 raft_consensus.cc:515] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e32ba8e6132b4f8e98a99066b6fffe05" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43859 } } peers { permanent_uuid: "10c2f471167442c0b75d8cd50ed8c40c" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40903 } } peers { permanent_uuid: "9cea93fb03e04e48a6dabc4094ee7c93" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 42955 } attrs { promote: false } }
I20260709 13:09:06.919353 28665 leader_election.cc:290] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859), 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903)
W20260709 13:09:06.922449 23077 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:06.926558 28665 raft_consensus.cc:2749] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:06.929750 23079 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111)
W20260709 13:09:06.933615 23077 leader_election.cc:336] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111)
I20260709 13:09:06.934176 23077 leader_election.cc:304] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cea93fb03e04e48a6dabc4094ee7c93; no voters: 10c2f471167442c0b75d8cd50ed8c40c, e32ba8e6132b4f8e98a99066b6fffe05
I20260709 13:09:06.935009 28665 raft_consensus.cc:2749] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:07.048564 23077 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:07.099723 23076 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.118237 23077 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:07.125891 23079 consensus_peers.cc:597] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.130075 23077 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:07.199375 23079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40903, user_credentials={real_user=slave}} blocked reactor thread for 67504us
W20260709 13:09:07.206641 23076 consensus_peers.cc:597] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.211030 23076 consensus_peers.cc:597] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.211534 23076 consensus_peers.cc:597] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.214178 23076 consensus_peers.cc:597] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.214771 23076 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.224112 23076 consensus_peers.cc:597] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.280506 23076 consensus_peers.cc:597] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.350956 23076 consensus_peers.cc:597] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.367205 23076 consensus_peers.cc:597] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.374673 23077 consensus_peers.cc:597] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:07.394512 23079 consensus_peers.cc:597] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.481303 23079 consensus_peers.cc:597] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.485069 23079 consensus_peers.cc:597] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.496750 23076 consensus_peers.cc:597] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.544943 23076 consensus_peers.cc:597] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.585342 23079 consensus_peers.cc:597] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.587831 23079 consensus_peers.cc:597] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.601512 23079 consensus_peers.cc:597] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:07.699616 21312 tablet_server.cc:196] TabletServer@127.20.208.3:0 shutdown complete.
W20260709 13:09:07.715855 23077 consensus_peers.cc:597] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e32ba8e6132b4f8e98a99066b6fffe05 (127.20.208.1:43859): Couldn't send request to peer e32ba8e6132b4f8e98a99066b6fffe05. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43859: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:09:07.725194 23079 consensus_peers.cc:597] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.744984 23079 consensus_peers.cc:597] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.748895 23076 consensus_peers.cc:597] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer e47a624c3ddb48c5a8947ac0b3e71f84 (127.20.208.2:42819): Couldn't send request to peer e47a624c3ddb48c5a8947ac0b3e71f84. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.789822 23079 consensus_peers.cc:597] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:07.817499 21312 tablet_server.cc:179] TabletServer@127.20.208.4:0 shutting down...
W20260709 13:09:07.837251 23079 consensus_peers.cc:597] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:07.865682 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:07.866524 21312 tablet_replica.cc:333] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.867542 21312 raft_consensus.cc:2243] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.868307 21312 raft_consensus.cc:2272] T 64165ef33c5441ef8b91a67653951961 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.871526 21312 tablet_replica.cc:333] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.872516 21312 raft_consensus.cc:2243] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.873937 21312 raft_consensus.cc:2272] T ff0a64e3152c4ccbbff4e78b6e82db2a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.877247 21312 tablet_replica.cc:333] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.877997 21312 raft_consensus.cc:2243] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.878829 21312 raft_consensus.cc:2272] T 634877efa82d48ea9055feb74030391f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.881238 21312 tablet_replica.cc:333] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.881794 21312 raft_consensus.cc:2243] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.882486 21312 raft_consensus.cc:2272] T add2d1ead99b44f6b4c0bb7f2fa9857a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.884765 21312 tablet_replica.cc:333] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.885411 21312 raft_consensus.cc:2243] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.885820 21312 raft_consensus.cc:2272] T 9bc53a10833c40d7b01be713f425dfcc P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.888142 21312 tablet_replica.cc:333] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.888758 21312 raft_consensus.cc:2243] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.889467 21312 raft_consensus.cc:2272] T ee6d9e2f597948e7b4670b3606ebf448 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.891481 21312 tablet_replica.cc:333] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.892302 21312 raft_consensus.cc:2243] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.892992 21312 raft_consensus.cc:2272] T cba81aa4ed494a6c81cc0cf660d6d818 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.895831 21312 tablet_replica.cc:333] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.896762 21312 raft_consensus.cc:2243] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.897753 21312 raft_consensus.cc:2272] T 06de1406fed544b39bf6d0ab441df770 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.900501 21312 tablet_replica.cc:333] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.901206 21312 raft_consensus.cc:2243] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.901975 21312 raft_consensus.cc:2272] T 1dcd5807b34a410c9196ed1b6e80ace3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.904111 21312 tablet_replica.cc:333] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.904838 21312 raft_consensus.cc:2243] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.905375 21312 raft_consensus.cc:2272] T 78cbb90e435d471fa07712145d0b9faa P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.907955 21312 tablet_replica.cc:333] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.908691 21312 raft_consensus.cc:2243] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.909248 21312 raft_consensus.cc:2272] T 69914642ad6d43889fea43ca1c6697f4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.911811 21312 tablet_replica.cc:333] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.912365 21312 raft_consensus.cc:2243] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.913172 21312 pending_rounds.cc:70] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: Trying to abort 1 pending ops.
I20260709 13:09:07.913339 21312 pending_rounds.cc:77] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting op as it isn't in flight: id { term: 9 index: 9 } timestamp: 7305636024238522368 op_type: NO_OP noop_request { }
I20260709 13:09:07.913671 21312 raft_consensus.cc:2889] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:07.913950 21312 raft_consensus.cc:2272] T bdd4b2c523374ff98c16360fa254608c P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.916744 21312 tablet_replica.cc:333] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.917760 21312 raft_consensus.cc:2243] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.918483 21312 raft_consensus.cc:2272] T 2c88522d64a9464ea79df0c6a6aa9652 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.921882 21312 tablet_replica.cc:333] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.922719 21312 raft_consensus.cc:2243] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.924145 21312 raft_consensus.cc:2272] T 73e134e5a00e463595325b431f07a3bd P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.927067 21312 tablet_replica.cc:333] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.928100 21312 raft_consensus.cc:2243] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.928778 21312 raft_consensus.cc:2272] T 4fe7e8d85f3b4703b850c99a435d1d29 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.931012 21312 tablet_replica.cc:333] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.931639 21312 raft_consensus.cc:2243] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.932435 21312 raft_consensus.cc:2272] T 7c3eb92518c7460abd36818ae39be5a0 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.934827 21312 tablet_replica.cc:333] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.935474 21312 raft_consensus.cc:2243] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.936365 21312 raft_consensus.cc:2272] T 3cb0890d5a7741bd8793d654027263a2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.938360 21312 tablet_replica.cc:333] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.938920 21312 raft_consensus.cc:2243] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.939430 21312 raft_consensus.cc:2272] T c96fcf9d065e46528b502778fede0f1f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.941556 21312 tablet_replica.cc:333] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.942118 21312 raft_consensus.cc:2243] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.942934 21312 raft_consensus.cc:2272] T 17ed109556234df2aeba1d6118cc0a95 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.945259 21312 tablet_replica.cc:333] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.945847 21312 raft_consensus.cc:2243] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.946755 21312 raft_consensus.cc:2272] T e0a2c1c9e9dd4272a78e7cd3da913fad P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.948890 21312 tablet_replica.cc:333] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.949503 21312 raft_consensus.cc:2243] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.950394 21312 raft_consensus.cc:2272] T 314cf48b748f4bcd8768227cd02627af P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.953291 21312 tablet_replica.cc:333] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.954046 21312 raft_consensus.cc:2243] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.954900 21312 raft_consensus.cc:2272] T 07e24d8dba0542d7a1428819c63159f5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.957460 21312 tablet_replica.cc:333] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.958070 21312 raft_consensus.cc:2243] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.958959 21312 raft_consensus.cc:2272] T a98509b657f84336bb26dd231a3124f1 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.961071 21312 tablet_replica.cc:333] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.961674 21312 raft_consensus.cc:2243] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.962224 21312 raft_consensus.cc:2272] T c04b0ff4c7da4211acec428ae776775a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.964298 21312 tablet_replica.cc:333] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.964843 21312 raft_consensus.cc:2243] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.965596 21312 raft_consensus.cc:2272] T 4d46675566504843a14e59e2035629c3 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.967796 21312 tablet_replica.cc:333] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.968392 21312 raft_consensus.cc:2243] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.969319 21312 raft_consensus.cc:2272] T f4d35c45e33c4336b33461cdbe7f7b6f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.971976 21312 tablet_replica.cc:333] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.972819 21312 raft_consensus.cc:2243] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.973963 21312 raft_consensus.cc:2272] T 2b2c58309c5440b19fa96cbeb5491c79 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.976358 21312 tablet_replica.cc:333] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.976963 21312 raft_consensus.cc:2243] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.977715 21312 pending_rounds.cc:70] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Trying to abort 1 pending ops.
I20260709 13:09:07.977878 21312 pending_rounds.cc:77] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting op as it isn't in flight: id { term: 15 index: 13 } timestamp: 7305636021921501184 op_type: NO_OP noop_request { }
I20260709 13:09:07.978135 21312 raft_consensus.cc:2889] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:07.978380 21312 raft_consensus.cc:2272] T 78e6dd3ee498418ab0eeb27b3289cdc5 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.980607 21312 tablet_replica.cc:333] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.981187 21312 raft_consensus.cc:2243] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.982124 21312 raft_consensus.cc:2272] T 69f070e8e9ed4c95b36baa7f987d1fba P 9cea93fb03e04e48a6dabc4094ee7c93 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:07.983791 23079 consensus_peers.cc:597] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 -> Peer 10c2f471167442c0b75d8cd50ed8c40c (127.20.208.3:40903): Couldn't send request to peer 10c2f471167442c0b75d8cd50ed8c40c. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:07.984640 21312 tablet_replica.cc:333] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.985335 21312 raft_consensus.cc:2243] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.985903 21312 raft_consensus.cc:2272] T 5ceea8b6b718469c8d899d7f03824359 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.988101 21312 tablet_replica.cc:333] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.988653 21312 raft_consensus.cc:2243] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.989102 21312 raft_consensus.cc:2272] T 7dae4a3a8e0e4e2e97b920c88a3fb020 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.991159 21312 tablet_replica.cc:333] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.991679 21312 raft_consensus.cc:2243] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.992590 21312 pending_rounds.cc:70] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: Trying to abort 1 pending ops.
I20260709 13:09:07.992766 21312 pending_rounds.cc:77] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93: Aborting op as it isn't in flight: id { term: 18 index: 17 } timestamp: 7305636022722007040 op_type: NO_OP noop_request { }
I20260709 13:09:07.993018 21312 raft_consensus.cc:2889] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:07.993288 21312 raft_consensus.cc:2272] T fdfa7f3695964682a28952992553f739 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.995597 21312 tablet_replica.cc:333] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.996187 21312 raft_consensus.cc:2243] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:07.996696 21312 raft_consensus.cc:2272] T 572a8927b7f349538a2b1f1300d659d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.998859 21312 tablet_replica.cc:333] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:07.999413 21312 raft_consensus.cc:2243] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.000222 21312 raft_consensus.cc:2272] T bd39ff0031394113b2b75f15cd7c44a4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.002293 21312 tablet_replica.cc:333] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:08.003044 21312 raft_consensus.cc:2243] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.004011 21312 raft_consensus.cc:2272] T 94be7e6c95554db88c30fee7a3db405f P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.006695 21312 tablet_replica.cc:333] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:08.007298 21312 raft_consensus.cc:2243] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.007754 21312 raft_consensus.cc:2272] T 03bee4af77fb4bccad7991b1429bba72 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.009670 21312 tablet_replica.cc:333] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:08.010156 21312 raft_consensus.cc:2243] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.010632 21312 raft_consensus.cc:2272] T 2647750dc34142bf8dd2c7a3bd334fc4 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.012568 21312 tablet_replica.cc:333] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:08.013037 21312 raft_consensus.cc:2243] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.013486 21312 raft_consensus.cc:2272] T 8fecad4f2f3d49ea8a691075b31e1f96 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.015473 21312 tablet_replica.cc:333] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:08.015941 21312 raft_consensus.cc:2243] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.016806 21312 raft_consensus.cc:2272] T 6089498054d24ce99c46fe9be74f8589 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.018764 21312 tablet_replica.cc:333] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:08.019304 21312 raft_consensus.cc:2243] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.019945 21312 raft_consensus.cc:2272] T 109ad37fc4fb45618b11eb81e3b2c7d2 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.022271 21312 tablet_replica.cc:333] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:08.022775 21312 raft_consensus.cc:2243] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.023588 21312 raft_consensus.cc:2272] T 5964cb0c6d2046d4b63d976e33ff0d84 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.025596 21312 tablet_replica.cc:333] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:08.026118 21312 raft_consensus.cc:2243] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.026693 21312 raft_consensus.cc:2272] T 4293c025258b4f61abd2346d38a2752b P 9cea93fb03e04e48a6dabc4094ee7c93 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.029047 21312 tablet_replica.cc:333] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:08.029510 21312 raft_consensus.cc:2243] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.030315 21312 raft_consensus.cc:2272] T 063ac6dfc4614afb9ca68efa49225bf7 P 9cea93fb03e04e48a6dabc4094ee7c93 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.032234 21312 tablet_replica.cc:333] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93: stopping tablet replica
I20260709 13:09:08.032728 21312 raft_consensus.cc:2243] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.033174 21312 raft_consensus.cc:2272] T 28e7a53997c5479d8edfb755d887f72a P 9cea93fb03e04e48a6dabc4094ee7c93 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:08.142638 22362 debug-util.cc:398] Leaking SignalData structure 0x7b0800112e20 after lost signal to thread 21315
W20260709 13:09:08.143754 22362 debug-util.cc:398] Leaking SignalData structure 0x7b08002036e0 after lost signal to thread 22365
W20260709 13:09:08.145195 22362 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2880 after lost signal to thread 23137
I20260709 13:09:08.548085 21312 tablet_server.cc:196] TabletServer@127.20.208.4:0 shutdown complete.
I20260709 13:09:08.658010 21312 master.cc:562] Master@127.20.208.62:33169 shutting down...
W20260709 13:09:08.699378 22379 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:09:08.699810 22379 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:08.700071 22379 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:09:08.705004 21312 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.705636 21312 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.706014 21312 tablet_replica.cc:333] T 00000000000000000000000000000000 P 71b24ec4eeaf4affa54fd8c740a7795b: stopping tablet replica
I20260709 13:09:09.030159 21312 master.cc:584] Master@127.20.208.62:33169 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (199816 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:09:09.121407 21312 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.208.62:34427
I20260709 13:09:09.122530 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:09.127807 28669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.128880 28668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.129783 28671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.130475 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:09.133232 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:09.133462 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:09.133621 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602549133595 us; error 0 us; skew 500 ppm
I20260709 13:09:09.134147 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:09.136758 21312 webserver.cc:533] Webserver started at http://127.20.208.62:33453/ using document root <none> and password file <none>
I20260709 13:09:09.137285 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:09.137470 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:09.137733 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:09.138957 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/master-0-root/instance:
uuid: "3eefbda506844b11b82db1277d67c8e7"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:09.143656 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:09.147302 28676 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.148064 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:09.148367 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/master-0-root
uuid: "3eefbda506844b11b82db1277d67c8e7"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:09.148694 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:09.165542 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:09.166710 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:09.206660 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.62:34427
I20260709 13:09:09.206766 28727 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.62:34427 every 8 connection(s)
I20260709 13:09:09.210846 28728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.222205 28728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7: Bootstrap starting.
I20260709 13:09:09.226857 28728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.231109 28728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7: No bootstrap required, opened a new log
I20260709 13:09:09.233325 28728 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefbda506844b11b82db1277d67c8e7" member_type: VOTER }
I20260709 13:09:09.233731 28728 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.233903 28728 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefbda506844b11b82db1277d67c8e7, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.234423 28728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefbda506844b11b82db1277d67c8e7" member_type: VOTER }
I20260709 13:09:09.234844 28728 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:09.235036 28728 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:09.235253 28728 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.239866 28728 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefbda506844b11b82db1277d67c8e7" member_type: VOTER }
I20260709 13:09:09.240420 28728 leader_election.cc:304] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3eefbda506844b11b82db1277d67c8e7; no voters: 
I20260709 13:09:09.241576 28728 leader_election.cc:290] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:09.242028 28731 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.243382 28731 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefbda506844b11b82db1277d67c8e7, State: Running, Role: LEADER
I20260709 13:09:09.244091 28731 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefbda506844b11b82db1277d67c8e7" member_type: VOTER }
I20260709 13:09:09.244441 28728 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:09.248888 28732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3eefbda506844b11b82db1277d67c8e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefbda506844b11b82db1277d67c8e7" member_type: VOTER } }
I20260709 13:09:09.249749 28732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:09.250553 28733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eefbda506844b11b82db1277d67c8e7. Latest consensus state: current_term: 1 leader_uuid: "3eefbda506844b11b82db1277d67c8e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefbda506844b11b82db1277d67c8e7" member_type: VOTER } }
I20260709 13:09:09.251304 28733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:09.252840 28739 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:09.260707 28739 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:09.261821 21312 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:09.270994 28739 catalog_manager.cc:1383] Generated new cluster ID: 20e34882b8fd4d50ac03e19a384c766a
I20260709 13:09:09.271275 28739 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:09.285537 28739 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:09.286823 28739 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:09.302502 28739 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7: Generated new TSK 0
I20260709 13:09:09.303125 28739 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:09.328838 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:09.335505 28749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.336771 28750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.339800 28752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.339879 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:09.342337 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:09.342659 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:09.342832 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602549342818 us; error 0 us; skew 500 ppm
I20260709 13:09:09.343446 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:09.346199 21312 webserver.cc:533] Webserver started at http://127.20.208.1:40589/ using document root <none> and password file <none>
I20260709 13:09:09.346710 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:09.346907 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:09.347163 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:09.348376 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/instance:
uuid: "7f68815192fc48a58a67ddf2da3bac70"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:09.353514 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:09:09.357204 28757 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.357993 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:09.358302 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-0-root
uuid: "7f68815192fc48a58a67ddf2da3bac70"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:09.358592 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:09.376204 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:09.377491 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:09.379200 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:09.381703 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:09.381924 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.382164 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:09.382331 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.424786 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.1:41969
I20260709 13:09:09.424906 28819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.1:41969 every 8 connection(s)
I20260709 13:09:09.430002 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:09.437747 28824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.439303 28825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.441064 28827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.442582 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:09.444574 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:09.444864 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:09.445055 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602549445034 us; error 0 us; skew 500 ppm
I20260709 13:09:09.445822 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:09.448814 28820 heartbeater.cc:344] Connected to a master server at 127.20.208.62:34427
I20260709 13:09:09.449002 21312 webserver.cc:533] Webserver started at http://127.20.208.2:35497/ using document root <none> and password file <none>
I20260709 13:09:09.449314 28820 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:09.449684 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:09.450019 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:09.450356 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:09.450297 28820 heartbeater.cc:507] Master 127.20.208.62:34427 requested a full tablet report, sending...
I20260709 13:09:09.451961 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/instance:
uuid: "89867186bb4546988c8fcd2b9fea8757"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:09.452929 28693 ts_manager.cc:194] Registered new tserver with Master: 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:09.454856 28693 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33760
I20260709 13:09:09.457085 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:09:09.461061 28832 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.462321 21312 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:09.462775 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-1-root
uuid: "89867186bb4546988c8fcd2b9fea8757"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:09.463116 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:09.482764 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:09.484215 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:09.486104 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:09.488984 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:09.489229 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.489450 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:09.489583 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.537232 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.2:41345
I20260709 13:09:09.537350 28894 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.2:41345 every 8 connection(s)
I20260709 13:09:09.541811 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:09.549010 28898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.551147 28899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.553120 28901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.553463 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:09.554567 28895 heartbeater.cc:344] Connected to a master server at 127.20.208.62:34427
I20260709 13:09:09.554584 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:09.555055 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:09.555131 28895 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:09.555316 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602549555296 us; error 0 us; skew 500 ppm
I20260709 13:09:09.556089 28895 heartbeater.cc:507] Master 127.20.208.62:34427 requested a full tablet report, sending...
I20260709 13:09:09.556161 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:09.558492 28693 ts_manager.cc:194] Registered new tserver with Master: 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:09.559168 21312 webserver.cc:533] Webserver started at http://127.20.208.3:42279/ using document root <none> and password file <none>
I20260709 13:09:09.559701 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:09.559854 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:09.560118 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:09.560050 28693 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33768
I20260709 13:09:09.561767 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/instance:
uuid: "7640ddad6f82422c8a0377a187b4e290"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:09.566915 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:09.570772 28906 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.571620 21312 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:09:09.571979 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-2-root
uuid: "7640ddad6f82422c8a0377a187b4e290"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:09.572273 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:09.584771 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:09.585999 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:09.587503 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:09.589921 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:09.590133 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.590373 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:09.590523 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.630476 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.3:40509
I20260709 13:09:09.630577 28968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.3:40509 every 8 connection(s)
I20260709 13:09:09.635635 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:09.643172 28973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.643150 28972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.648278 28969 heartbeater.cc:344] Connected to a master server at 127.20.208.62:34427
I20260709 13:09:09.648830 28969 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:09.649377 28975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.649647 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:09.649852 28969 heartbeater.cc:507] Master 127.20.208.62:34427 requested a full tablet report, sending...
I20260709 13:09:09.650946 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:09.651234 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:09.651458 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602549651437 us; error 0 us; skew 500 ppm
I20260709 13:09:09.652109 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:09.652361 28693 ts_manager.cc:194] Registered new tserver with Master: 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:09.654158 28693 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33780
I20260709 13:09:09.654910 21312 webserver.cc:533] Webserver started at http://127.20.208.4:35535/ using document root <none> and password file <none>
I20260709 13:09:09.655570 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:09.655757 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:09.656029 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:09.657191 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-3-root/instance:
uuid: "f3d3a97b01f64816a2a769d159dd64d2"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:09.661566 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:09.665103 28980 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.665897 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:09.666203 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-3-root
uuid: "f3d3a97b01f64816a2a769d159dd64d2"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:09.666477 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:09.687142 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:09.688412 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:09.689970 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:09.692302 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:09.692533 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:09:09.692788 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:09.692937 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.735064 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.4:46467
I20260709 13:09:09.735174 29042 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.4:46467 every 8 connection(s)
I20260709 13:09:09.749379 29043 heartbeater.cc:344] Connected to a master server at 127.20.208.62:34427
I20260709 13:09:09.749825 29043 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:09.750648 29043 heartbeater.cc:507] Master 127.20.208.62:34427 requested a full tablet report, sending...
I20260709 13:09:09.753376 28693 ts_manager.cc:194] Registered new tserver with Master: f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:09.754473 21312 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016316491s
I20260709 13:09:09.755081 28693 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33796
I20260709 13:09:09.785825 28693 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33810:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:09:10.024415 29008 tablet_service.cc:1511] Processing CreateTablet for tablet e6d945783c31437981498fa3ba0887ff (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:10.026119 29008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d945783c31437981498fa3ba0887ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.030272 29007 tablet_service.cc:1511] Processing CreateTablet for tablet b3841cb2f1364534b341ed93ebd0f73f (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:10.031982 29007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3841cb2f1364534b341ed93ebd0f73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.037483 29006 tablet_service.cc:1511] Processing CreateTablet for tablet 62a577314507499e84f3ce9f1f878ddd (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:10.039117 29006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a577314507499e84f3ce9f1f878ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.040284 29005 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb6c055b4c440bbb4cbecf2a32bf6e2 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:10.042145 29005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb6c055b4c440bbb4cbecf2a32bf6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.048085 28860 tablet_service.cc:1511] Processing CreateTablet for tablet ffdf6272d9e4462c8bd8e31403360a5b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:10.049772 28860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffdf6272d9e4462c8bd8e31403360a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.051265 28859 tablet_service.cc:1511] Processing CreateTablet for tablet b3841cb2f1364534b341ed93ebd0f73f (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:10.060070 28859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3841cb2f1364534b341ed93ebd0f73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.064138 29003 tablet_service.cc:1511] Processing CreateTablet for tablet 128ca54c3ca34865935113dc7a9f0d21 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:10.053298 28858 tablet_service.cc:1511] Processing CreateTablet for tablet 62a577314507499e84f3ce9f1f878ddd (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:10.065724 29003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128ca54c3ca34865935113dc7a9f0d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.066642 28858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a577314507499e84f3ce9f1f878ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.067333 28934 tablet_service.cc:1511] Processing CreateTablet for tablet e6d945783c31437981498fa3ba0887ff (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:10.054014 29004 tablet_service.cc:1511] Processing CreateTablet for tablet 63e0aebb326f4409a072848dd5227247 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:10.068850 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d945783c31437981498fa3ba0887ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.069422 29004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63e0aebb326f4409a072848dd5227247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.070911 28929 tablet_service.cc:1511] Processing CreateTablet for tablet 128ca54c3ca34865935113dc7a9f0d21 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:10.070731 28933 tablet_service.cc:1511] Processing CreateTablet for tablet ffdf6272d9e4462c8bd8e31403360a5b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:10.065747 28855 tablet_service.cc:1511] Processing CreateTablet for tablet 128ca54c3ca34865935113dc7a9f0d21 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:10.072587 28929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128ca54c3ca34865935113dc7a9f0d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.072781 28855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128ca54c3ca34865935113dc7a9f0d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.073179 28931 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd628bc39b04e3eb0cad27972841737 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:10.069483 28932 tablet_service.cc:1511] Processing CreateTablet for tablet 62a577314507499e84f3ce9f1f878ddd (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:10.056579 28856 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb6c055b4c440bbb4cbecf2a32bf6e2 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:10.055280 28857 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd628bc39b04e3eb0cad27972841737 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:10.068972 28930 tablet_service.cc:1511] Processing CreateTablet for tablet 63e0aebb326f4409a072848dd5227247 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:10.075282 28931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd628bc39b04e3eb0cad27972841737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.075289 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb6c055b4c440bbb4cbecf2a32bf6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.084878 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a577314507499e84f3ce9f1f878ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.086258 28933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffdf6272d9e4462c8bd8e31403360a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.087621 28930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63e0aebb326f4409a072848dd5227247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.089037 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd628bc39b04e3eb0cad27972841737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.101179 28854 tablet_service.cc:1511] Processing CreateTablet for tablet 505c7b69cc824534a36d0f305227ccfe (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:10.103515 28854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505c7b69cc824534a36d0f305227ccfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.105594 28928 tablet_service.cc:1511] Processing CreateTablet for tablet 505c7b69cc824534a36d0f305227ccfe (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:10.107777 28928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505c7b69cc824534a36d0f305227ccfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.113770 28784 tablet_service.cc:1511] Processing CreateTablet for tablet ffdf6272d9e4462c8bd8e31403360a5b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:10.114507 29002 tablet_service.cc:1511] Processing CreateTablet for tablet c18d000a8ebe429caa1c1c23e30e8c46 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:10.115563 28782 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd628bc39b04e3eb0cad27972841737 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:10.116072 29002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18d000a8ebe429caa1c1c23e30e8c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.116904 28783 tablet_service.cc:1511] Processing CreateTablet for tablet b3841cb2f1364534b341ed93ebd0f73f (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:10.118126 28781 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb6c055b4c440bbb4cbecf2a32bf6e2 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:10.118889 28785 tablet_service.cc:1511] Processing CreateTablet for tablet e6d945783c31437981498fa3ba0887ff (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:10.120440 28780 tablet_service.cc:1511] Processing CreateTablet for tablet 63e0aebb326f4409a072848dd5227247 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:10.122833 28779 tablet_service.cc:1511] Processing CreateTablet for tablet 505c7b69cc824534a36d0f305227ccfe (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:10.115455 28784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffdf6272d9e4462c8bd8e31403360a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.125370 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d945783c31437981498fa3ba0887ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.127206 28779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505c7b69cc824534a36d0f305227ccfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.127916 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3841cb2f1364534b341ed93ebd0f73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.128824 28781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb6c055b4c440bbb4cbecf2a32bf6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.129493 28782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd628bc39b04e3eb0cad27972841737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.131574 28780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63e0aebb326f4409a072848dd5227247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.132826 28778 tablet_service.cc:1511] Processing CreateTablet for tablet c18d000a8ebe429caa1c1c23e30e8c46 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:10.134569 28778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18d000a8ebe429caa1c1c23e30e8c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.141599 28853 tablet_service.cc:1511] Processing CreateTablet for tablet c18d000a8ebe429caa1c1c23e30e8c46 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:10.143349 28853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18d000a8ebe429caa1c1c23e30e8c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.155799 28927 tablet_service.cc:1511] Processing CreateTablet for tablet 8996feb2bbcd43b4b8cef11d3cea4e91 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:10.157425 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8996feb2bbcd43b4b8cef11d3cea4e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.193135 28777 tablet_service.cc:1511] Processing CreateTablet for tablet 8996feb2bbcd43b4b8cef11d3cea4e91 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:10.193670 29008 tablet_service.cc:1511] Processing CreateTablet for tablet 8996feb2bbcd43b4b8cef11d3cea4e91 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:10.194716 28777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8996feb2bbcd43b4b8cef11d3cea4e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.195021 29008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8996feb2bbcd43b4b8cef11d3cea4e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.204197 29063 tablet_bootstrap.cc:492] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:10.211237 29063 tablet_bootstrap.cc:654] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.216892 29007 tablet_service.cc:1511] Processing CreateTablet for tablet 845ec131ab0c46b49160d56a240504b7 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:10.218353 29007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845ec131ab0c46b49160d56a240504b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.219726 28931 tablet_service.cc:1511] Processing CreateTablet for tablet 845ec131ab0c46b49160d56a240504b7 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:10.221402 28931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845ec131ab0c46b49160d56a240504b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.218433 28852 tablet_service.cc:1511] Processing CreateTablet for tablet 845ec131ab0c46b49160d56a240504b7 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:10.238510 28852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845ec131ab0c46b49160d56a240504b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.261175 28776 tablet_service.cc:1511] Processing CreateTablet for tablet f3ae58f02e904d698a5cfb5b598b91be (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:10.262666 28776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ae58f02e904d698a5cfb5b598b91be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.279142 29006 tablet_service.cc:1511] Processing CreateTablet for tablet 92c712a67162406ba7f28ef7f9b396b9 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:10.280639 29006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c712a67162406ba7f28ef7f9b396b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.284821 28928 tablet_service.cc:1511] Processing CreateTablet for tablet f3ae58f02e904d698a5cfb5b598b91be (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:10.287132 28928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ae58f02e904d698a5cfb5b598b91be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.279022 28854 tablet_service.cc:1511] Processing CreateTablet for tablet f3ae58f02e904d698a5cfb5b598b91be (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:10.289294 28854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ae58f02e904d698a5cfb5b598b91be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.292810 28859 tablet_service.cc:1511] Processing CreateTablet for tablet 92c712a67162406ba7f28ef7f9b396b9 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:10.294229 28859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c712a67162406ba7f28ef7f9b396b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.294308 28933 tablet_service.cc:1511] Processing CreateTablet for tablet 14e2f6598cef41e581c126c2788da507 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:10.295993 28933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e2f6598cef41e581c126c2788da507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.314335 29003 tablet_service.cc:1511] Processing CreateTablet for tablet 14e2f6598cef41e581c126c2788da507 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:10.315925 29003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e2f6598cef41e581c126c2788da507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.338501 28856 tablet_service.cc:1511] Processing CreateTablet for tablet 1918784f405b46fe85f940384b1e4520 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:10.340060 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1918784f405b46fe85f940384b1e4520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.343215 28776 tablet_service.cc:1511] Processing CreateTablet for tablet 14e2f6598cef41e581c126c2788da507 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:10.343924 28934 tablet_service.cc:1511] Processing CreateTablet for tablet 1918784f405b46fe85f940384b1e4520 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:10.359794 29064 tablet_bootstrap.cc:492] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:10.361065 29066 tablet_bootstrap.cc:492] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:10.366206 28741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:10.376222 29066 tablet_bootstrap.cc:654] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.384670 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1918784f405b46fe85f940384b1e4520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.393265 28776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e2f6598cef41e581c126c2788da507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.393461 29065 tablet_bootstrap.cc:492] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:10.406220 29004 tablet_service.cc:1511] Processing CreateTablet for tablet 1918784f405b46fe85f940384b1e4520 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:10.407696 29004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1918784f405b46fe85f940384b1e4520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.408638 29063 tablet_bootstrap.cc:492] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:10.384091 28783 tablet_service.cc:1511] Processing CreateTablet for tablet 92c712a67162406ba7f28ef7f9b396b9 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:10.409235 29063 ts_tablet_manager.cc:1403] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.205s	user 0.024s	sys 0.027s
I20260709 13:09:10.409910 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c712a67162406ba7f28ef7f9b396b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.412618 29063 raft_consensus.cc:359] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:10.413491 29063 raft_consensus.cc:385] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.413800 29063 raft_consensus.cc:740] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.414592 29063 consensus_queue.cc:260] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:10.415612 28785 tablet_service.cc:1511] Processing CreateTablet for tablet 3792b36a88e84708afea67ae52341ad1 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:10.417115 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3792b36a88e84708afea67ae52341ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.412729 29064 tablet_bootstrap.cc:654] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.430408 29043 heartbeater.cc:499] Master 127.20.208.62:34427 was elected leader, sending a full tablet report...
I20260709 13:09:10.434088 29063 ts_tablet_manager.cc:1434] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.024s	user 0.012s	sys 0.006s
I20260709 13:09:10.433955 28928 tablet_service.cc:1511] Processing CreateTablet for tablet 3792b36a88e84708afea67ae52341ad1 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:10.435235 29063 tablet_bootstrap.cc:492] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:10.435389 28928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3792b36a88e84708afea67ae52341ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.442000 29003 tablet_service.cc:1511] Processing CreateTablet for tablet fbf928a86b924440b6bfc966df8860b8 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:10.443459 29003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf928a86b924440b6bfc966df8860b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.446336 28777 tablet_service.cc:1511] Processing CreateTablet for tablet fbf928a86b924440b6bfc966df8860b8 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:10.447801 28777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf928a86b924440b6bfc966df8860b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.453116 29066 tablet_bootstrap.cc:492] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:10.443446 29065 tablet_bootstrap.cc:654] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.455016 29006 tablet_service.cc:1511] Processing CreateTablet for tablet 45159667ba6f4b919ff80fa9d04e360e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:10.457062 29063 tablet_bootstrap.cc:654] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.457316 29006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45159667ba6f4b919ff80fa9d04e360e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.457881 28820 heartbeater.cc:499] Master 127.20.208.62:34427 was elected leader, sending a full tablet report...
I20260709 13:09:10.461570 28927 tablet_service.cc:1511] Processing CreateTablet for tablet 45159667ba6f4b919ff80fa9d04e360e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:10.463032 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45159667ba6f4b919ff80fa9d04e360e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.458032 28858 tablet_service.cc:1511] Processing CreateTablet for tablet fbf928a86b924440b6bfc966df8860b8 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:10.466406 29066 ts_tablet_manager.cc:1403] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.003s
I20260709 13:09:10.471453 28783 tablet_service.cc:1511] Processing CreateTablet for tablet 45159667ba6f4b919ff80fa9d04e360e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:10.472159 28854 tablet_service.cc:1511] Processing CreateTablet for tablet 397ea1e4725643da8ae65abeabbabcd7 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:10.473074 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45159667ba6f4b919ff80fa9d04e360e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.475678 29065 tablet_bootstrap.cc:492] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:10.477016 29065 ts_tablet_manager.cc:1403] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.006s
I20260709 13:09:10.474931 28934 tablet_service.cc:1511] Processing CreateTablet for tablet 397ea1e4725643da8ae65abeabbabcd7 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:10.481385 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397ea1e4725643da8ae65abeabbabcd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.483770 29063 tablet_bootstrap.cc:492] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:10.432293 28852 tablet_service.cc:1511] Processing CreateTablet for tablet 3792b36a88e84708afea67ae52341ad1 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:10.484572 29063 ts_tablet_manager.cc:1403] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.014s
I20260709 13:09:10.487460 29008 tablet_service.cc:1511] Processing CreateTablet for tablet 397ea1e4725643da8ae65abeabbabcd7 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:10.489009 29008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397ea1e4725643da8ae65abeabbabcd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.490135 28853 tablet_service.cc:1511] Processing CreateTablet for tablet b6c27c89959045278c3f55d885d5391f (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 13:09:10.491674 29044 tablet.cc:2406] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:10.488862 28785 tablet_service.cc:1511] Processing CreateTablet for tablet b6c27c89959045278c3f55d885d5391f (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:10.494165 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c27c89959045278c3f55d885d5391f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.500516 29065 raft_consensus.cc:359] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:10.501498 29066 raft_consensus.cc:359] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:10.512768 29066 raft_consensus.cc:385] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.513180 29066 raft_consensus.cc:740] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.504914 28858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf928a86b924440b6bfc966df8860b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.514572 28853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c27c89959045278c3f55d885d5391f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.520650 28854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397ea1e4725643da8ae65abeabbabcd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.520371 29068 raft_consensus.cc:493] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.521298 29068 raft_consensus.cc:515] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:10.512323 29065 raft_consensus.cc:385] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.524931 29066 consensus_queue.cc:260] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:10.529745 29068 leader_election.cc:290] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:10.537446 28852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3792b36a88e84708afea67ae52341ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.538971 29065 raft_consensus.cc:740] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.543421 29065 consensus_queue.cc:260] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:10.557489 29063 raft_consensus.cc:359] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.558450 29063 raft_consensus.cc:385] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.558983 29063 raft_consensus.cc:740] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.561885 28932 tablet_service.cc:1511] Processing CreateTablet for tablet b6c27c89959045278c3f55d885d5391f (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:10.563135 28895 heartbeater.cc:499] Master 127.20.208.62:34427 was elected leader, sending a full tablet report...
I20260709 13:09:10.563336 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c27c89959045278c3f55d885d5391f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.571426 28857 tablet_service.cc:1511] Processing CreateTablet for tablet a77eab9e557b46d8acc7483af6e6ad0d (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:10.558075 29066 ts_tablet_manager.cc:1434] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 13:09:10.572918 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77eab9e557b46d8acc7483af6e6ad0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.573513 29066 tablet_bootstrap.cc:492] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:10.574052 28785 tablet_service.cc:1511] Processing CreateTablet for tablet a77eab9e557b46d8acc7483af6e6ad0d (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:10.575452 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77eab9e557b46d8acc7483af6e6ad0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.579051 29074 raft_consensus.cc:493] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.579730 29074 raft_consensus.cc:515] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:10.587605 28783 tablet_service.cc:1511] Processing CreateTablet for tablet d40c62440e604ddfb2e59ee713fbbb34 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:10.589284 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40c62440e604ddfb2e59ee713fbbb34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.593757 29006 tablet_service.cc:1511] Processing CreateTablet for tablet d40c62440e604ddfb2e59ee713fbbb34 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:10.595398 29006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40c62440e604ddfb2e59ee713fbbb34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.610584 29063 consensus_queue.cc:260] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.618410 29003 tablet_service.cc:1511] Processing CreateTablet for tablet a77eab9e557b46d8acc7483af6e6ad0d (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:10.619702 29063 ts_tablet_manager.cc:1434] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.135s	user 0.012s	sys 0.000s
I20260709 13:09:10.620673 29074 leader_election.cc:290] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:10.621373 29063 tablet_bootstrap.cc:492] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:10.622313 29064 tablet_bootstrap.cc:492] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:10.622956 29064 ts_tablet_manager.cc:1403] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.268s	user 0.013s	sys 0.009s
I20260709 13:09:10.635152 29065 ts_tablet_manager.cc:1434] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.157s	user 0.008s	sys 0.005s
I20260709 13:09:10.619843 29003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77eab9e557b46d8acc7483af6e6ad0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.641973 28928 tablet_service.cc:1511] Processing CreateTablet for tablet d40c62440e604ddfb2e59ee713fbbb34 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:10.636312 29065 tablet_bootstrap.cc:492] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:10.654942 28928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40c62440e604ddfb2e59ee713fbbb34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.658394 28969 heartbeater.cc:499] Master 127.20.208.62:34427 was elected leader, sending a full tablet report...
I20260709 13:09:10.666659 29064 raft_consensus.cc:359] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.669004 28860 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6aa359b7334b7ab7b98c3a741e7402 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:10.670508 28860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6aa359b7334b7ab7b98c3a741e7402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.667465 29064 raft_consensus.cc:385] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.685571 29066 tablet_bootstrap.cc:654] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.695423 29068 raft_consensus.cc:493] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.712873 29068 raft_consensus.cc:515] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.715265 29068 leader_election.cc:290] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:10.719110 28777 tablet_service.cc:1511] Processing CreateTablet for tablet b029f39d79fe45a2914c451500924304 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:10.697739 28927 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6aa359b7334b7ab7b98c3a741e7402 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:10.700057 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:10.723628 29063 tablet_bootstrap.cc:654] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.702752 29065 tablet_bootstrap.cc:654] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.694885 29064 raft_consensus.cc:740] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.724781 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6aa359b7334b7ab7b98c3a741e7402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.725191 29008 tablet_service.cc:1511] Processing CreateTablet for tablet a0f5b8a34d8d42c7958b3e1a2423802c (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:10.725347 29064 consensus_queue.cc:260] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.721971 28777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b029f39d79fe45a2914c451500924304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.726966 29008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f5b8a34d8d42c7958b3e1a2423802c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.729244 28934 tablet_service.cc:1511] Processing CreateTablet for tablet b029f39d79fe45a2914c451500924304 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:10.729707 28783 tablet_service.cc:1511] Processing CreateTablet for tablet a0f5b8a34d8d42c7958b3e1a2423802c (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:10.729610 28852 tablet_service.cc:1511] Processing CreateTablet for tablet b029f39d79fe45a2914c451500924304 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:10.735458 28932 tablet_service.cc:1511] Processing CreateTablet for tablet e897b01fbc7d44a2b2a24b592d256a55 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:10.736088 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505c7b69cc824534a36d0f305227ccfe" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:10.737124 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:10.740271 29004 tablet_service.cc:1511] Processing CreateTablet for tablet e897b01fbc7d44a2b2a24b592d256a55 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:10.723091 29003 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6aa359b7334b7ab7b98c3a741e7402 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:10.738787 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:10.744933 28852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b029f39d79fe45a2914c451500924304. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:10.745255 28984 leader_election.cc:343] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.745980 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:10.746555 28984 leader_election.cc:343] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.745687 29066 tablet_bootstrap.cc:492] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:10.747825 29066 ts_tablet_manager.cc:1403] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.175s	user 0.008s	sys 0.006s
I20260709 13:09:10.743966 29004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e897b01fbc7d44a2b2a24b592d256a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.749241 29003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6aa359b7334b7ab7b98c3a741e7402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.750293 28854 tablet_service.cc:1511] Processing CreateTablet for tablet a0f5b8a34d8d42c7958b3e1a2423802c (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:10.751670 28854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f5b8a34d8d42c7958b3e1a2423802c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:10.752405 28981 leader_election.cc:343] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:10.748025 28758 leader_election.cc:343] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.754267 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b029f39d79fe45a2914c451500924304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.766412 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505c7b69cc824534a36d0f305227ccfe" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:10.756316 29066 raft_consensus.cc:359] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.765044 28981 leader_election.cc:304] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:10.768288 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f5b8a34d8d42c7958b3e1a2423802c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.768622 29068 raft_consensus.cc:2749] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:10.770876 28758 leader_election.cc:343] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.771459 28758 leader_election.cc:304] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:10.772428 29074 raft_consensus.cc:2749] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:10.777791 28981 leader_election.cc:343] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.768025 29066 raft_consensus.cc:385] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.780572 29066 raft_consensus.cc:740] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.783592 29066 consensus_queue.cc:260] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.780315 28981 leader_election.cc:304] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:10.789557 29068 raft_consensus.cc:2749] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.795363 28785 tablet_service.cc:1511] Processing CreateTablet for tablet e897b01fbc7d44a2b2a24b592d256a55 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:10.796864 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e897b01fbc7d44a2b2a24b592d256a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.798141 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e897b01fbc7d44a2b2a24b592d256a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.798492 28858 tablet_service.cc:1511] Processing CreateTablet for tablet 6714d660646441d58bea7a912cba0ec8 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:10.799777 28858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6714d660646441d58bea7a912cba0ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.800876 29082 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.801481 29082 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.802132 28928 tablet_service.cc:1511] Processing CreateTablet for tablet 6714d660646441d58bea7a912cba0ec8 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:10.822968 29064 ts_tablet_manager.cc:1434] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.200s	user 0.019s	sys 0.009s
I20260709 13:09:10.824231 29063 tablet_bootstrap.cc:492] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:10.804292 29082 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:10.828519 29063 ts_tablet_manager.cc:1403] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.207s	user 0.009s	sys 0.011s
I20260709 13:09:10.823230 28928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6714d660646441d58bea7a912cba0ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.838467 28776 tablet_service.cc:1511] Processing CreateTablet for tablet 2fbc309858774a56b5464235e918e3d5 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:10.824246 29064 tablet_bootstrap.cc:492] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:10.829061 29066 ts_tablet_manager.cc:1434] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.002s
I20260709 13:09:10.834748 29008 tablet_service.cc:1511] Processing CreateTablet for tablet 6714d660646441d58bea7a912cba0ec8 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:10.840436 28776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fbc309858774a56b5464235e918e3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.844887 28860 tablet_service.cc:1511] Processing CreateTablet for tablet 2fbc309858774a56b5464235e918e3d5 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:10.836249 29063 raft_consensus.cc:359] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.850390 28782 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5fb10557dd4995ab650a239d1cde17 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:10.850433 29066 tablet_bootstrap.cc:492] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:10.852388 28782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5fb10557dd4995ab650a239d1cde17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.856133 28860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fbc309858774a56b5464235e918e3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.857088 29008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6714d660646441d58bea7a912cba0ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.855103 29063 raft_consensus.cc:385] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.868831 29063 raft_consensus.cc:740] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.869838 29063 consensus_queue.cc:260] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.874284 29063 ts_tablet_manager.cc:1434] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:09:10.875211 29063 tablet_bootstrap.cc:492] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:10.878340 29004 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5fb10557dd4995ab650a239d1cde17 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:10.879786 29004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5fb10557dd4995ab650a239d1cde17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.868012 29066 tablet_bootstrap.cc:654] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.895725 28927 tablet_service.cc:1511] Processing CreateTablet for tablet 2fbc309858774a56b5464235e918e3d5 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:10.897253 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fbc309858774a56b5464235e918e3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.898404 29003 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd25378f6794f9ab52ee328577124e3 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:10.899767 29003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd25378f6794f9ab52ee328577124e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.902794 28930 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd25378f6794f9ab52ee328577124e3 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:10.904403 28930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd25378f6794f9ab52ee328577124e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.923421 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:10.924399 29018 raft_consensus.cc:2468] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:10.926828 28908 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:10.927829 29082 raft_consensus.cc:2804] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.928236 29082 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.928642 29082 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.939471 28777 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd25378f6794f9ab52ee328577124e3 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:10.940397 28860 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5fb10557dd4995ab650a239d1cde17 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:10.940977 28777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd25378f6794f9ab52ee328577124e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.941917 29063 tablet_bootstrap.cc:654] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.945837 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:10.936329 29082 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:10.951126 28858 tablet_service.cc:1511] Processing CreateTablet for tablet 2c3b31ed6f204a71a8ac57ddbc19e662 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:10.952807 28932 tablet_service.cc:1511] Processing CreateTablet for tablet 2c3b31ed6f204a71a8ac57ddbc19e662 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:10.953974 29006 tablet_service.cc:1511] Processing CreateTablet for tablet 2c3b31ed6f204a71a8ac57ddbc19e662 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:10.955062 28852 tablet_service.cc:1511] Processing CreateTablet for tablet ca66f80367c145af96bd99c7df4ccbd0 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:10.956553 29076 raft_consensus.cc:493] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.956463 28776 tablet_service.cc:1511] Processing CreateTablet for tablet ca66f80367c145af96bd99c7df4ccbd0 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:10.958904 28776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca66f80367c145af96bd99c7df4ccbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.960191 28934 tablet_service.cc:1511] Processing CreateTablet for tablet ca66f80367c145af96bd99c7df4ccbd0 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:10.961090 29064 tablet_bootstrap.cc:654] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.957199 29076 raft_consensus.cc:515] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:10.963944 29076 leader_election.cc:290] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:10.957599 29006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3b31ed6f204a71a8ac57ddbc19e662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.957510 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3b31ed6f204a71a8ac57ddbc19e662. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:10.956664 28910 leader_election.cc:343] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.980969 29007 tablet_service.cc:1511] Processing CreateTablet for tablet bde8f4a342f345cf90f76ba21b614c2b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:11.013525 29007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde8f4a342f345cf90f76ba21b614c2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:11.013358 28910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 63394.5us
I20260709 13:09:10.981731 29065 tablet_bootstrap.cc:492] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:11.015552 29065 ts_tablet_manager.cc:1403] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.379s	user 0.053s	sys 0.035s
I20260709 13:09:10.984606 29082 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:10.984112 28857 tablet_service.cc:1511] Processing CreateTablet for tablet bde8f4a342f345cf90f76ba21b614c2b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:10.986845 29066 tablet_bootstrap.cc:492] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:10.988015 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:11.019328 29066 ts_tablet_manager.cc:1403] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.169s	user 0.012s	sys 0.002s
I20260709 13:09:11.019768 29018 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.022198 29065 raft_consensus.cc:359] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.022624 29066 raft_consensus.cc:359] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.023154 29065 raft_consensus.cc:385] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.023416 29066 raft_consensus.cc:385] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.023566 29065 raft_consensus.cc:740] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.023873 29066 raft_consensus.cc:740] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.025111 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca66f80367c145af96bd99c7df4ccbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.984112 28783 tablet_service.cc:1511] Processing CreateTablet for tablet bde8f4a342f345cf90f76ba21b614c2b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:11.004187 28860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5fb10557dd4995ab650a239d1cde17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.025784 29066 consensus_queue.cc:260] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.032397 29002 tablet_service.cc:1511] Processing CreateTablet for tablet 6c946f5606ec4af895c04195b74db3e1 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:11.019407 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:11.041254 28852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca66f80367c145af96bd99c7df4ccbd0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:11.052554 28910 leader_election.cc:343] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.054684 28782 tablet_service.cc:1511] Processing CreateTablet for tablet 6c946f5606ec4af895c04195b74db3e1 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:11.056078 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde8f4a342f345cf90f76ba21b614c2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.056686 29002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c946f5606ec4af895c04195b74db3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.051128 29066 ts_tablet_manager.cc:1434] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:09:11.059655 28858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3b31ed6f204a71a8ac57ddbc19e662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.060313 28854 tablet_service.cc:1511] Processing CreateTablet for tablet 68bbc69d44e948e7b6f3a85ea80aec7e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:11.061650 28854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68bbc69d44e948e7b6f3a85ea80aec7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.055974 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde8f4a342f345cf90f76ba21b614c2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.066717 28782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c946f5606ec4af895c04195b74db3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.059583 29066 tablet_bootstrap.cc:492] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:11.074601 29066 tablet_bootstrap.cc:654] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.074887 29074 raft_consensus.cc:493] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.075466 29074 raft_consensus.cc:515] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.082194 29074 leader_election.cc:290] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:11.087060 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:11.088739 28758 leader_election.cc:343] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.095176 29004 tablet_service.cc:1511] Processing CreateTablet for tablet 68bbc69d44e948e7b6f3a85ea80aec7e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:11.096706 29004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68bbc69d44e948e7b6f3a85ea80aec7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.100391 28785 tablet_service.cc:1511] Processing CreateTablet for tablet 7caa5ccce9344e3993cdd74c21d6d2d7 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:11.101855 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7caa5ccce9344e3993cdd74c21d6d2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.104452 28856 tablet_service.cc:1511] Processing CreateTablet for tablet 7caa5ccce9344e3993cdd74c21d6d2d7 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:11.105921 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7caa5ccce9344e3993cdd74c21d6d2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.106144 28927 tablet_service.cc:1511] Processing CreateTablet for tablet 6c946f5606ec4af895c04195b74db3e1 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:11.107468 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c946f5606ec4af895c04195b74db3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.111115 28928 tablet_service.cc:1511] Processing CreateTablet for tablet 7caa5ccce9344e3993cdd74c21d6d2d7 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:11.112051 29003 tablet_service.cc:1511] Processing CreateTablet for tablet c413a0a088424cd884473468aa41ad3b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:11.112653 28928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7caa5ccce9344e3993cdd74c21d6d2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.113847 28932 tablet_service.cc:1511] Processing CreateTablet for tablet 68bbc69d44e948e7b6f3a85ea80aec7e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:11.111189 29018 raft_consensus.cc:2468] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:11.116808 29003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c413a0a088424cd884473468aa41ad3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.117564 28908 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:11.118480 29082 raft_consensus.cc:2804] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.118959 29082 raft_consensus.cc:697] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:11.126338 29082 consensus_queue.cc:237] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.126981 28779 tablet_service.cc:1511] Processing CreateTablet for tablet c413a0a088424cd884473468aa41ad3b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:11.128429 28779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c413a0a088424cd884473468aa41ad3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.128813 29064 tablet_bootstrap.cc:492] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:11.129392 29064 ts_tablet_manager.cc:1403] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.305s	user 0.050s	sys 0.026s
I20260709 13:09:11.126919 29063 tablet_bootstrap.cc:492] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:11.133062 29063 ts_tablet_manager.cc:1403] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.258s	user 0.017s	sys 0.022s
I20260709 13:09:11.136225 29063 raft_consensus.cc:359] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.137676 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdf6272d9e4462c8bd8e31403360a5b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:11.132766 29064 raft_consensus.cc:359] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.138641 29064 raft_consensus.cc:385] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.138981 29064 raft_consensus.cc:740] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.137698 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:11.140147 29018 raft_consensus.cc:2468] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
W20260709 13:09:11.140964 28833 leader_election.cc:343] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.144850 28759 leader_election.cc:304] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:11.146273 29074 raft_consensus.cc:2804] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.146679 29074 raft_consensus.cc:493] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.147011 29074 raft_consensus.cc:3060] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.155972 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68bbc69d44e948e7b6f3a85ea80aec7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.025779 29065 consensus_queue.cc:260] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.138341 29063 raft_consensus.cc:385] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.158457 29063 raft_consensus.cc:740] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.159487 29063 consensus_queue.cc:260] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.169540 28852 tablet_service.cc:1511] Processing CreateTablet for tablet c413a0a088424cd884473468aa41ad3b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:11.170269 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdf6272d9e4462c8bd8e31403360a5b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:11.170045 29066 tablet_bootstrap.cc:492] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:11.174443 29063 ts_tablet_manager.cc:1434] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:09:11.155390 29074 raft_consensus.cc:515] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.188534 29066 ts_tablet_manager.cc:1403] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.030s
I20260709 13:09:11.188318 29002 tablet_service.cc:1511] Processing CreateTablet for tablet 88d9475e96d74d868e148f76bccfb047 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:11.192101 29066 raft_consensus.cc:359] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
W20260709 13:09:11.193895 28836 leader_election.cc:343] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.194038 29066 raft_consensus.cc:385] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.194494 28930 tablet_service.cc:1511] Processing CreateTablet for tablet 88d9475e96d74d868e148f76bccfb047 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:11.195995 28930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d9475e96d74d868e148f76bccfb047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.194510 28836 leader_election.cc:304] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:11.197937 29076 raft_consensus.cc:2749] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.194559 29066 raft_consensus.cc:740] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.199404 29063 tablet_bootstrap.cc:492] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:11.199965 29066 consensus_queue.cc:260] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.180328 29064 consensus_queue.cc:260] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.204586 29064 ts_tablet_manager.cc:1434] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:09:11.207438 29065 ts_tablet_manager.cc:1434] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.191s	user 0.008s	sys 0.000s
I20260709 13:09:11.207875 29074 leader_election.cc:290] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:11.217449 29064 tablet_bootstrap.cc:492] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:11.231912 28857 tablet_service.cc:1511] Processing CreateTablet for tablet 41fcfba163a74ac1b6aa94f2022c252e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:11.233007 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:11.233695 29018 raft_consensus.cc:3060] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.233784 28785 tablet_service.cc:1511] Processing CreateTablet for tablet 88d9475e96d74d868e148f76bccfb047 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:11.235222 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d9475e96d74d868e148f76bccfb047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.237619 29002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d9475e96d74d868e148f76bccfb047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.238147 28693 catalog_manager.cc:5697] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.243019 29065 tablet_bootstrap.cc:492] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:11.243281 29063 tablet_bootstrap.cc:654] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.232252 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
W20260709 13:09:11.246956 28758 leader_election.cc:343] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.256631 29018 raft_consensus.cc:2468] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:11.258854 28759 leader_election.cc:304] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:11.260322 29074 raft_consensus.cc:2804] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.260901 29074 raft_consensus.cc:697] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:11.261843 29074 consensus_queue.cc:237] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.257279 28852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c413a0a088424cd884473468aa41ad3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.282660 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fcfba163a74ac1b6aa94f2022c252e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.298691 29064 tablet_bootstrap.cc:654] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.302660 28934 tablet_service.cc:1511] Processing CreateTablet for tablet 41fcfba163a74ac1b6aa94f2022c252e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:11.303592 29006 tablet_service.cc:1511] Processing CreateTablet for tablet 41fcfba163a74ac1b6aa94f2022c252e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:11.305577 29006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fcfba163a74ac1b6aa94f2022c252e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.304211 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fcfba163a74ac1b6aa94f2022c252e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.307442 28691 catalog_manager.cc:5697] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.309504 29066 ts_tablet_manager.cc:1434] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.120s	user 0.018s	sys 0.019s
I20260709 13:09:11.317821 29066 tablet_bootstrap.cc:492] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:11.320757 29065 tablet_bootstrap.cc:654] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.321796 29063 tablet_bootstrap.cc:492] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:11.324311 29063 ts_tablet_manager.cc:1403] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.000s
I20260709 13:09:11.325665 28779 tablet_service.cc:1511] Processing CreateTablet for tablet 9427717c9f3e4422b4864beddbf36d0c (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:11.327178 28779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9427717c9f3e4422b4864beddbf36d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.327659 29063 raft_consensus.cc:359] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.329471 29074 raft_consensus.cc:493] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.330157 29074 raft_consensus.cc:515] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.332533 29063 raft_consensus.cc:385] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.333473 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e0aebb326f4409a072848dd5227247" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:11.335078 28758 leader_election.cc:343] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.332281 29066 tablet_bootstrap.cc:654] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.336462 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e0aebb326f4409a072848dd5227247" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
W20260709 13:09:11.338085 28759 leader_election.cc:343] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.335397 29074 leader_election.cc:290] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:11.332964 29063 raft_consensus.cc:740] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.338559 28759 leader_election.cc:304] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:11.340634 29096 raft_consensus.cc:2749] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.339457 28858 tablet_service.cc:1511] Processing CreateTablet for tablet 9427717c9f3e4422b4864beddbf36d0c (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:11.340651 29063 consensus_queue.cc:260] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.342700 28858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9427717c9f3e4422b4864beddbf36d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.344161 29063 ts_tablet_manager.cc:1434] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:11.367844 28927 tablet_service.cc:1511] Processing CreateTablet for tablet 9427717c9f3e4422b4864beddbf36d0c (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:09:11.369751 28741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:11.370159 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9427717c9f3e4422b4864beddbf36d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.370904 29004 tablet_service.cc:1511] Processing CreateTablet for tablet 0358f1bde5044224a2fb9711b1f990b6 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:11.372432 29004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0358f1bde5044224a2fb9711b1f990b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.376765 29064 tablet_bootstrap.cc:492] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:11.377333 29064 ts_tablet_manager.cc:1403] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.172s	user 0.020s	sys 0.014s
I20260709 13:09:11.374456 28785 tablet_service.cc:1511] Processing CreateTablet for tablet 0358f1bde5044224a2fb9711b1f990b6 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:11.381461 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0358f1bde5044224a2fb9711b1f990b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.382743 28856 tablet_service.cc:1511] Processing CreateTablet for tablet 0358f1bde5044224a2fb9711b1f990b6 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:11.384457 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0358f1bde5044224a2fb9711b1f990b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.384716 29064 raft_consensus.cc:359] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.385511 29064 raft_consensus.cc:385] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.386821 29064 raft_consensus.cc:740] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.387547 29064 consensus_queue.cc:260] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.388932 28932 tablet_service.cc:1511] Processing CreateTablet for tablet d918ac438d8147cb8488b64ab616301e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:11.389856 29064 ts_tablet_manager.cc:1434] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:09:11.390455 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d918ac438d8147cb8488b64ab616301e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.391000 29064 tablet_bootstrap.cc:492] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:11.365477 29063 tablet_bootstrap.cc:492] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:11.407037 29064 tablet_bootstrap.cc:654] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.422631 29002 tablet_service.cc:1511] Processing CreateTablet for tablet d918ac438d8147cb8488b64ab616301e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:11.423841 29002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d918ac438d8147cb8488b64ab616301e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.426882 29066 tablet_bootstrap.cc:492] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:11.427521 29066 ts_tablet_manager.cc:1403] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.022s
I20260709 13:09:11.429080 28785 tablet_service.cc:1511] Processing CreateTablet for tablet d918ac438d8147cb8488b64ab616301e (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:11.431391 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d918ac438d8147cb8488b64ab616301e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.431475 28857 tablet_service.cc:1511] Processing CreateTablet for tablet b0d50209455e43a6b08ae3f9f45fc6fe (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:11.431028 29066 raft_consensus.cc:359] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.435213 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d50209455e43a6b08ae3f9f45fc6fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.435642 28927 tablet_service.cc:1511] Processing CreateTablet for tablet b0d50209455e43a6b08ae3f9f45fc6fe (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:11.437065 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d50209455e43a6b08ae3f9f45fc6fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.437788 29007 tablet_service.cc:1511] Processing CreateTablet for tablet b0d50209455e43a6b08ae3f9f45fc6fe (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:11.439211 29007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d50209455e43a6b08ae3f9f45fc6fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.440634 29066 raft_consensus.cc:385] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.443169 29066 raft_consensus.cc:740] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.444677 29066 consensus_queue.cc:260] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.440496 29063 tablet_bootstrap.cc:654] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.448239 29066 ts_tablet_manager.cc:1434] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.006s
I20260709 13:09:11.465582 29066 tablet_bootstrap.cc:492] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:11.448596 29065 tablet_bootstrap.cc:492] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:11.452163 29068 raft_consensus.cc:493] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.468904 29065 ts_tablet_manager.cc:1403] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.226s	user 0.020s	sys 0.014s
I20260709 13:09:11.468839 29068 raft_consensus.cc:515] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.471382 29068 leader_election.cc:290] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:11.475440 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a577314507499e84f3ce9f1f878ddd" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:11.476442 29074 raft_consensus.cc:493] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.477023 29074 raft_consensus.cc:515] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.479367 29074 leader_election.cc:290] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:11.472232 29065 raft_consensus.cc:359] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.490222 29066 tablet_bootstrap.cc:654] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.491022 29076 raft_consensus.cc:493] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.491134 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ae58f02e904d698a5cfb5b598b91be" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:11.491340 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ae58f02e904d698a5cfb5b598b91be" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:11.493582 29076 raft_consensus.cc:515] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.494313 28779 tablet_service.cc:1511] Processing CreateTablet for tablet c9df6dbe75ce424697576f62262f2c02 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:11.495802 28779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9df6dbe75ce424697576f62262f2c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.496508 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505c7b69cc824534a36d0f305227ccfe" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:11.497180 28794 raft_consensus.cc:2468] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:11.497531 28852 tablet_service.cc:1511] Processing CreateTablet for tablet c9df6dbe75ce424697576f62262f2c02 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:11.498467 28836 leader_election.cc:304] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:11.498974 28852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9df6dbe75ce424697576f62262f2c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.495711 29076 leader_election.cc:290] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:11.486209 29065 raft_consensus.cc:385] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:11.504266 28758 leader_election.cc:343] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.505164 29064 tablet_bootstrap.cc:492] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:11.507165 28934 tablet_service.cc:1511] Processing CreateTablet for tablet c9df6dbe75ce424697576f62262f2c02 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:11.521291 29064 ts_tablet_manager.cc:1403] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.016s
I20260709 13:09:11.521822 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9df6dbe75ce424697576f62262f2c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.524935 29076 raft_consensus.cc:2804] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.525385 29076 raft_consensus.cc:493] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.525720 29076 raft_consensus.cc:3060] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.529115 28785 tablet_service.cc:1511] Processing CreateTablet for tablet f4dc4bce7caf4a349b3ce695b2658707 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:11.529541 28857 tablet_service.cc:1511] Processing CreateTablet for tablet f4dc4bce7caf4a349b3ce695b2658707 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:11.530632 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dc4bce7caf4a349b3ce695b2658707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.530879 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dc4bce7caf4a349b3ce695b2658707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.507881 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505c7b69cc824534a36d0f305227ccfe" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:11.509577 29006 tablet_service.cc:1511] Processing CreateTablet for tablet f4dc4bce7caf4a349b3ce695b2658707 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:11.533594 29064 raft_consensus.cc:359] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:11.520505 28758 leader_election.cc:343] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.534451 28758 leader_election.cc:304] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:11.534025 29006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dc4bce7caf4a349b3ce695b2658707. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:11.534929 28833 leader_election.cc:343] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.515736 29065 raft_consensus.cc:740] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.536979 29074 raft_consensus.cc:2749] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.541630 29065 consensus_queue.cc:260] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.551640 28932 tablet_service.cc:1511] Processing CreateTablet for tablet 9547f10aff2e45b8b40cd1b4bddf42d5 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:11.545365 29064 raft_consensus.cc:385] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:11.554375 28836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 56015.7us
I20260709 13:09:11.555399 29068 raft_consensus.cc:493] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.562203 29068 raft_consensus.cc:515] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.564132 29068 leader_election.cc:290] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:11.556231 29065 ts_tablet_manager.cc:1434] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.001s
I20260709 13:09:11.565057 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:11.565593 29065 tablet_bootstrap.cc:492] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
W20260709 13:09:11.566792 28984 leader_election.cc:343] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.565048 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9547f10aff2e45b8b40cd1b4bddf42d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.570220 29076 raft_consensus.cc:515] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.575434 29065 tablet_bootstrap.cc:654] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.557127 28783 tablet_service.cc:1511] Processing CreateTablet for tablet 9547f10aff2e45b8b40cd1b4bddf42d5 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:11.577348 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9547f10aff2e45b8b40cd1b4bddf42d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.577347 29082 raft_consensus.cc:493] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.579851 29082 raft_consensus.cc:515] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:11.559383 28981 leader_election.cc:343] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.560021 29002 tablet_service.cc:1511] Processing CreateTablet for tablet 9547f10aff2e45b8b40cd1b4bddf42d5 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:11.561015 28856 tablet_service.cc:1511] Processing CreateTablet for tablet 2e0029999088407b9d71307a13c1599b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:11.576328 29063 tablet_bootstrap.cc:492] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:11.587872 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:11.588202 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:11.587946 29063 ts_tablet_manager.cc:1403] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.228s	user 0.013s	sys 0.000s
W20260709 13:09:11.589740 28910 leader_election.cc:343] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.588910 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0029999088407b9d71307a13c1599b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:11.590849 28981 leader_election.cc:343] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.591414 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a577314507499e84f3ce9f1f878ddd" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:11.592288 29063 raft_consensus.cc:359] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.593063 29063 raft_consensus.cc:385] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.593375 29063 raft_consensus.cc:740] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.594209 29063 consensus_queue.cc:260] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.595604 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505c7b69cc824534a36d0f305227ccfe" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:11.596253 28794 raft_consensus.cc:3060] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.596431 29063 ts_tablet_manager.cc:1434] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:11.583565 29082 leader_election.cc:290] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:11.598589 29076 leader_election.cc:290] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:11.555034 29064 raft_consensus.cc:740] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.604676 29007 tablet_service.cc:1511] Processing CreateTablet for tablet 2e0029999088407b9d71307a13c1599b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:11.591359 28981 leader_election.cc:304] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:11.614212 29068 raft_consensus.cc:2749] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.616008 29082 raft_consensus.cc:493] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.610945 29066 tablet_bootstrap.cc:492] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:11.611469 28785 tablet_service.cc:1511] Processing CreateTablet for tablet 8125abb8d87d437cb630354900d6e5b4 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:11.612210 29002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9547f10aff2e45b8b40cd1b4bddf42d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.608969 28794 raft_consensus.cc:2468] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:11.618027 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8125abb8d87d437cb630354900d6e5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.618439 29066 ts_tablet_manager.cc:1403] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.153s	user 0.024s	sys 0.038s
I20260709 13:09:11.617049 29082 raft_consensus.cc:515] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.624400 29066 raft_consensus.cc:359] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.625325 29066 raft_consensus.cc:385] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.626096 29066 raft_consensus.cc:740] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.626241 29082 leader_election.cc:290] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:11.626561 29064 consensus_queue.cc:260] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.627987 29066 consensus_queue.cc:260] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.632653 29066 ts_tablet_manager.cc:1434] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
W20260709 13:09:11.635818 28981 leader_election.cc:343] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.636935 28836 leader_election.cc:304] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:11.641716 29111 raft_consensus.cc:2804] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.642355 29111 raft_consensus.cc:697] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:11.643172 29111 consensus_queue.cc:237] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.641659 29066 tablet_bootstrap.cc:492] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:11.649803 29063 tablet_bootstrap.cc:492] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:11.653026 28981 leader_election.cc:304] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:11.653898 29068 raft_consensus.cc:2749] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.653673 28856 tablet_service.cc:1511] Processing CreateTablet for tablet 8125abb8d87d437cb630354900d6e5b4 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:11.655802 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:11.655966 28932 tablet_service.cc:1511] Processing CreateTablet for tablet 8125abb8d87d437cb630354900d6e5b4 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:11.656559 29018 raft_consensus.cc:2468] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:11.655296 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8125abb8d87d437cb630354900d6e5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.625285 28927 tablet_service.cc:1511] Processing CreateTablet for tablet 2e0029999088407b9d71307a13c1599b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:11.640916 29007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0029999088407b9d71307a13c1599b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.629105 29064 ts_tablet_manager.cc:1434] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.002s
I20260709 13:09:11.658901 28908 leader_election.cc:304] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:11.660030 29064 tablet_bootstrap.cc:492] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:11.660789 29082 raft_consensus.cc:2804] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.661218 29082 raft_consensus.cc:493] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.661537 29082 raft_consensus.cc:3060] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.663493 29066 tablet_bootstrap.cc:654] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.657354 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8125abb8d87d437cb630354900d6e5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.665059 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0029999088407b9d71307a13c1599b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.679843 28693 catalog_manager.cc:5697] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.686822 29084 consensus_queue.cc:1048] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.690188 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:11.690634 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505c7b69cc824534a36d0f305227ccfe" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:11.691282 28944 raft_consensus.cc:3060] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.695899 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:11.697990 28907 leader_election.cc:343] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.698588 28907 leader_election.cc:304] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
W20260709 13:09:11.699985 28907 leader_election.cc:343] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.700711 29084 raft_consensus.cc:2749] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.704173 28944 raft_consensus.cc:2468] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:11.712381 29007 tablet_service.cc:1511] Processing CreateTablet for tablet 72bfbcadacb1480fbedbd436808ea85b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:11.714180 29007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72bfbcadacb1480fbedbd436808ea85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.718811 29065 tablet_bootstrap.cc:492] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:11.719537 29065 ts_tablet_manager.cc:1403] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.154s	user 0.002s	sys 0.009s
I20260709 13:09:11.723265 29065 raft_consensus.cc:359] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.724152 29065 raft_consensus.cc:385] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.724460 29065 raft_consensus.cc:740] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.725287 29065 consensus_queue.cc:260] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.731624 29065 ts_tablet_manager.cc:1434] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:09:11.734597 28794 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.737840 29064 tablet_bootstrap.cc:654] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.743182 29084 consensus_queue.cc:1048] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.744191 29063 tablet_bootstrap.cc:654] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.748142 28783 tablet_service.cc:1511] Processing CreateTablet for tablet 72bfbcadacb1480fbedbd436808ea85b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:11.761168 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72bfbcadacb1480fbedbd436808ea85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.761873 28856 tablet_service.cc:1511] Processing CreateTablet for tablet 72bfbcadacb1480fbedbd436808ea85b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:11.763217 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72bfbcadacb1480fbedbd436808ea85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.775601 29074 consensus_queue.cc:1048] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.758237 29082 raft_consensus.cc:515] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.785585 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:11.786046 28932 tablet_service.cc:1511] Processing CreateTablet for tablet e014e29eece34924b34eaf88458e5ab4 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:11.786316 28870 raft_consensus.cc:3060] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.787948 29066 tablet_bootstrap.cc:492] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:11.788740 29066 ts_tablet_manager.cc:1403] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.147s	user 0.049s	sys 0.035s
I20260709 13:09:11.792655 29066 raft_consensus.cc:359] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.793478 29066 raft_consensus.cc:385] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.759510 29065 tablet_bootstrap.cc:492] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:11.793838 29066 raft_consensus.cc:740] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.795142 29066 consensus_queue.cc:260] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.799319 29066 ts_tablet_manager.cc:1434] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:11.800413 29066 tablet_bootstrap.cc:492] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:11.807083 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e014e29eece34924b34eaf88458e5ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.807569 29111 raft_consensus.cc:493] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.808094 29111 raft_consensus.cc:515] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.810678 29063 tablet_bootstrap.cc:492] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:11.811259 29063 ts_tablet_manager.cc:1403] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.009s
I20260709 13:09:11.811437 29111 leader_election.cc:290] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:11.817500 29096 raft_consensus.cc:493] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.818248 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:11.818130 29096 raft_consensus.cc:515] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.817420 28869 raft_consensus.cc:3060] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.821820 29064 tablet_bootstrap.cc:492] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:11.822395 29064 ts_tablet_manager.cc:1403] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.163s	user 0.009s	sys 0.010s
I20260709 13:09:11.822904 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:11.823598 29017 raft_consensus.cc:2468] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:11.820458 29096 leader_election.cc:290] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:11.824836 28759 leader_election.cc:304] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:11.825766 29096 raft_consensus.cc:2804] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.825672 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:11.826360 29096 raft_consensus.cc:493] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.826784 29096 raft_consensus.cc:3060] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:11.827595 28758 leader_election.cc:343] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.833319 28870 raft_consensus.cc:2468] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:11.834733 29074 consensus_queue.cc:1048] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.836690 29066 tablet_bootstrap.cc:654] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.840386 28907 leader_election.cc:304] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:11.840306 29096 raft_consensus.cc:515] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.841588 29119 raft_consensus.cc:2804] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.842152 29119 raft_consensus.cc:697] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:11.843004 29119 consensus_queue.cc:237] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.844091 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:11.844290 29096 leader_election.cc:290] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:11.844180 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:11.844944 29017 raft_consensus.cc:3060] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.825500 29064 raft_consensus.cc:359] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.846187 29064 raft_consensus.cc:385] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.846139 28834 leader_election.cc:304] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:11.846779 29064 raft_consensus.cc:740] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.840152 29063 raft_consensus.cc:359] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.848040 29063 raft_consensus.cc:385] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.848349 29063 raft_consensus.cc:740] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.849893 29064 consensus_queue.cc:260] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.851954 29017 raft_consensus.cc:2468] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:11.853255 28759 leader_election.cc:304] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:11.854072 29096 raft_consensus.cc:2804] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.854367 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:11.854954 29096 raft_consensus.cc:697] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:11.854836 28693 catalog_manager.cc:5697] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:11.856034 28758 leader_election.cc:343] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.855924 29096 consensus_queue.cc:237] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.861315 29063 consensus_queue.cc:260] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.865151 29064 ts_tablet_manager.cc:1434] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:09:11.866241 29063 ts_tablet_manager.cc:1434] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 13:09:11.868777 29063 tablet_bootstrap.cc:492] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:11.867679 29064 tablet_bootstrap.cc:492] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:11.878309 29064 tablet_bootstrap.cc:654] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.882385 29066 tablet_bootstrap.cc:492] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:11.883275 29066 ts_tablet_manager.cc:1403] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.083s	user 0.017s	sys 0.009s
I20260709 13:09:11.885099 29082 leader_election.cc:290] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:11.886433 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:11.886492 29066 raft_consensus.cc:359] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.887283 29017 raft_consensus.cc:3060] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.885103 29063 tablet_bootstrap.cc:654] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.857446 29007 tablet_service.cc:1511] Processing CreateTablet for tablet e014e29eece34924b34eaf88458e5ab4 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:11.890538 29007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e014e29eece34924b34eaf88458e5ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.887588 29066 raft_consensus.cc:385] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.891404 29066 raft_consensus.cc:740] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.892369 29066 consensus_queue.cc:260] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:11.894937 29066 ts_tablet_manager.cc:1434] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:11.895136 29017 raft_consensus.cc:2468] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:11.897688 29066 tablet_bootstrap.cc:492] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:11.897980 28783 tablet_service.cc:1511] Processing CreateTablet for tablet e014e29eece34924b34eaf88458e5ab4 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:11.901510 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e014e29eece34924b34eaf88458e5ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.895344 29065 tablet_bootstrap.cc:654] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.904955 29063 tablet_bootstrap.cc:492] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:11.905619 29063 ts_tablet_manager.cc:1403] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:09:11.906132 28932 tablet_service.cc:1511] Processing CreateTablet for tablet da7fd30052d142679c225954b5b5724b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:11.907421 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7fd30052d142679c225954b5b5724b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.899132 28857 tablet_service.cc:1511] Processing CreateTablet for tablet da7fd30052d142679c225954b5b5724b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:11.909516 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7fd30052d142679c225954b5b5724b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.916764 29002 tablet_service.cc:1511] Processing CreateTablet for tablet da7fd30052d142679c225954b5b5724b (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:11.918242 29002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7fd30052d142679c225954b5b5724b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.917906 29063 raft_consensus.cc:359] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.918637 29063 raft_consensus.cc:385] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.918928 29063 raft_consensus.cc:740] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.919606 29063 consensus_queue.cc:260] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.923537 29066 tablet_bootstrap.cc:654] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.928033 29063 ts_tablet_manager.cc:1434] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.004s
I20260709 13:09:11.927953 28785 tablet_service.cc:1511] Processing CreateTablet for tablet da3ea20eff10460186a8e96381d02883 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:11.929471 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3ea20eff10460186a8e96381d02883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.929659 29063 tablet_bootstrap.cc:492] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:11.932848 28852 tablet_service.cc:1511] Processing CreateTablet for tablet da3ea20eff10460186a8e96381d02883 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:11.933861 29065 tablet_bootstrap.cc:492] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:11.934340 28852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3ea20eff10460186a8e96381d02883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.934458 29065 ts_tablet_manager.cc:1403] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.175s	user 0.006s	sys 0.006s
I20260709 13:09:11.935475 29063 tablet_bootstrap.cc:654] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.942153 29065 raft_consensus.cc:359] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.949220 29068 raft_consensus.cc:493] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.953133 29068 raft_consensus.cc:515] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:11.955308 29068 leader_election.cc:290] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:11.957280 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:11.957948 28927 tablet_service.cc:1511] Processing CreateTablet for tablet da3ea20eff10460186a8e96381d02883 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:11.959303 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3ea20eff10460186a8e96381d02883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.959455 29064 tablet_bootstrap.cc:492] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:11.960034 29064 ts_tablet_manager.cc:1403] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.024s
I20260709 13:09:11.963260 29064 raft_consensus.cc:359] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:11.963471 29004 tablet_service.cc:1511] Processing CreateTablet for tablet 060ea2b150b444aab3e1430624fe2a3d (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:11.964011 29064 raft_consensus.cc:385] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:11.965081 28984 leader_election.cc:343] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.958050 29006 tablet_service.cc:1511] Processing CreateTablet for tablet f34810d0af154f329fec45e857a80d99 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:11.966109 28779 tablet_service.cc:1511] Processing CreateTablet for tablet f34810d0af154f329fec45e857a80d99 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:11.967283 29006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34810d0af154f329fec45e857a80d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.969460 28856 tablet_service.cc:1511] Processing CreateTablet for tablet f34810d0af154f329fec45e857a80d99 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:11.970112 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:11.970830 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34810d0af154f329fec45e857a80d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.967284 28779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34810d0af154f329fec45e857a80d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.943012 29065 raft_consensus.cc:385] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:11.977507 28981 leader_election.cc:343] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.978145 28981 leader_election.cc:304] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:11.978900 29068 raft_consensus.cc:2749] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.972720 28934 tablet_service.cc:1511] Processing CreateTablet for tablet 060ea2b150b444aab3e1430624fe2a3d (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:11.981453 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ea2b150b444aab3e1430624fe2a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.982378 28782 tablet_service.cc:1511] Processing CreateTablet for tablet 060ea2b150b444aab3e1430624fe2a3d (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:11.983752 28782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ea2b150b444aab3e1430624fe2a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.983918 29063 tablet_bootstrap.cc:492] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:11.984447 29063 ts_tablet_manager.cc:1403] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.006s
I20260709 13:09:11.985036 29004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ea2b150b444aab3e1430624fe2a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.975469 29065 raft_consensus.cc:740] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.964344 29064 raft_consensus.cc:740] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.991393 29063 raft_consensus.cc:359] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.001542 29063 raft_consensus.cc:385] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.002610 29063 raft_consensus.cc:740] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.003443 29063 consensus_queue.cc:260] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:11.997140 29064 consensus_queue.cc:260] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.006678 29064 ts_tablet_manager.cc:1434] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:09:12.007843 29065 consensus_queue.cc:260] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.008921 29096 raft_consensus.cc:493] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.009501 29096 raft_consensus.cc:515] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.010339 29065 ts_tablet_manager.cc:1434] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:09:12.011475 29065 tablet_bootstrap.cc:492] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:12.011775 29096 leader_election.cc:290] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:12.013587 29064 tablet_bootstrap.cc:492] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:12.015030 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:12.019474 28758 leader_election.cc:343] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.008159 28691 catalog_manager.cc:5697] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.024895 29063 ts_tablet_manager.cc:1434] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.003s
I20260709 13:09:12.033469 29063 tablet_bootstrap.cc:492] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:12.027709 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:12.034672 29017 raft_consensus.cc:2468] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:12.036816 29082 raft_consensus.cc:493] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.037401 29082 raft_consensus.cc:515] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.036257 28759 leader_election.cc:304] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:12.045001 29082 leader_election.cc:290] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:12.046944 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdf6272d9e4462c8bd8e31403360a5b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:12.047724 28794 raft_consensus.cc:2468] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:12.049919 28910 leader_election.cc:304] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:12.050127 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdf6272d9e4462c8bd8e31403360a5b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:12.050940 29096 raft_consensus.cc:2804] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.051396 29096 raft_consensus.cc:493] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.051748 29096 raft_consensus.cc:3060] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.050976 28870 raft_consensus.cc:2468] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:12.060534 29082 raft_consensus.cc:2804] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.061534 29082 raft_consensus.cc:493] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.062011 29082 raft_consensus.cc:3060] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.069520 28856 tablet_service.cc:1511] Processing CreateTablet for tablet 37be0dd46a214f7d9eef969ee4d69966 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:12.071632 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37be0dd46a214f7d9eef969ee4d69966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.082283 28934 tablet_service.cc:1511] Processing CreateTablet for tablet 37be0dd46a214f7d9eef969ee4d69966 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:12.082644 29111 consensus_queue.cc:1048] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.085745 29068 raft_consensus.cc:493] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.086620 29068 raft_consensus.cc:515] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.086143 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37be0dd46a214f7d9eef969ee4d69966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.076568 29063 tablet_bootstrap.cc:654] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.095374 29007 tablet_service.cc:1511] Processing CreateTablet for tablet 37be0dd46a214f7d9eef969ee4d69966 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:12.095974 29096 raft_consensus.cc:515] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.097157 29068 leader_election.cc:290] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:12.098780 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:12.099473 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:12.101876 29065 tablet_bootstrap.cc:654] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.102408 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
W20260709 13:09:12.104117 28758 leader_election.cc:343] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.103930 28857 tablet_service.cc:1511] Processing CreateTablet for tablet d1293cb1f6ed468da880ff1ee758b3b4 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:12.102622 29007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37be0dd46a214f7d9eef969ee4d69966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.105389 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1293cb1f6ed468da880ff1ee758b3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.100167 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:12.107122 28944 raft_consensus.cc:2468] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:12.100180 29017 raft_consensus.cc:3060] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:12.108852 28981 leader_election.cc:343] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.101876 29066 tablet_bootstrap.cc:492] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:12.095960 29064 tablet_bootstrap.cc:654] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.109879 29066 ts_tablet_manager.cc:1403] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.212s	user 0.015s	sys 0.045s
I20260709 13:09:12.107421 29082 raft_consensus.cc:515] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.112665 28932 tablet_service.cc:1511] Processing CreateTablet for tablet d1293cb1f6ed468da880ff1ee758b3b4 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:12.118381 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1293cb1f6ed468da880ff1ee758b3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.121832 28783 tablet_service.cc:1511] Processing CreateTablet for tablet d1293cb1f6ed468da880ff1ee758b3b4 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:12.123494 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1293cb1f6ed468da880ff1ee758b3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.114027 29111 consensus_queue.cc:1048] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:09:12.109808 29096 leader_election.cc:290] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:12.132911 28981 leader_election.cc:304] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:12.135200 28785 tablet_service.cc:1511] Processing CreateTablet for tablet 37f7afbd6bd14202b784bc4c24b71bd1 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:12.137533 29002 tablet_service.cc:1511] Processing CreateTablet for tablet 37f7afbd6bd14202b784bc4c24b71bd1 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:12.143112 28927 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba5ec54e7c44d24bc7d08fb0e839618 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:12.150957 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f7afbd6bd14202b784bc4c24b71bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.151022 29068 raft_consensus.cc:2804] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.142074 29066 raft_consensus.cc:359] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.151808 29068 raft_consensus.cc:493] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.150960 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba5ec54e7c44d24bc7d08fb0e839618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.152348 29068 raft_consensus.cc:3060] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.138190 28852 tablet_service.cc:1511] Processing CreateTablet for tablet 37f7afbd6bd14202b784bc4c24b71bd1 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:12.154624 28852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f7afbd6bd14202b784bc4c24b71bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.141518 29082 leader_election.cc:290] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:12.149567 29004 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba5ec54e7c44d24bc7d08fb0e839618 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:12.151047 29002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f7afbd6bd14202b784bc4c24b71bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.142872 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdf6272d9e4462c8bd8e31403360a5b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:12.147502 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdf6272d9e4462c8bd8e31403360a5b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:12.152119 29066 raft_consensus.cc:385] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.157898 29066 raft_consensus.cc:740] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.157353 29004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba5ec54e7c44d24bc7d08fb0e839618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.162572 29066 consensus_queue.cc:260] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.177211 29066 ts_tablet_manager.cc:1434] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:09:12.162166 29076 raft_consensus.cc:2749] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.175514 28870 raft_consensus.cc:3060] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.175149 28795 raft_consensus.cc:3060] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.190949 29066 tablet_bootstrap.cc:492] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:12.203594 28783 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba5ec54e7c44d24bc7d08fb0e839618 (DEFAULT_TABLE table=test-workload [id=299510493dac4b8e8e57c677bcde3660]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:12.204950 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba5ec54e7c44d24bc7d08fb0e839618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.211750 29065 tablet_bootstrap.cc:492] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:12.209095 29017 raft_consensus.cc:2468] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:12.215482 28759 leader_election.cc:304] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:12.215960 29065 ts_tablet_manager.cc:1403] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.205s	user 0.017s	sys 0.002s
I20260709 13:09:12.216389 29074 raft_consensus.cc:2804] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.221632 29065 raft_consensus.cc:359] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.222388 29065 raft_consensus.cc:385] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.222718 29065 raft_consensus.cc:740] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.223402 29065 consensus_queue.cc:260] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.239362 29147 raft_consensus.cc:493] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.240015 29147 raft_consensus.cc:515] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.244256 29064 tablet_bootstrap.cc:492] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:12.244906 29064 ts_tablet_manager.cc:1403] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.232s	user 0.012s	sys 0.008s
I20260709 13:09:12.256116 29065 ts_tablet_manager.cc:1434] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.006s
I20260709 13:09:12.258144 29063 tablet_bootstrap.cc:492] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:12.258836 29063 ts_tablet_manager.cc:1403] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.226s	user 0.019s	sys 0.014s
I20260709 13:09:12.254734 29074 raft_consensus.cc:697] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:12.263502 29065 tablet_bootstrap.cc:492] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:12.266975 29147 leader_election.cc:290] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:12.269824 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c712a67162406ba7f28ef7f9b396b9" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:12.270666 28869 raft_consensus.cc:2468] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:12.272730 29074 consensus_queue.cc:237] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.268719 29066 tablet_bootstrap.cc:654] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.282127 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c712a67162406ba7f28ef7f9b396b9" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:12.282794 29082 consensus_queue.cc:1048] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.275101 28981 leader_election.cc:304] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:12.277222 28870 raft_consensus.cc:2468] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:12.282006 28868 raft_consensus.cc:3060] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.286468 28907 leader_election.cc:304] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:12.287772 29082 raft_consensus.cc:2804] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.288326 29082 raft_consensus.cc:697] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:12.288965 29147 raft_consensus.cc:2804] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:12.289443 28984 leader_election.cc:343] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.289309 29082 consensus_queue.cc:237] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.290980 29064 raft_consensus.cc:359] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.291788 29064 raft_consensus.cc:385] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.292101 29064 raft_consensus.cc:740] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.289362 29147 raft_consensus.cc:493] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.293816 29147 raft_consensus.cc:3060] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.295468 29068 raft_consensus.cc:515] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.303143 29066 tablet_bootstrap.cc:492] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:12.303747 29066 ts_tablet_manager.cc:1403] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.113s	user 0.006s	sys 0.010s
I20260709 13:09:12.310053 28795 raft_consensus.cc:2468] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:12.310348 29063 raft_consensus.cc:359] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.316306 29063 raft_consensus.cc:385] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.316689 29063 raft_consensus.cc:740] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.308403 29068 leader_election.cc:290] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:12.318953 29063 consensus_queue.cc:260] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.326237 29066 raft_consensus.cc:359] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.327152 29066 raft_consensus.cc:385] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.327450 29066 raft_consensus.cc:740] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.329277 29066 consensus_queue.cc:260] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.337219 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:12.342923 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:12.343840 28943 raft_consensus.cc:3060] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.351706 29066 ts_tablet_manager.cc:1434] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.003s
I20260709 13:09:12.311754 29064 consensus_queue.cc:260] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.404965 29063 ts_tablet_manager.cc:1434] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.146s	user 0.028s	sys 0.025s
W20260709 13:09:12.402972 28981 leader_election.cc:343] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.409701 29063 tablet_bootstrap.cc:492] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:12.407065 29111 raft_consensus.cc:493] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.419837 28693 catalog_manager.cc:5697] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.414124 29156 consensus_queue.cc:1048] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:12.414563 29065 tablet_bootstrap.cc:654] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.422724 28692 catalog_manager.cc:5697] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.428655 29111 raft_consensus.cc:515] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:12.415683 28741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:12.409483 29074 consensus_queue.cc:1048] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:12.430987 29111 leader_election.cc:290] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:12.408914 29147 raft_consensus.cc:515] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.431609 29066 tablet_bootstrap.cc:492] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:12.404150 28908 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:46467, user_credentials={real_user=slave}} blocked reactor thread for 48299us
I20260709 13:09:12.434468 29153 raft_consensus.cc:493] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.435058 29153 raft_consensus.cc:515] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.437377 29153 leader_election.cc:290] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:12.437569 29148 consensus_queue.cc:1048] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:12.447804 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:12.448176 29147 leader_election.cc:290] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:12.449136 29064 ts_tablet_manager.cc:1434] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.204s	user 0.013s	sys 0.005s
I20260709 13:09:12.449725 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e2f6598cef41e581c126c2788da507" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:12.451905 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c712a67162406ba7f28ef7f9b396b9" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:12.452216 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c712a67162406ba7f28ef7f9b396b9" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:12.452880 28869 raft_consensus.cc:3060] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.453785 29064 tablet_bootstrap.cc:492] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
W20260709 13:09:12.456924 28981 leader_election.cc:343] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.460759 28869 raft_consensus.cc:2468] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:12.464268 28981 leader_election.cc:304] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:12.462636 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e2f6598cef41e581c126c2788da507" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:12.472131 28795 raft_consensus.cc:2468] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:12.472599 29065 tablet_bootstrap.cc:492] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:12.461263 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:12.473816 29065 ts_tablet_manager.cc:1403] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.211s	user 0.015s	sys 0.012s
I20260709 13:09:12.472518 29147 raft_consensus.cc:2804] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.475217 29147 raft_consensus.cc:697] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
W20260709 13:09:12.473307 28984 leader_election.cc:343] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.480064 29063 tablet_bootstrap.cc:654] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.476140 29147 consensus_queue.cc:237] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.481598 28984 leader_election.cc:304] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:12.482529 29153 raft_consensus.cc:2804] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.482946 29153 raft_consensus.cc:493] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.483282 29153 raft_consensus.cc:3060] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.483189 28834 leader_election.cc:304] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:12.484184 29065 raft_consensus.cc:359] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.484997 29065 raft_consensus.cc:385] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.485293 29065 raft_consensus.cc:740] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.486114 29065 consensus_queue.cc:260] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.488464 29065 ts_tablet_manager.cc:1434] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:09:12.489691 29065 tablet_bootstrap.cc:492] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:12.491462 29148 raft_consensus.cc:493] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.491958 28943 raft_consensus.cc:2468] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:12.492039 29148 raft_consensus.cc:515] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.493835 28981 leader_election.cc:304] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:12.494397 29148 leader_election.cc:290] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:12.495515 29066 tablet_bootstrap.cc:654] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.499678 29068 raft_consensus.cc:2804] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.500948 29111 raft_consensus.cc:2749] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.501627 29068 raft_consensus.cc:697] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:12.502547 29068 consensus_queue.cc:237] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.508796 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:12.510341 29065 tablet_bootstrap.cc:654] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.496270 29153 raft_consensus.cc:515] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.518530 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:12.519297 29153 leader_election.cc:290] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:12.519937 28758 leader_election.cc:343] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.521315 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e2f6598cef41e581c126c2788da507" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:12.521965 28795 raft_consensus.cc:3060] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.525467 29064 tablet_bootstrap.cc:654] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.519416 28943 raft_consensus.cc:2468] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:12.530622 28758 leader_election.cc:304] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:12.531093 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e2f6598cef41e581c126c2788da507" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:12.533718 29096 raft_consensus.cc:2804] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.540125 29096 raft_consensus.cc:493] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.540581 29096 raft_consensus.cc:3060] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:12.547247 28981 leader_election.cc:343] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.570245 29066 tablet_bootstrap.cc:492] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:12.570909 29066 ts_tablet_manager.cc:1403] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.157s	user 0.015s	sys 0.009s
I20260709 13:09:12.575624 29096 raft_consensus.cc:515] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.574359 29066 raft_consensus.cc:359] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.578614 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
W20260709 13:09:12.580497 28758 leader_election.cc:343] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.581070 29066 raft_consensus.cc:385] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.581801 29066 raft_consensus.cc:740] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.582871 29066 consensus_queue.cc:260] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.585346 29066 ts_tablet_manager.cc:1434] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:12.586684 29066 tablet_bootstrap.cc:492] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:12.586068 28795 raft_consensus.cc:2468] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:12.588778 28984 leader_election.cc:304] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:12.589748 29068 raft_consensus.cc:2804] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.590253 29068 raft_consensus.cc:697] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:12.591077 29068 consensus_queue.cc:237] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.588924 29096 leader_election.cc:290] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:12.595196 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:12.596004 28943 raft_consensus.cc:3060] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.604653 28943 raft_consensus.cc:2468] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:12.609400 28758 leader_election.cc:304] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:12.611004 29096 raft_consensus.cc:2804] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.611752 29096 raft_consensus.cc:697] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:12.612754 29066 tablet_bootstrap.cc:654] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.612627 29096 consensus_queue.cc:237] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.625492 28693 catalog_manager.cc:5697] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.630832 29064 tablet_bootstrap.cc:492] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:12.631393 29064 ts_tablet_manager.cc:1403] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.178s	user 0.007s	sys 0.007s
I20260709 13:09:12.632426 29066 tablet_bootstrap.cc:492] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:12.633080 29066 ts_tablet_manager.cc:1403] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
I20260709 13:09:12.636214 29066 raft_consensus.cc:359] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.637030 29066 raft_consensus.cc:385] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.637319 29066 raft_consensus.cc:740] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.637988 29066 consensus_queue.cc:260] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.640130 29066 ts_tablet_manager.cc:1434] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:12.642433 29064 raft_consensus.cc:359] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.643196 29064 raft_consensus.cc:385] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.643458 29064 raft_consensus.cc:740] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.644268 29064 consensus_queue.cc:260] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.650228 29066 tablet_bootstrap.cc:492] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:12.651368 29064 ts_tablet_manager.cc:1434] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.006s
I20260709 13:09:12.652452 29064 tablet_bootstrap.cc:492] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:12.656399 29066 tablet_bootstrap.cc:654] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.658341 29064 tablet_bootstrap.cc:654] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.667217 28693 catalog_manager.cc:5697] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.671607 29096 raft_consensus.cc:493] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.672200 29096 raft_consensus.cc:515] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.674396 29096 leader_election.cc:290] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:12.669615 28693 catalog_manager.cc:5697] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.678390 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3792b36a88e84708afea67ae52341ad1" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:12.680013 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3792b36a88e84708afea67ae52341ad1" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:12.681736 28758 leader_election.cc:343] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:12.683766 28758 leader_election.cc:343] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.684294 28758 leader_election.cc:304] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:12.685673 29096 raft_consensus.cc:2749] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.689164 29063 tablet_bootstrap.cc:492] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:12.689095 29066 tablet_bootstrap.cc:492] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:12.689826 29063 ts_tablet_manager.cc:1403] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.280s	user 0.044s	sys 0.086s
I20260709 13:09:12.690165 29066 ts_tablet_manager.cc:1403] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.004s
I20260709 13:09:12.692824 29066 raft_consensus.cc:359] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.693502 29066 raft_consensus.cc:385] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.693763 29066 raft_consensus.cc:740] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.694461 29065 tablet_bootstrap.cc:492] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:12.694574 29066 consensus_queue.cc:260] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.697139 29066 ts_tablet_manager.cc:1434] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:12.696754 29063 raft_consensus.cc:359] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.698444 29066 tablet_bootstrap.cc:492] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:12.698566 29063 raft_consensus.cc:385] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.698886 29063 raft_consensus.cc:740] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.699856 29064 tablet_bootstrap.cc:492] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:12.699553 29063 consensus_queue.cc:260] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.700383 29064 ts_tablet_manager.cc:1403] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.022s
I20260709 13:09:12.701624 29063 ts_tablet_manager.cc:1434] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:12.702620 29063 tablet_bootstrap.cc:492] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:12.703665 29064 raft_consensus.cc:359] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.704553 29064 raft_consensus.cc:385] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.704838 29064 raft_consensus.cc:740] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.705621 29065 ts_tablet_manager.cc:1403] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.216s	user 0.047s	sys 0.036s
I20260709 13:09:12.705672 29064 consensus_queue.cc:260] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.707121 29066 tablet_bootstrap.cc:654] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.708463 29065 raft_consensus.cc:359] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.709249 29065 raft_consensus.cc:385] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.709506 29065 raft_consensus.cc:740] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.710243 29065 consensus_queue.cc:260] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.711011 29096 consensus_queue.cc:1048] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.712426 29065 ts_tablet_manager.cc:1434] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:09:12.713629 29065 tablet_bootstrap.cc:492] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:12.716884 29158 raft_consensus.cc:493] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.717453 29158 raft_consensus.cc:515] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.719758 28692 catalog_manager.cc:5697] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.723243 29063 tablet_bootstrap.cc:654] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.721167 29066 tablet_bootstrap.cc:492] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:12.721903 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e2f6598cef41e581c126c2788da507" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:12.724920 29066 ts_tablet_manager.cc:1403] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.000s
I20260709 13:09:12.722548 29065 tablet_bootstrap.cc:654] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.729557 28870 raft_consensus.cc:3060] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.736907 29158 leader_election.cc:290] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:12.721275 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e2f6598cef41e581c126c2788da507" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:12.738188 28795 raft_consensus.cc:2393] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate f3d3a97b01f64816a2a769d159dd64d2 in this term.
I20260709 13:09:12.738677 29063 tablet_bootstrap.cc:492] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:12.739216 29063 ts_tablet_manager.cc:1403] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.006s
I20260709 13:09:12.739463 28910 leader_election.cc:304] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:12.744076 29063 raft_consensus.cc:359] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.744884 29063 raft_consensus.cc:385] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.745170 29063 raft_consensus.cc:740] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.746038 29158 raft_consensus.cc:3060] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.747783 29063 consensus_queue.cc:260] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.748076 29066 raft_consensus.cc:359] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.748947 29066 raft_consensus.cc:385] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.749318 29066 raft_consensus.cc:740] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.749862 29145 consensus_queue.cc:1048] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.750168 29066 consensus_queue.cc:260] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.752703 29066 ts_tablet_manager.cc:1434] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:09:12.750043 29063 ts_tablet_manager.cc:1434] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:09:12.754654 29066 tablet_bootstrap.cc:492] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:12.754686 29063 tablet_bootstrap.cc:492] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:12.756943 29065 tablet_bootstrap.cc:492] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:12.757931 29065 ts_tablet_manager.cc:1403] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.015s
I20260709 13:09:12.759634 29119 raft_consensus.cc:493] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.760200 29119 raft_consensus.cc:515] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.763732 29063 tablet_bootstrap.cc:654] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.761749 29065 raft_consensus.cc:359] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.765935 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a577314507499e84f3ce9f1f878ddd" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:12.768605 29065 raft_consensus.cc:385] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.762650 29119 leader_election.cc:290] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:12.769109 29065 raft_consensus.cc:740] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.764081 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a577314507499e84f3ce9f1f878ddd" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:12.770071 29065 consensus_queue.cc:260] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:12.771166 28907 leader_election.cc:343] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.772421 29065 ts_tablet_manager.cc:1434] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:09:12.767630 29066 tablet_bootstrap.cc:654] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.774751 29065 tablet_bootstrap.cc:492] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:12.768908 29016 raft_consensus.cc:2468] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:12.779413 29063 tablet_bootstrap.cc:492] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:12.780010 29063 ts_tablet_manager.cc:1403] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:09:12.783088 29063 raft_consensus.cc:359] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.783855 29063 raft_consensus.cc:385] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.784181 29063 raft_consensus.cc:740] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.783524 29065 tablet_bootstrap.cc:654] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.784955 29063 consensus_queue.cc:260] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.788285 29063 ts_tablet_manager.cc:1434] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:12.789391 29063 tablet_bootstrap.cc:492] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:12.795979 29063 tablet_bootstrap.cc:654] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.796082 28908 leader_election.cc:304] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:12.798188 29119 raft_consensus.cc:2804] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.798497 29066 tablet_bootstrap.cc:492] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:12.798628 29119 raft_consensus.cc:493] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.799082 29066 ts_tablet_manager.cc:1403] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.002s
I20260709 13:09:12.802256 29066 raft_consensus.cc:359] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.803074 29066 raft_consensus.cc:385] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.803391 29066 raft_consensus.cc:740] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.803735 29111 raft_consensus.cc:493] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.804256 29111 raft_consensus.cc:515] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.804176 29066 consensus_queue.cc:260] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.805914 29063 tablet_bootstrap.cc:492] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:12.806393 29065 tablet_bootstrap.cc:492] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:12.806404 29063 ts_tablet_manager.cc:1403] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:09:12.807406 29065 ts_tablet_manager.cc:1403] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.002s
I20260709 13:09:12.808784 29066 ts_tablet_manager.cc:1434] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:09:12.799170 29119 raft_consensus.cc:3060] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.809881 29066 tablet_bootstrap.cc:492] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:12.811393 29065 raft_consensus.cc:359] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.812157 29065 raft_consensus.cc:385] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.812454 29065 raft_consensus.cc:740] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.812891 29063 raft_consensus.cc:359] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.816438 29063 raft_consensus.cc:385] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.816833 29063 raft_consensus.cc:740] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.813162 29065 consensus_queue.cc:260] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.814342 29145 raft_consensus.cc:493] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.817516 29145 raft_consensus.cc:515] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.819088 29065 ts_tablet_manager.cc:1434] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 13:09:12.819676 29145 leader_election.cc:290] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:12.806691 29111 leader_election.cc:290] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:12.815666 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ae58f02e904d698a5cfb5b598b91be" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:12.820160 29065 tablet_bootstrap.cc:492] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:12.820247 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ae58f02e904d698a5cfb5b598b91be" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:12.817521 29063 consensus_queue.cc:260] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.823906 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c27c89959045278c3f55d885d5391f" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:12.821040 28795 raft_consensus.cc:2468] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
W20260709 13:09:12.825508 28758 leader_election.cc:343] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.826346 29066 tablet_bootstrap.cc:654] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.826722 29065 tablet_bootstrap.cc:654] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:12.828611 28833 leader_election.cc:343] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.831933 29063 ts_tablet_manager.cc:1434] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 13:09:12.833420 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c27c89959045278c3f55d885d5391f" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:12.834407 29063 tablet_bootstrap.cc:492] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
W20260709 13:09:12.835907 28758 leader_election.cc:343] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.836445 28758 leader_election.cc:304] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:12.837340 29145 raft_consensus.cc:2749] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.839112 29065 tablet_bootstrap.cc:492] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:12.839665 29065 ts_tablet_manager.cc:1403] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:09:12.841305 29063 tablet_bootstrap.cc:654] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.842707 29065 raft_consensus.cc:359] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.843487 29065 raft_consensus.cc:385] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.843765 29065 raft_consensus.cc:740] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.846122 29066 tablet_bootstrap.cc:492] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:12.846246 28836 leader_election.cc:304] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:12.846803 29066 ts_tablet_manager.cc:1403] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.003s
I20260709 13:09:12.848094 29111 raft_consensus.cc:2804] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.848590 29111 raft_consensus.cc:493] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.849035 29111 raft_consensus.cc:3060] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.850716 29066 raft_consensus.cc:359] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.851497 29066 raft_consensus.cc:385] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.851786 29066 raft_consensus.cc:740] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.852566 29066 consensus_queue.cc:260] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:12.854758 29066 ts_tablet_manager.cc:1434] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:12.850297 29065 consensus_queue.cc:260] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.857458 29065 ts_tablet_manager.cc:1434] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:09:12.858968 29066 tablet_bootstrap.cc:492] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:12.862509 29064 ts_tablet_manager.cc:1434] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.161s	user 0.006s	sys 0.001s
I20260709 13:09:12.864379 29064 tablet_bootstrap.cc:492] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:12.865132 29065 tablet_bootstrap.cc:492] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:12.868067 29082 consensus_queue.cc:1048] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.871551 29065 tablet_bootstrap.cc:654] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.876089 29066 tablet_bootstrap.cc:654] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.877254 29068 consensus_queue.cc:1048] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.758487 29158 raft_consensus.cc:2749] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.885495 29153 raft_consensus.cc:493] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.886044 29153 raft_consensus.cc:515] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.886737 29119 raft_consensus.cc:515] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.889011 29153 leader_election.cc:290] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:12.894858 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1918784f405b46fe85f940384b1e4520" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:12.896862 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1918784f405b46fe85f940384b1e4520" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:12.898229 29111 raft_consensus.cc:515] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.901808 29158 consensus_queue.cc:1048] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:12.902590 28981 leader_election.cc:343] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:12.903699 28981 leader_election.cc:343] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.905980 29119 leader_election.cc:290] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:12.906711 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a577314507499e84f3ce9f1f878ddd" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:12.907421 29064 tablet_bootstrap.cc:654] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.907493 28868 raft_consensus.cc:3060] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.904361 28981 leader_election.cc:304] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:12.913442 29068 raft_consensus.cc:2749] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.914834 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ae58f02e904d698a5cfb5b598b91be" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:12.915848 28794 raft_consensus.cc:3060] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.919263 29063 tablet_bootstrap.cc:492] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:12.920219 29063 ts_tablet_manager.cc:1403] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.086s	user 0.031s	sys 0.020s
I20260709 13:09:12.927102 29063 raft_consensus.cc:359] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.927927 29063 raft_consensus.cc:385] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.928177 29063 raft_consensus.cc:740] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.928923 29063 consensus_queue.cc:260] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.937789 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a577314507499e84f3ce9f1f878ddd" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:12.938498 29016 raft_consensus.cc:3060] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.938767 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ae58f02e904d698a5cfb5b598b91be" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:12.940932 29111 leader_election.cc:290] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
W20260709 13:09:12.945793 28833 leader_election.cc:343] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.947221 28868 raft_consensus.cc:2468] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:12.945349 28794 raft_consensus.cc:2468] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:12.948899 28907 leader_election.cc:304] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:12.949432 28836 leader_election.cc:304] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:12.949862 29119 raft_consensus.cc:2804] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.950515 29119 raft_consensus.cc:697] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:12.950713 29111 raft_consensus.cc:2804] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.951416 29111 raft_consensus.cc:697] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:12.954818 29145 raft_consensus.cc:493] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.955518 29145 raft_consensus.cc:515] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:12.958024 29145 leader_election.cc:290] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:12.960669 29119 consensus_queue.cc:237] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:12.970747 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:12.968253 29063 ts_tablet_manager.cc:1434] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:09:12.971351 29096 raft_consensus.cc:493] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.971889 29096 raft_consensus.cc:515] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:12.972810 28758 leader_election.cc:343] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.973016 29063 tablet_bootstrap.cc:492] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:12.974212 29096 leader_election.cc:290] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:12.978456 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:12.979221 29018 raft_consensus.cc:2468] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:12.980363 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c712a67162406ba7f28ef7f9b396b9" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:12.981698 28759 leader_election.cc:304] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:12.983070 29096 raft_consensus.cc:2804] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.983355 29063 tablet_bootstrap.cc:654] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.952298 29111 consensus_queue.cc:237] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:12.985144 29096 raft_consensus.cc:493] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.996199 28794 raft_consensus.cc:3060] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.996776 29145 raft_consensus.cc:493] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.009053 29066 tablet_bootstrap.cc:492] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:13.009443 29064 tablet_bootstrap.cc:492] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:12.997421 29145 raft_consensus.cc:515] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.010020 29064 ts_tablet_manager.cc:1403] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.146s	user 0.030s	sys 0.025s
I20260709 13:09:13.011945 29016 raft_consensus.cc:2468] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:13.004814 29148 raft_consensus.cc:493] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.013182 29148 raft_consensus.cc:515] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.013751 28691 catalog_manager.cc:5697] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.015666 29145 leader_election.cc:290] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:13.017366 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77eab9e557b46d8acc7483af6e6ad0d" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:13.019493 28758 leader_election.cc:343] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.021275 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77eab9e557b46d8acc7483af6e6ad0d" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:13.022902 29148 leader_election.cc:290] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:12.987226 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c712a67162406ba7f28ef7f9b396b9" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:13.024577 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:13.026503 28758 leader_election.cc:343] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.998063 29147 raft_consensus.cc:493] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.027546 29147 raft_consensus.cc:515] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.027985 29068 consensus_queue.cc:1048] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.022624 29145 consensus_queue.cc:1048] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.033663 29064 raft_consensus.cc:359] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.034425 29064 raft_consensus.cc:385] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.034705 29064 raft_consensus.cc:740] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.035382 29064 consensus_queue.cc:260] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.039884 29147 leader_election.cc:290] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:13.043323 29064 ts_tablet_manager.cc:1434] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:09:13.030992 29065 tablet_bootstrap.cc:492] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:13.031414 28758 leader_election.cc:304] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:13.009994 29066 ts_tablet_manager.cc:1403] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.010s
W20260709 13:09:13.040180 28759 leader_election.cc:343] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.051795 29148 raft_consensus.cc:2749] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.051836 29064 tablet_bootstrap.cc:492] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:13.051524 28759 leader_election.cc:304] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:13.051491 29066 raft_consensus.cc:359] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.054407 29066 raft_consensus.cc:385] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.054783 29066 raft_consensus.cc:740] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.055125 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:12.988806 29096 raft_consensus.cc:3060] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.055650 29145 raft_consensus.cc:2749] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.056401 29076 raft_consensus.cc:493] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.055573 29066 consensus_queue.cc:260] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.056950 29076 raft_consensus.cc:515] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.058419 29066 ts_tablet_manager.cc:1434] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:13.059175 29065 ts_tablet_manager.cc:1403] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.194s	user 0.003s	sys 0.021s
I20260709 13:09:13.059686 29066 tablet_bootstrap.cc:492] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:13.061076 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:13.061792 29018 raft_consensus.cc:2468] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:13.056358 28794 raft_consensus.cc:2468] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:13.080897 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:13.081835 28984 leader_election.cc:304] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:13.082935 29153 raft_consensus.cc:2804] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:13.083395 28981 leader_election.cc:343] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.084754 29076 leader_election.cc:290] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:13.087293 28759 leader_election.cc:304] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:13.088835 29082 raft_consensus.cc:493] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.089568 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:13.090090 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:13.091003 28944 raft_consensus.cc:2393] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89867186bb4546988c8fcd2b9fea8757 in current term 1: Already voted for candidate f3d3a97b01f64816a2a769d159dd64d2 in this term.
I20260709 13:09:13.089569 29082 raft_consensus.cc:515] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.092420 29145 raft_consensus.cc:2804] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.092892 29145 raft_consensus.cc:493] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.093291 29145 raft_consensus.cc:3060] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.083345 29153 raft_consensus.cc:493] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.096976 29153 raft_consensus.cc:3060] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.098845 29066 tablet_bootstrap.cc:654] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.099900 28692 catalog_manager.cc:5697] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.102304 28833 leader_election.cc:304] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:13.092347 29065 raft_consensus.cc:359] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.105500 29065 raft_consensus.cc:385] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.105809 29065 raft_consensus.cc:740] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.106531 29065 consensus_queue.cc:260] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.107522 29145 raft_consensus.cc:515] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.108258 29082 leader_election.cc:290] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:13.109612 29111 raft_consensus.cc:493] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.110484 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:13.111094 29065 ts_tablet_manager.cc:1434] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:09:13.111008 29111 raft_consensus.cc:515] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.112178 29065 tablet_bootstrap.cc:492] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
W20260709 13:09:13.112098 28758 leader_election.cc:343] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.114037 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:13.116955 29145 leader_election.cc:290] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:13.116880 29064 tablet_bootstrap.cc:654] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.117839 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:13.118980 29111 leader_election.cc:290] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:13.120229 28833 leader_election.cc:304] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:13.122097 29147 raft_consensus.cc:493] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.122745 29147 raft_consensus.cc:515] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.125114 29147 leader_election.cc:290] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:13.125695 29147 consensus_queue.cc:1048] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.115803 29153 raft_consensus.cc:515] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.116596 29076 raft_consensus.cc:3060] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.135702 29197 raft_consensus.cc:493] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.137537 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e0aebb326f4409a072848dd5227247" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:13.138293 28794 raft_consensus.cc:2468] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:13.136317 29197 raft_consensus.cc:515] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.128800 29111 raft_consensus.cc:2749] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.133610 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e0aebb326f4409a072848dd5227247" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:13.148219 29016 raft_consensus.cc:2468] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:13.149097 29147 raft_consensus.cc:493] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.149521 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ea1e4725643da8ae65abeabbabcd7" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:13.149631 29147 raft_consensus.cc:515] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.154161 29197 leader_election.cc:290] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:13.154687 28870 raft_consensus.cc:3060] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.142479 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ea1e4725643da8ae65abeabbabcd7" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:13.148804 28910 leader_election.cc:304] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:13.159037 29065 tablet_bootstrap.cc:654] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.160493 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:13.162012 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf928a86b924440b6bfc966df8860b8" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:13.163352 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf928a86b924440b6bfc966df8860b8" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:13.164197 28981 leader_election.cc:343] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.166013 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e0aebb326f4409a072848dd5227247" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:13.169315 28984 leader_election.cc:343] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:13.169747 28981 leader_election.cc:343] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.169926 29148 consensus_queue.cc:1048] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:13.170524 28981 leader_election.cc:343] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.171041 28981 leader_election.cc:304] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:13.172756 29197 raft_consensus.cc:2749] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:13.172369 28981 leader_election.cc:343] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.174266 28981 leader_election.cc:304] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:13.175300 29197 raft_consensus.cc:2749] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.178781 29063 tablet_bootstrap.cc:492] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:13.179352 29063 ts_tablet_manager.cc:1403] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.207s	user 0.033s	sys 0.022s
I20260709 13:09:13.175450 29147 leader_election.cc:290] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:13.186080 29111 raft_consensus.cc:493] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.186721 29111 raft_consensus.cc:515] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.186818 29063 raft_consensus.cc:359] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.188858 29063 raft_consensus.cc:385] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.189214 29063 raft_consensus.cc:740] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.189971 29063 consensus_queue.cc:260] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.160799 29082 raft_consensus.cc:2804] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.193125 29082 raft_consensus.cc:493] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.193562 29082 raft_consensus.cc:3060] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.194389 29111 leader_election.cc:290] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:13.195850 29153 leader_election.cc:290] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:13.161319 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:13.160624 29076 raft_consensus.cc:2749] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.206430 29063 ts_tablet_manager.cc:1434] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:09:13.201220 29147 consensus_queue.cc:1048] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:13.208166 29016 raft_consensus.cc:2393] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7f68815192fc48a58a67ddf2da3bac70 in current term 1: Already voted for candidate f3d3a97b01f64816a2a769d159dd64d2 in this term.
I20260709 13:09:13.208523 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c27c89959045278c3f55d885d5391f" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:13.212857 29064 tablet_bootstrap.cc:492] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:13.213572 29064 ts_tablet_manager.cc:1403] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.010s
I20260709 13:09:13.201128 29096 raft_consensus.cc:515] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.207695 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c27c89959045278c3f55d885d5391f" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:13.217897 29063 tablet_bootstrap.cc:492] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:13.213025 29074 raft_consensus.cc:493] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.219801 29074 raft_consensus.cc:515] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.230361 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:13.231251 28793 raft_consensus.cc:2393] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 in current term 1: Already voted for candidate 7f68815192fc48a58a67ddf2da3bac70 in this term.
W20260709 13:09:13.225759 28833 leader_election.cc:343] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.232883 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:13.234166 28759 leader_election.cc:304] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:13.226104 28794 raft_consensus.cc:2468] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:13.236132 29148 raft_consensus.cc:2749] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.238333 29064 raft_consensus.cc:359] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.238667 28984 leader_election.cc:304] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:13.225219 29096 leader_election.cc:290] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:13.239116 29064 raft_consensus.cc:385] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.240733 29064 raft_consensus.cc:740] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.245654 29064 consensus_queue.cc:260] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.251366 29064 ts_tablet_manager.cc:1434] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:09:13.252046 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:13.252823 28941 raft_consensus.cc:3060] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.245850 29147 raft_consensus.cc:2749] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.269011 29064 tablet_bootstrap.cc:492] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:13.244696 29153 consensus_queue.cc:1048] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:09:13.262974 29200 raft_consensus.cc:493] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.271414 29200 raft_consensus.cc:515] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.247606 29016 raft_consensus.cc:3060] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.277088 29066 tablet_bootstrap.cc:492] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:13.277398 29064 tablet_bootstrap.cc:654] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.277246 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ae58f02e904d698a5cfb5b598b91be" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:13.256667 28836 leader_election.cc:304] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:13.274552 29200 leader_election.cc:290] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:13.282004 29066 ts_tablet_manager.cc:1403] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.223s	user 0.011s	sys 0.007s
I20260709 13:09:13.281553 29076 raft_consensus.cc:2804] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.283810 29076 raft_consensus.cc:493] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.284165 29076 raft_consensus.cc:3060] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.257395 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e0aebb326f4409a072848dd5227247" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:13.284891 28794 raft_consensus.cc:2468] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:13.286293 29074 leader_election.cc:290] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:13.288021 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40c62440e604ddfb2e59ee713fbbb34" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:13.290670 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ae58f02e904d698a5cfb5b598b91be" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:13.291582 28795 raft_consensus.cc:2393] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate 89867186bb4546988c8fcd2b9fea8757 in this term.
I20260709 13:09:13.293817 29063 tablet_bootstrap.cc:654] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.294651 29066 raft_consensus.cc:359] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.295329 29066 raft_consensus.cc:385] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.295574 29066 raft_consensus.cc:740] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.296245 29066 consensus_queue.cc:260] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.300983 29066 ts_tablet_manager.cc:1434] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
W20260709 13:09:13.299449 28759 leader_election.cc:343] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.301630 28910 leader_election.cc:304] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:13.302048 29066 tablet_bootstrap.cc:492] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:13.304450 29200 raft_consensus.cc:3060] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.310595 29066 tablet_bootstrap.cc:654] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.320595 29064 tablet_bootstrap.cc:492] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:13.321205 29064 ts_tablet_manager.cc:1403] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.006s
I20260709 13:09:13.322723 28984 leader_election.cc:304] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:13.323752 29147 raft_consensus.cc:2804] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.324179 29147 raft_consensus.cc:493] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.324556 29147 raft_consensus.cc:3060] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.325718 29082 raft_consensus.cc:515] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.328867 28942 raft_consensus.cc:2393] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 in current term 1: Already voted for candidate 7640ddad6f82422c8a0377a187b4e290 in this term.
I20260709 13:09:13.330410 29016 raft_consensus.cc:2468] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:13.332195 28759 leader_election.cc:304] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:13.333343 29148 raft_consensus.cc:2804] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.333875 29148 raft_consensus.cc:697] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:13.334725 29148 consensus_queue.cc:237] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.335605 29200 raft_consensus.cc:2749] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.340570 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e0aebb326f4409a072848dd5227247" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:13.341289 28795 raft_consensus.cc:3060] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.328183 29082 leader_election.cc:290] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:13.341229 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e0aebb326f4409a072848dd5227247" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:13.348842 29076 raft_consensus.cc:515] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.354355 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c27c89959045278c3f55d885d5391f" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:13.357152 28793 raft_consensus.cc:3060] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.357438 29153 consensus_queue.cc:1048] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.359951 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40c62440e604ddfb2e59ee713fbbb34" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:13.376768 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c27c89959045278c3f55d885d5391f" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
W20260709 13:09:13.378539 28833 leader_election.cc:343] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.379273 28793 raft_consensus.cc:2468] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:13.380542 28836 leader_election.cc:304] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:13.381464 29111 raft_consensus.cc:2804] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.381963 29111 raft_consensus.cc:697] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:13.382762 29111 consensus_queue.cc:237] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.371704 29076 leader_election.cc:290] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
W20260709 13:09:13.393117 29207 log.cc:927] Time spent T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:13.395195 29064 raft_consensus.cc:359] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.395972 29064 raft_consensus.cc:385] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.396253 29064 raft_consensus.cc:740] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.398074 29064 consensus_queue.cc:260] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.408085 29064 ts_tablet_manager.cc:1434] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.001s
I20260709 13:09:13.409837 29064 tablet_bootstrap.cc:492] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:13.419250 29063 tablet_bootstrap.cc:492] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:13.419703 29063 ts_tablet_manager.cc:1403] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.202s	user 0.018s	sys 0.008s
W20260709 13:09:13.424113 28758 leader_election.cc:343] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.424727 28758 leader_election.cc:304] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:13.425664 29206 raft_consensus.cc:2749] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.426437 29063 raft_consensus.cc:359] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.427204 29063 raft_consensus.cc:385] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.427485 29063 raft_consensus.cc:740] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.418318 28941 raft_consensus.cc:2468] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:13.430501 29064 tablet_bootstrap.cc:654] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.439108 29063 consensus_queue.cc:260] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.440146 29153 raft_consensus.cc:493] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.440691 29153 raft_consensus.cc:515] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.442873 29153 leader_election.cc:290] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:13.444557 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40c62440e604ddfb2e59ee713fbbb34" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:13.445749 29076 consensus_queue.cc:1048] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.447024 29147 raft_consensus.cc:515] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.447711 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40c62440e604ddfb2e59ee713fbbb34" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
W20260709 13:09:13.448046 28981 leader_election.cc:343] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.448654 28794 raft_consensus.cc:2468] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:13.451385 28984 leader_election.cc:304] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:13.447716 28690 catalog_manager.cc:5697] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.449143 28795 raft_consensus.cc:2468] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:13.454165 29063 ts_tablet_manager.cc:1434] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:09:13.447104 28692 catalog_manager.cc:5697] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.451807 29066 tablet_bootstrap.cc:492] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:13.457989 29065 tablet_bootstrap.cc:492] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:13.459098 29065 ts_tablet_manager.cc:1403] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.347s	user 0.035s	sys 0.025s
I20260709 13:09:13.459481 29197 raft_consensus.cc:2804] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.460085 29197 raft_consensus.cc:493] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.460547 29197 raft_consensus.cc:3060] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:13.462426 28741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:13.462052 29065 raft_consensus.cc:359] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.459446 28910 leader_election.cc:304] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:13.463141 29065 raft_consensus.cc:385] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.463502 29065 raft_consensus.cc:740] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.464262 29065 consensus_queue.cc:260] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.465000 29200 raft_consensus.cc:2804] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.466588 29200 raft_consensus.cc:697] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:13.467113 29147 leader_election.cc:290] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:13.467859 29016 raft_consensus.cc:2393] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate f3d3a97b01f64816a2a769d159dd64d2 in this term.
I20260709 13:09:13.467474 29200 consensus_queue.cc:237] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.468011 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e0aebb326f4409a072848dd5227247" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:13.465309 29066 ts_tablet_manager.cc:1403] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.163s	user 0.031s	sys 0.010s
I20260709 13:09:13.480553 29158 consensus_queue.cc:1048] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.493124 29065 ts_tablet_manager.cc:1434] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:09:13.497860 29065 tablet_bootstrap.cc:492] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:13.498986 29066 raft_consensus.cc:359] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.499763 29066 raft_consensus.cc:385] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.500036 29066 raft_consensus.cc:740] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.500728 29066 consensus_queue.cc:260] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.502868 29066 ts_tablet_manager.cc:1434] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:13.503839 29066 tablet_bootstrap.cc:492] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:13.494911 29063 tablet_bootstrap.cc:492] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:13.473124 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63e0aebb326f4409a072848dd5227247" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:13.506677 28794 raft_consensus.cc:2393] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 in current term 1: Already voted for candidate 7640ddad6f82422c8a0377a187b4e290 in this term.
I20260709 13:09:13.472074 29197 raft_consensus.cc:515] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.482714 29064 tablet_bootstrap.cc:492] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:13.507992 29064 ts_tablet_manager.cc:1403] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.013s
I20260709 13:09:13.510128 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40c62440e604ddfb2e59ee713fbbb34" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:13.510787 28984 leader_election.cc:304] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:13.511072 29064 raft_consensus.cc:359] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:13.511776 28981 leader_election.cc:343] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.512547 29063 tablet_bootstrap.cc:654] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.512784 29153 raft_consensus.cc:2749] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.513619 29064 raft_consensus.cc:385] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.513993 29064 raft_consensus.cc:740] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.514842 29064 consensus_queue.cc:260] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.515815 29200 raft_consensus.cc:493] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.516266 29200 raft_consensus.cc:515] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.518383 29200 leader_election.cc:290] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:13.519544 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1918784f405b46fe85f940384b1e4520" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:13.520241 29016 raft_consensus.cc:2468] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:13.521477 29064 ts_tablet_manager.cc:1434] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:09:13.522547 29064 tablet_bootstrap.cc:492] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:13.522276 29139 consensus_queue.cc:1048] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.505617 29065 tablet_bootstrap.cc:654] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.522171 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1918784f405b46fe85f940384b1e4520" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:13.527122 28868 raft_consensus.cc:2468] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:13.528898 28907 leader_election.cc:304] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:13.527324 28691 catalog_manager.cc:5697] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.530078 29200 raft_consensus.cc:2804] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.530709 29200 raft_consensus.cc:493] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.531167 29200 raft_consensus.cc:3060] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.530115 29064 tablet_bootstrap.cc:654] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.535144 29197 leader_election.cc:290] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:13.541318 29200 raft_consensus.cc:515] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.546253 29158 consensus_queue.cc:1048] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.550366 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40c62440e604ddfb2e59ee713fbbb34" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:13.554828 28794 raft_consensus.cc:3060] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.559340 29066 tablet_bootstrap.cc:654] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.563287 28794 raft_consensus.cc:2468] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:13.565969 29197 raft_consensus.cc:493] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.579892 29065 tablet_bootstrap.cc:492] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:13.580066 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1918784f405b46fe85f940384b1e4520" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:13.580623 29065 ts_tablet_manager.cc:1403] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.018s
I20260709 13:09:13.580708 28868 raft_consensus.cc:3060] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.584152 29065 raft_consensus.cc:359] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.584971 29065 raft_consensus.cc:385] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.585326 29065 raft_consensus.cc:740] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.586102 29065 consensus_queue.cc:260] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.579075 29197 raft_consensus.cc:515] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.594492 29200 leader_election.cc:290] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:13.600929 29065 ts_tablet_manager.cc:1434] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:13.601997 29065 tablet_bootstrap.cc:492] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:13.602443 29064 tablet_bootstrap.cc:492] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:13.602978 29064 ts_tablet_manager.cc:1403] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.020s
I20260709 13:09:13.605576 29063 tablet_bootstrap.cc:492] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:13.606252 29063 ts_tablet_manager.cc:1403] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.001s
I20260709 13:09:13.606688 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1918784f405b46fe85f940384b1e4520" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:13.607417 29017 raft_consensus.cc:3060] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.615335 28984 leader_election.cc:304] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:13.615902 29197 leader_election.cc:290] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:13.619808 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77eab9e557b46d8acc7483af6e6ad0d" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:13.621409 29148 raft_consensus.cc:493] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.621987 29148 raft_consensus.cc:515] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.624140 29148 leader_election.cc:290] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:13.625530 28868 raft_consensus.cc:2468] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
W20260709 13:09:13.626652 28981 leader_election.cc:343] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.627460 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77eab9e557b46d8acc7483af6e6ad0d" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:13.628966 28793 raft_consensus.cc:2468] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:13.630460 28984 leader_election.cc:304] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:13.630998 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f5b8a34d8d42c7958b3e1a2423802c" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:13.631680 29147 raft_consensus.cc:2804] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.632238 29147 raft_consensus.cc:697] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:13.632249 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f5b8a34d8d42c7958b3e1a2423802c" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:13.633098 29147 consensus_queue.cc:237] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.635037 29153 raft_consensus.cc:2804] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.635445 29017 raft_consensus.cc:2468] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:13.637241 28908 leader_election.cc:304] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:13.615463 29063 raft_consensus.cc:359] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.635478 29153 raft_consensus.cc:493] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.638635 29153 raft_consensus.cc:3060] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.638434 29063 raft_consensus.cc:385] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.641309 29065 tablet_bootstrap.cc:654] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.641330 29063 raft_consensus.cc:740] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.644891 29063 consensus_queue.cc:260] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:13.635488 28758 leader_election.cc:343] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.646273 29016 raft_consensus.cc:2468] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:13.648200 28759 leader_election.cc:304] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:13.649160 29148 raft_consensus.cc:2804] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.649729 29148 raft_consensus.cc:493] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.650094 29148 raft_consensus.cc:3060] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.651111 29063 ts_tablet_manager.cc:1434] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:09:13.651794 29227 raft_consensus.cc:2804] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.652107 29063 tablet_bootstrap.cc:492] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:13.649147 29153 raft_consensus.cc:515] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.658394 29148 raft_consensus.cc:515] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.658730 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77eab9e557b46d8acc7483af6e6ad0d" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:13.661744 29065 tablet_bootstrap.cc:492] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:13.662657 28793 raft_consensus.cc:3060] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.662803 29065 ts_tablet_manager.cc:1403] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.000s
I20260709 13:09:13.627401 29064 raft_consensus.cc:359] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.664517 29063 tablet_bootstrap.cc:654] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.666757 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77eab9e557b46d8acc7483af6e6ad0d" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:13.667290 29065 raft_consensus.cc:359] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.667999 29065 raft_consensus.cc:385] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.664466 29064 raft_consensus.cc:385] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.668761 29064 raft_consensus.cc:740] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.669239 29153 leader_election.cc:290] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:13.668336 29065 raft_consensus.cc:740] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.670816 28793 raft_consensus.cc:2468] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:13.676021 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f5b8a34d8d42c7958b3e1a2423802c" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:13.676137 28984 leader_election.cc:304] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:13.677129 29153 raft_consensus.cc:2804] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:13.677858 28758 leader_election.cc:343] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.678079 29153 raft_consensus.cc:697] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:13.671141 29064 consensus_queue.cc:260] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.671471 29065 consensus_queue.cc:260] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.678604 29227 raft_consensus.cc:697] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:13.678964 29153 consensus_queue.cc:237] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.679425 28692 catalog_manager.cc:5697] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.661976 29066 tablet_bootstrap.cc:492] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:13.674019 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f5b8a34d8d42c7958b3e1a2423802c" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:13.674458 29148 leader_election.cc:290] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:13.679739 29227 consensus_queue.cc:237] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.683931 29066 ts_tablet_manager.cc:1403] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.180s	user 0.028s	sys 0.019s
I20260709 13:09:13.685806 29016 raft_consensus.cc:3060] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.686782 29066 raft_consensus.cc:359] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.687522 29066 raft_consensus.cc:385] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.687783 29066 raft_consensus.cc:740] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.680351 29065 ts_tablet_manager.cc:1434] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:13.688455 29066 consensus_queue.cc:260] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.691989 29066 ts_tablet_manager.cc:1434] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:13.689513 29065 tablet_bootstrap.cc:492] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:13.696764 29016 raft_consensus.cc:2468] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:13.689652 28868 raft_consensus.cc:3060] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.701068 29064 ts_tablet_manager.cc:1434] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.000s
I20260709 13:09:13.702059 29064 tablet_bootstrap.cc:492] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:13.701795 28690 catalog_manager.cc:5697] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.704821 29066 tablet_bootstrap.cc:492] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:13.703284 28759 leader_election.cc:304] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:13.708542 29064 tablet_bootstrap.cc:654] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.709936 29148 raft_consensus.cc:2804] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.709362 28693 catalog_manager.cc:5697] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.710489 29148 raft_consensus.cc:697] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:13.710668 29065 tablet_bootstrap.cc:654] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.699193 29063 tablet_bootstrap.cc:492] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:13.712267 29063 ts_tablet_manager.cc:1403] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.004s
I20260709 13:09:13.715193 29063 raft_consensus.cc:359] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.716462 29148 consensus_queue.cc:237] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.718904 28868 raft_consensus.cc:2468] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:13.720571 29063 raft_consensus.cc:385] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.720985 29063 raft_consensus.cc:740] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.722056 29063 consensus_queue.cc:260] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.725140 29063 ts_tablet_manager.cc:1434] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:13.726493 29063 tablet_bootstrap.cc:492] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:13.730011 29153 raft_consensus.cc:493] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.730616 29153 raft_consensus.cc:515] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.733793 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6aa359b7334b7ab7b98c3a741e7402" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:13.735109 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6aa359b7334b7ab7b98c3a741e7402" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:13.735929 29065 tablet_bootstrap.cc:492] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:13.736514 29065 ts_tablet_manager.cc:1403] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.001s
I20260709 13:09:13.737221 29153 leader_election.cc:290] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:13.747927 29064 tablet_bootstrap.cc:492] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:13.748492 29064 ts_tablet_manager.cc:1403] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.011s
I20260709 13:09:13.750174 29063 tablet_bootstrap.cc:654] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.739351 29065 raft_consensus.cc:359] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.723351 29066 tablet_bootstrap.cc:654] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:13.741135 28981 leader_election.cc:343] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:13.751531 28981 leader_election.cc:343] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.751261 29064 raft_consensus.cc:359] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.752139 29064 raft_consensus.cc:385] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.756640 29064 raft_consensus.cc:740] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.753537 28689 catalog_manager.cc:5697] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.757515 29064 consensus_queue.cc:260] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.755582 29065 raft_consensus.cc:385] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.752030 28981 leader_election.cc:304] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:13.759029 29153 raft_consensus.cc:2749] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.760819 29065 raft_consensus.cc:740] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.760426 29064 ts_tablet_manager.cc:1434] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:09:13.761976 29064 tablet_bootstrap.cc:492] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:13.761705 29065 consensus_queue.cc:260] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.763574 29066 tablet_bootstrap.cc:492] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:13.764048 29065 ts_tablet_manager.cc:1434] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.001s
I20260709 13:09:13.766454 29066 ts_tablet_manager.cc:1403] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.004s
I20260709 13:09:13.767400 29065 tablet_bootstrap.cc:492] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:13.768579 29064 tablet_bootstrap.cc:654] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.769059 29139 raft_consensus.cc:493] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.769593 29139 raft_consensus.cc:515] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.771859 29139 leader_election.cc:290] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:13.773878 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf928a86b924440b6bfc966df8860b8" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:13.774755 29016 raft_consensus.cc:2468] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:13.777262 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf928a86b924440b6bfc966df8860b8" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:13.778175 28793 raft_consensus.cc:2468] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:13.781388 28834 leader_election.cc:304] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:13.773326 29066 raft_consensus.cc:359] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.784953 29066 raft_consensus.cc:385] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.785254 29066 raft_consensus.cc:740] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.786074 29066 consensus_queue.cc:260] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.787045 29111 raft_consensus.cc:2804] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.787504 29111 raft_consensus.cc:493] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.787837 29111 raft_consensus.cc:3060] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.791563 29066 ts_tablet_manager.cc:1434] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:13.792725 29066 tablet_bootstrap.cc:492] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:13.795820 29111 raft_consensus.cc:515] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.798141 29111 leader_election.cc:290] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:13.799466 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf928a86b924440b6bfc966df8860b8" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:13.806021 28793 raft_consensus.cc:3060] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.803824 29066 tablet_bootstrap.cc:654] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.805341 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf928a86b924440b6bfc966df8860b8" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:13.807056 29016 raft_consensus.cc:3060] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.816012 29016 raft_consensus.cc:2468] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:13.817443 29065 tablet_bootstrap.cc:654] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.828879 29063 tablet_bootstrap.cc:492] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:13.829757 29063 ts_tablet_manager.cc:1403] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.002s
I20260709 13:09:13.844543 28834 leader_election.cc:304] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:13.845853 29111 raft_consensus.cc:2804] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.846378 29111 raft_consensus.cc:697] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:13.844907 28793 raft_consensus.cc:2468] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:13.847213 29111 consensus_queue.cc:237] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:13.850204 29063 raft_consensus.cc:359] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.850965 29063 raft_consensus.cc:385] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.851223 29063 raft_consensus.cc:740] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.852442 29063 consensus_queue.cc:260] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.859668 29065 tablet_bootstrap.cc:492] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:13.860452 29065 ts_tablet_manager.cc:1403] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.008s
I20260709 13:09:13.861367 29064 tablet_bootstrap.cc:492] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:13.861927 29064 ts_tablet_manager.cc:1403] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.100s	user 0.032s	sys 0.020s
I20260709 13:09:13.863648 29065 raft_consensus.cc:359] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.864516 29065 raft_consensus.cc:385] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.864945 29065 raft_consensus.cc:740] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.865725 29227 raft_consensus.cc:493] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.865749 29065 consensus_queue.cc:260] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.866364 29227 raft_consensus.cc:515] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.868352 29065 ts_tablet_manager.cc:1434] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:09:13.869556 29065 tablet_bootstrap.cc:492] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:13.870580 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ea1e4725643da8ae65abeabbabcd7" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:13.871320 28868 raft_consensus.cc:2468] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:13.871320 29064 raft_consensus.cc:359] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.864660 29063 ts_tablet_manager.cc:1434] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.005s
I20260709 13:09:13.872857 29227 leader_election.cc:290] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:13.872762 28907 leader_election.cc:304] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:13.875037 29063 tablet_bootstrap.cc:492] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:13.876641 29065 tablet_bootstrap.cc:654] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.875083 29227 raft_consensus.cc:2804] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.879009 29227 raft_consensus.cc:493] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.879415 29227 raft_consensus.cc:3060] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.880779 29066 tablet_bootstrap.cc:492] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:13.881297 29066 ts_tablet_manager.cc:1403] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.089s	user 0.029s	sys 0.039s
I20260709 13:09:13.872762 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ea1e4725643da8ae65abeabbabcd7" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:13.884052 29066 raft_consensus.cc:359] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.873958 29064 raft_consensus.cc:385] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.884965 29066 raft_consensus.cc:385] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.885466 29066 raft_consensus.cc:740] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.885295 29064 raft_consensus.cc:740] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.886332 29066 consensus_queue.cc:260] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:13.886567 29064 consensus_queue.cc:260] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:13.888430 29066 ts_tablet_manager.cc:1434] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:13.889480 29066 tablet_bootstrap.cc:492] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:13.892697 29064 ts_tablet_manager.cc:1434] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:09:13.893997 29064 tablet_bootstrap.cc:492] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:13.895581 29066 tablet_bootstrap.cc:654] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.884907 29016 raft_consensus.cc:2468] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:13.897450 29145 consensus_queue.cc:1048] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.912254 29063 tablet_bootstrap.cc:654] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.904292 29227 raft_consensus.cc:515] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:13.926723 29227 leader_election.cc:290] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:13.991336 29064 tablet_bootstrap.cc:654] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.991984 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ea1e4725643da8ae65abeabbabcd7" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:13.993392 28868 raft_consensus.cc:3060] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.996217 29082 raft_consensus.cc:493] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.001987 29063 tablet_bootstrap.cc:492] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:14.002414 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ea1e4725643da8ae65abeabbabcd7" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:14.003180 29063 ts_tablet_manager.cc:1403] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.005s
I20260709 13:09:14.003544 29016 raft_consensus.cc:3060] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.006317 29082 raft_consensus.cc:515] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.016314 29082 leader_election.cc:290] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:14.017558 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3792b36a88e84708afea67ae52341ad1" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:14.025169 28794 raft_consensus.cc:2468] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:14.019341 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3792b36a88e84708afea67ae52341ad1" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:14.027454 28869 raft_consensus.cc:2468] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 0.
I20260709 13:09:14.027272 29145 consensus_queue.cc:1048] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.021157 29076 consensus_queue.cc:1048] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.019142 28943 raft_consensus.cc:3060] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.027174 28910 leader_election.cc:304] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:14.037561 29082 raft_consensus.cc:2804] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.038074 29082 raft_consensus.cc:493] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.038683 29082 raft_consensus.cc:3060] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.041940 29063 raft_consensus.cc:359] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.042790 29063 raft_consensus.cc:385] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.043087 29063 raft_consensus.cc:740] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.043830 29063 consensus_queue.cc:260] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.057847 29063 ts_tablet_manager.cc:1434] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.054s	user 0.012s	sys 0.000s
I20260709 13:09:14.059772 29063 tablet_bootstrap.cc:492] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:14.058805 28689 catalog_manager.cc:5697] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.060254 29147 consensus_queue.cc:1048] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.065876 29066 tablet_bootstrap.cc:492] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:14.066851 29066 ts_tablet_manager.cc:1403] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.178s	user 0.020s	sys 0.017s
I20260709 13:09:14.074436 29082 raft_consensus.cc:515] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.079118 29197 raft_consensus.cc:493] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.065557 29065 tablet_bootstrap.cc:492] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:14.091200 29227 raft_consensus.cc:493] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.092028 29227 raft_consensus.cc:515] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.080109 29197 raft_consensus.cc:515] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.096254 29197 leader_election.cc:290] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:14.089251 29066 raft_consensus.cc:359] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.076038 29063 tablet_bootstrap.cc:654] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.103201 29066 raft_consensus.cc:385] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.103696 29066 raft_consensus.cc:740] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.104377 29066 consensus_queue.cc:260] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.105865 29066 ts_tablet_manager.cc:1434] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:09:14.107380 29076 consensus_queue.cc:1048] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.118363 29066 tablet_bootstrap.cc:492] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:14.119464 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3792b36a88e84708afea67ae52341ad1" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:14.120162 28869 raft_consensus.cc:3060] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.120949 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3792b36a88e84708afea67ae52341ad1" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:14.121709 28791 raft_consensus.cc:3060] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.101076 29082 leader_election.cc:290] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:14.126458 29066 tablet_bootstrap.cc:654] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.121555 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b01fbc7d44a2b2a24b592d256a55" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:14.126470 29065 ts_tablet_manager.cc:1403] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.257s	user 0.029s	sys 0.028s
I20260709 13:09:14.129679 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:14.130892 28790 raft_consensus.cc:2393] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate 7f68815192fc48a58a67ddf2da3bac70 in this term.
I20260709 13:09:14.130975 29065 raft_consensus.cc:359] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.132040 29065 raft_consensus.cc:385] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.132682 29227 leader_election.cc:290] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:14.132738 29082 consensus_queue.cc:1048] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:09:14.132397 29065 raft_consensus.cc:740] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.127251 28795 raft_consensus.cc:2468] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:14.170838 29016 raft_consensus.cc:2468] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:14.172905 29206 raft_consensus.cc:493] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.173795 29206 raft_consensus.cc:515] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.177634 29206 leader_election.cc:290] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:14.182327 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b01fbc7d44a2b2a24b592d256a55" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:14.182576 29206 raft_consensus.cc:493] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.183506 28908 leader_election.cc:304] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:14.184779 29082 raft_consensus.cc:2804] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.185366 29082 raft_consensus.cc:697] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:14.185488 28984 leader_election.cc:304] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:14.185808 29153 raft_consensus.cc:493] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.186825 29256 raft_consensus.cc:2804] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.186482 29082 consensus_queue.cc:237] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.187274 29256 raft_consensus.cc:493] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.187748 29256 raft_consensus.cc:3060] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.189016 28866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b029f39d79fe45a2914c451500924304" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:14.190722 29065 consensus_queue.cc:260] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.183920 29206 raft_consensus.cc:515] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.203555 29065 ts_tablet_manager.cc:1434] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:09:14.186478 29153 raft_consensus.cc:515] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.207922 29153 leader_election.cc:290] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:14.208437 29065 tablet_bootstrap.cc:492] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:14.132774 29197 consensus_queue.cc:1048] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
I20260709 13:09:14.217608 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b029f39d79fe45a2914c451500924304" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:14.226892 29064 tablet_bootstrap.cc:492] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:14.227730 29064 ts_tablet_manager.cc:1403] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.334s	user 0.013s	sys 0.005s
I20260709 13:09:14.227541 29227 consensus_queue.cc:1048] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:09:14.241101 28981 consensus_peers.cc:597] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:14.237272 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:14.248508 29206 leader_election.cc:290] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
W20260709 13:09:14.249274 28981 leader_election.cc:343] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.253197 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6714d660646441d58bea7a912cba0ec8" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:14.258633 29066 tablet_bootstrap.cc:492] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:14.259151 29066 ts_tablet_manager.cc:1403] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.006s
I20260709 13:09:14.264058 29063 tablet_bootstrap.cc:492] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:14.264706 29063 ts_tablet_manager.cc:1403] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.205s	user 0.010s	sys 0.014s
I20260709 13:09:14.266115 28867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6714d660646441d58bea7a912cba0ec8" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:14.269246 28758 leader_election.cc:343] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.271257 29158 consensus_queue.cc:1048] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.273592 29074 raft_consensus.cc:493] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.275501 29197 consensus_queue.cc:1048] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.274801 29074 raft_consensus.cc:515] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.278219 28791 raft_consensus.cc:2468] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:14.279284 29074 leader_election.cc:290] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:14.279688 28910 leader_election.cc:304] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:14.280844 29227 raft_consensus.cc:2804] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.281392 29227 raft_consensus.cc:697] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:14.272948 29016 raft_consensus.cc:2393] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate f3d3a97b01f64816a2a769d159dd64d2 in this term.
I20260709 13:09:14.257251 28868 raft_consensus.cc:2468] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
W20260709 13:09:14.286743 28758 consensus_peers.cc:597] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:14.290028 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:14.290455 29227 consensus_queue.cc:237] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.292919 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:14.294420 29066 raft_consensus.cc:359] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.295320 29066 raft_consensus.cc:385] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.295598 29066 raft_consensus.cc:740] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.297106 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:14.298120 29064 raft_consensus.cc:359] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.298692 29206 consensus_queue.cc:1048] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.302287 29139 consensus_queue.cc:1048] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.300256 29063 raft_consensus.cc:359] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.303531 29063 raft_consensus.cc:385] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.304103 29063 raft_consensus.cc:740] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.305814 29256 raft_consensus.cc:515] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.310634 29064 raft_consensus.cc:385] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.311059 29064 raft_consensus.cc:740] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.296257 29066 consensus_queue.cc:260] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:14.296173 28981 leader_election.cc:343] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.324267 29063 consensus_queue.cc:260] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.308305 29256 leader_election.cc:290] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:14.330381 28981 leader_election.cc:343] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.345623 28981 leader_election.cc:304] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:14.345969 28866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:14.346698 29197 raft_consensus.cc:2749] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.347239 28869 raft_consensus.cc:2468] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
W20260709 13:09:14.333114 28758 leader_election.cc:343] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.348224 28758 leader_election.cc:304] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
W20260709 13:09:14.349255 28759 leader_election.cc:343] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.349076 29230 consensus_queue.cc:1048] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:14.349584 28758 leader_election.cc:343] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.351083 29206 raft_consensus.cc:2749] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.342111 29064 consensus_queue.cc:260] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.360100 28691 catalog_manager.cc:5697] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.366137 28908 leader_election.cc:304] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:14.367581 29230 raft_consensus.cc:3060] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.366370 29065 tablet_bootstrap.cc:654] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.367744 29063 ts_tablet_manager.cc:1434] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.000s
I20260709 13:09:14.376259 29066 ts_tablet_manager.cc:1434] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.001s
I20260709 13:09:14.377745 29064 ts_tablet_manager.cc:1434] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.150s	user 0.005s	sys 0.005s
I20260709 13:09:14.379371 29064 tablet_bootstrap.cc:492] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:14.373277 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b01fbc7d44a2b2a24b592d256a55" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:14.388435 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b01fbc7d44a2b2a24b592d256a55" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:14.389261 28795 raft_consensus.cc:3060] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.408402 29197 raft_consensus.cc:493] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.409163 29197 raft_consensus.cc:515] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.412094 29197 leader_election.cc:290] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:14.414880 28691 catalog_manager.cc:5697] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:14.417207 28981 leader_election.cc:343] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.419226 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:14.419883 28758 leader_election.cc:343] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.420395 28758 leader_election.cc:304] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
W20260709 13:09:14.421727 28758 leader_election.cc:343] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.422222 28758 leader_election.cc:304] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:14.422957 29074 raft_consensus.cc:2749] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.423492 29145 raft_consensus.cc:2749] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.426502 29063 tablet_bootstrap.cc:492] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:14.436033 29064 tablet_bootstrap.cc:654] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:14.441213 28981 leader_election.cc:343] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.443641 29230 raft_consensus.cc:2749] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.449476 29066 tablet_bootstrap.cc:492] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:14.455336 29111 consensus_queue.cc:1048] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.469007 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:14.469708 29065 tablet_bootstrap.cc:492] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:14.470273 29065 ts_tablet_manager.cc:1403] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.262s	user 0.015s	sys 0.011s
I20260709 13:09:14.473311 29065 raft_consensus.cc:359] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.474059 29065 raft_consensus.cc:385] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.474380 29065 raft_consensus.cc:740] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.459806 28795 raft_consensus.cc:2468] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:14.480326 29063 tablet_bootstrap.cc:654] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.483222 29065 consensus_queue.cc:260] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.485849 29065 ts_tablet_manager.cc:1434] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:09:14.487052 29065 tablet_bootstrap.cc:492] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:14.493624 29065 tablet_bootstrap.cc:654] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.511116 29066 tablet_bootstrap.cc:654] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:14.514032 28984 leader_election.cc:343] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.514618 28984 leader_election.cc:304] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:14.518314 29064 tablet_bootstrap.cc:492] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:14.518826 29064 ts_tablet_manager.cc:1403] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.140s	user 0.014s	sys 0.008s
I20260709 13:09:14.524123 29064 raft_consensus.cc:359] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.526382 29064 raft_consensus.cc:385] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.526702 29064 raft_consensus.cc:740] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.519192 29256 raft_consensus.cc:2749] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.540912 29064 consensus_queue.cc:260] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.545802 29064 ts_tablet_manager.cc:1434] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:09:14.548430 28984 leader_election.cc:304] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:14.550072 29197 raft_consensus.cc:2804] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.550910 29197 raft_consensus.cc:697] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:14.551566 29064 tablet_bootstrap.cc:492] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:14.557698 29111 raft_consensus.cc:493] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.552806 29197 consensus_queue.cc:237] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.558602 29111 raft_consensus.cc:515] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.561625 29063 tablet_bootstrap.cc:492] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:14.562494 29063 ts_tablet_manager.cc:1403] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.168s	user 0.011s	sys 0.002s
I20260709 13:09:14.564847 29111 leader_election.cc:290] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:14.565599 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6aa359b7334b7ab7b98c3a741e7402" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:14.567353 29065 tablet_bootstrap.cc:492] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:14.567636 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6aa359b7334b7ab7b98c3a741e7402" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:14.568156 29065 ts_tablet_manager.cc:1403] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.081s	user 0.031s	sys 0.006s
I20260709 13:09:14.566551 29063 raft_consensus.cc:359] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.569015 29063 raft_consensus.cc:385] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.566531 29014 raft_consensus.cc:2468] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:14.568953 28941 raft_consensus.cc:2468] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:14.570760 28834 leader_election.cc:304] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:14.572580 29063 raft_consensus.cc:740] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.572674 29111 raft_consensus.cc:2804] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.573112 29111 raft_consensus.cc:493] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.573479 29111 raft_consensus.cc:3060] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.573454 29063 consensus_queue.cc:260] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.578843 29063 ts_tablet_manager.cc:1434] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:09:14.580070 29063 tablet_bootstrap.cc:492] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:14.593981 29065 raft_consensus.cc:359] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.594743 29065 raft_consensus.cc:385] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.595041 29065 raft_consensus.cc:740] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.595731 29065 consensus_queue.cc:260] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.599742 29063 tablet_bootstrap.cc:654] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:14.600797 28741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:14.601099 29065 ts_tablet_manager.cc:1434] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:09:14.601253 28941 raft_consensus.cc:3060] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.602370 29065 tablet_bootstrap.cc:492] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:14.608974 29066 tablet_bootstrap.cc:492] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:14.609604 29066 ts_tablet_manager.cc:1403] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.160s	user 0.012s	sys 0.011s
I20260709 13:09:14.611310 29065 tablet_bootstrap.cc:654] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.611941 29231 consensus_queue.cc:1048] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.612416 29066 raft_consensus.cc:359] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.613255 29066 raft_consensus.cc:385] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.613521 29066 raft_consensus.cc:740] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.614274 29066 consensus_queue.cc:260] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.616369 29111 raft_consensus.cc:515] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.618894 29066 ts_tablet_manager.cc:1434] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 13:09:14.620288 29066 tablet_bootstrap.cc:492] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:14.628261 29064 tablet_bootstrap.cc:654] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.631593 28693 catalog_manager.cc:5697] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.635988 29066 tablet_bootstrap.cc:654] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.646097 29065 tablet_bootstrap.cc:492] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:14.646807 29065 ts_tablet_manager.cc:1403] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.013s
I20260709 13:09:14.646749 29063 tablet_bootstrap.cc:492] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:14.647930 29063 ts_tablet_manager.cc:1403] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.001s
I20260709 13:09:14.651031 29063 raft_consensus.cc:359] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.651777 29063 raft_consensus.cc:385] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.652056 29063 raft_consensus.cc:740] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.650168 29065 raft_consensus.cc:359] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.652884 29065 raft_consensus.cc:385] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.653153 29065 raft_consensus.cc:740] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.653939 29065 consensus_queue.cc:260] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.655956 29064 tablet_bootstrap.cc:492] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:14.656618 29064 ts_tablet_manager.cc:1403] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.002s
I20260709 13:09:14.656657 29065 ts_tablet_manager.cc:1434] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:09:14.658885 29065 tablet_bootstrap.cc:492] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:14.659446 29066 tablet_bootstrap.cc:492] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:14.659952 29066 ts_tablet_manager.cc:1403] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.011s
I20260709 13:09:14.659591 29064 raft_consensus.cc:359] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.660492 29064 raft_consensus.cc:385] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.660781 29064 raft_consensus.cc:740] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.662118 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6aa359b7334b7ab7b98c3a741e7402" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:14.662745 28943 raft_consensus.cc:3060] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.663094 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6aa359b7334b7ab7b98c3a741e7402" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:14.663738 29017 raft_consensus.cc:3060] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.665177 29063 consensus_queue.cc:260] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.667520 29063 ts_tablet_manager.cc:1434] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.003s
I20260709 13:09:14.669023 29065 tablet_bootstrap.cc:654] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.671307 28943 raft_consensus.cc:2468] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:14.674620 28833 leader_election.cc:304] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:14.675660 29076 raft_consensus.cc:2804] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.675585 29231 consensus_queue.cc:1048] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.676373 29076 raft_consensus.cc:697] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:14.677276 29076 consensus_queue.cc:237] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.680428 29017 raft_consensus.cc:2468] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:14.662729 29066 raft_consensus.cc:359] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.682459 29066 raft_consensus.cc:385] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.683187 29066 raft_consensus.cc:740] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.688593 29111 leader_election.cc:290] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:14.688454 29066 consensus_queue.cc:260] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.688318 29064 consensus_queue.cc:260] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.692229 29064 ts_tablet_manager.cc:1434] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:09:14.689831 29063 tablet_bootstrap.cc:492] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:14.693475 29064 tablet_bootstrap.cc:492] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:14.700212 29064 tablet_bootstrap.cc:654] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.692296 29066 ts_tablet_manager.cc:1434] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:09:14.705066 29066 tablet_bootstrap.cc:492] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:14.706327 29065 tablet_bootstrap.cc:492] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:14.712038 29065 ts_tablet_manager.cc:1403] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.009s
I20260709 13:09:14.714849 29065 raft_consensus.cc:359] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.715534 29065 raft_consensus.cc:385] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.715814 29065 raft_consensus.cc:740] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.715976 29064 tablet_bootstrap.cc:492] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:14.716521 29065 consensus_queue.cc:260] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.718252 29065 ts_tablet_manager.cc:1434] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:14.718860 29063 tablet_bootstrap.cc:654] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.719120 29065 tablet_bootstrap.cc:492] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:14.716542 29064 ts_tablet_manager.cc:1403] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.003s
I20260709 13:09:14.723446 29064 raft_consensus.cc:359] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.724169 29064 raft_consensus.cc:385] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.724506 29064 raft_consensus.cc:740] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.725193 29064 consensus_queue.cc:260] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.725505 29065 tablet_bootstrap.cc:654] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.725564 29066 tablet_bootstrap.cc:654] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.726812 29148 raft_consensus.cc:493] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.727324 29148 raft_consensus.cc:515] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.728510 29064 ts_tablet_manager.cc:1434] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:14.729606 29148 leader_election.cc:290] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:14.729804 29064 tablet_bootstrap.cc:492] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:14.728987 28693 catalog_manager.cc:5697] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.732239 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:14.733886 28758 leader_election.cc:343] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.735019 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:14.736793 29076 raft_consensus.cc:493] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.737174 29064 tablet_bootstrap.cc:654] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:14.736379 28758 leader_election.cc:343] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.737936 28758 leader_election.cc:304] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:14.738818 29074 raft_consensus.cc:2749] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.742957 29111 raft_consensus.cc:493] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.743659 29111 raft_consensus.cc:515] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.737306 29076 raft_consensus.cc:515] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.746690 29076 leader_election.cc:290] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:14.748651 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b029f39d79fe45a2914c451500924304" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:14.749424 28941 raft_consensus.cc:2468] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:14.752298 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f5b8a34d8d42c7958b3e1a2423802c" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:14.753968 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b029f39d79fe45a2914c451500924304" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:14.754794 28791 raft_consensus.cc:2468] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:14.756889 28833 leader_election.cc:304] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:14.757136 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f5b8a34d8d42c7958b3e1a2423802c" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:14.758140 29076 raft_consensus.cc:2804] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.758626 29076 raft_consensus.cc:493] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.758984 29076 raft_consensus.cc:3060] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.760645 28834 leader_election.cc:304] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:14.761698 29250 raft_consensus.cc:2749] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.762388 29111 leader_election.cc:290] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:14.774569 29139 raft_consensus.cc:493] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.775240 29139 raft_consensus.cc:515] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.779770 29066 tablet_bootstrap.cc:492] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:14.780020 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6714d660646441d58bea7a912cba0ec8" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:14.780314 29066 ts_tablet_manager.cc:1403] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.011s
I20260709 13:09:14.780751 29017 raft_consensus.cc:2468] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:14.782354 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6714d660646441d58bea7a912cba0ec8" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:14.783557 29066 raft_consensus.cc:359] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:14.783874 28833 leader_election.cc:343] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.784296 29139 leader_election.cc:290] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:14.784642 28834 leader_election.cc:304] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:14.785858 29139 raft_consensus.cc:2804] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.786232 29139 raft_consensus.cc:493] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.786561 29139 raft_consensus.cc:3060] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.793675 29066 raft_consensus.cc:385] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.794087 29066 raft_consensus.cc:740] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.794785 29066 consensus_queue.cc:260] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.774768 29076 raft_consensus.cc:515] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.797076 29139 raft_consensus.cc:515] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.799567 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b029f39d79fe45a2914c451500924304" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:14.802752 28791 raft_consensus.cc:3060] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.803344 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b029f39d79fe45a2914c451500924304" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:14.803994 28941 raft_consensus.cc:3060] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.804862 29231 raft_consensus.cc:493] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.805378 29231 raft_consensus.cc:515] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.805576 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6714d660646441d58bea7a912cba0ec8" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:14.805765 29139 leader_election.cc:290] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
W20260709 13:09:14.807081 28833 leader_election.cc:343] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.807602 29231 leader_election.cc:290] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:14.800685 29076 leader_election.cc:290] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:14.799338 29066 ts_tablet_manager.cc:1434] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:09:14.809684 29066 tablet_bootstrap.cc:492] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:14.811122 28791 raft_consensus.cc:2468] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:14.812188 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b01fbc7d44a2b2a24b592d256a55" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:14.812695 29139 raft_consensus.cc:493] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.813266 29139 raft_consensus.cc:515] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.814280 28941 raft_consensus.cc:2468] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:14.815418 28833 leader_election.cc:304] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:14.815371 29139 leader_election.cc:290] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:14.810999 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6714d660646441d58bea7a912cba0ec8" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:14.816659 29017 raft_consensus.cc:3060] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.817634 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:14.819074 28833 leader_election.cc:343] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.819456 29063 tablet_bootstrap.cc:492] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:14.819955 29063 ts_tablet_manager.cc:1403] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.152s	user 0.011s	sys 0.000s
I20260709 13:09:14.820868 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:14.821574 28795 raft_consensus.cc:2468] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:14.822844 29063 raft_consensus.cc:359] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.823530 29063 raft_consensus.cc:385] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.823772 29063 raft_consensus.cc:740] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.824501 29063 consensus_queue.cc:260] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.826612 29063 ts_tablet_manager.cc:1434] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:09:14.827693 29063 tablet_bootstrap.cc:492] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:14.828794 29111 raft_consensus.cc:2804] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.829383 29111 raft_consensus.cc:697] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:14.829929 29017 raft_consensus.cc:2468] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:14.830271 29111 consensus_queue.cc:237] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.832406 28836 leader_election.cc:304] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:14.833455 29250 raft_consensus.cc:2804] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.833863 29250 raft_consensus.cc:493] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.834179 29250 raft_consensus.cc:3060] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.835682 29063 tablet_bootstrap.cc:654] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.838212 29064 tablet_bootstrap.cc:492] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:14.838714 29064 ts_tablet_manager.cc:1403] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.019s
I20260709 13:09:14.828604 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b01fbc7d44a2b2a24b592d256a55" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:14.841024 28791 raft_consensus.cc:2393] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate f3d3a97b01f64816a2a769d159dd64d2 in this term.
I20260709 13:09:14.842275 28910 leader_election.cc:304] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:14.843561 29231 raft_consensus.cc:3060] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.850077 29066 tablet_bootstrap.cc:654] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.851963 29065 tablet_bootstrap.cc:492] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:14.852643 29065 ts_tablet_manager.cc:1403] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.134s	user 0.044s	sys 0.026s
I20260709 13:09:14.865016 28834 leader_election.cc:304] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:14.866773 29250 raft_consensus.cc:515] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.867651 29111 raft_consensus.cc:2804] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.873782 29111 raft_consensus.cc:697] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:14.878345 29111 consensus_queue.cc:237] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.881138 29250 leader_election.cc:290] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:14.882359 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:14.881371 28691 catalog_manager.cc:5697] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.883805 29231 raft_consensus.cc:2749] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.884071 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:14.884794 28791 raft_consensus.cc:3060] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.886811 29197 raft_consensus.cc:493] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.887359 29197 raft_consensus.cc:515] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
W20260709 13:09:14.889147 28833 leader_election.cc:343] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.889712 29197 leader_election.cc:290] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:14.891245 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:14.893370 29063 tablet_bootstrap.cc:492] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
W20260709 13:09:14.893563 28984 leader_election.cc:343] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.893944 29063 ts_tablet_manager.cc:1403] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.066s	user 0.027s	sys 0.016s
I20260709 13:09:14.894495 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:14.897354 29065 raft_consensus.cc:359] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.898866 29065 raft_consensus.cc:385] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.899246 29065 raft_consensus.cc:740] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.898001 29063 raft_consensus.cc:359] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.900818 29063 raft_consensus.cc:385] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.900961 29066 tablet_bootstrap.cc:492] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:14.901221 29063 raft_consensus.cc:740] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.901662 29066 ts_tablet_manager.cc:1403] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.003s
I20260709 13:09:14.902331 29063 consensus_queue.cc:260] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:14.899296 28981 leader_election.cc:343] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.905103 29063 ts_tablet_manager.cc:1434] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:14.907755 29231 consensus_queue.cc:1048] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.910590 29066 raft_consensus.cc:359] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.911590 29066 raft_consensus.cc:385] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.911885 29066 raft_consensus.cc:740] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.898347 29064 raft_consensus.cc:359] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.912914 29064 raft_consensus.cc:385] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.913261 29064 raft_consensus.cc:740] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.914948 28981 leader_election.cc:304] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:14.916695 29063 tablet_bootstrap.cc:492] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:14.916870 29255 raft_consensus.cc:2749] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.920972 29066 consensus_queue.cc:260] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.923885 29066 ts_tablet_manager.cc:1434] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:09:14.925273 29066 tablet_bootstrap.cc:492] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:14.928462 29063 tablet_bootstrap.cc:654] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.936733 29148 raft_consensus.cc:493] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.936498 29082 consensus_queue.cc:1048] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.937279 29148 raft_consensus.cc:515] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.939388 29148 leader_election.cc:290] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:14.940989 29065 consensus_queue.cc:260] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:14.950996 29065 ts_tablet_manager.cc:1434] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.001s
I20260709 13:09:14.942308 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:14.944028 28791 raft_consensus.cc:2468] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:14.952320 29065 tablet_bootstrap.cc:492] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
W20260709 13:09:14.952989 28758 leader_election.cc:343] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.953562 28836 leader_election.cc:304] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:14.946372 29066 tablet_bootstrap.cc:654] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.947922 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:14.955435 29017 raft_consensus.cc:2468] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:14.955925 29250 raft_consensus.cc:2804] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.956733 29250 raft_consensus.cc:697] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:14.957823 29250 consensus_queue.cc:237] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.941224 28693 catalog_manager.cc:5697] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.940742 29064 consensus_queue.cc:260] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.963644 29064 ts_tablet_manager.cc:1434] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.002s
I20260709 13:09:14.966476 29063 tablet_bootstrap.cc:492] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:14.967078 29063 ts_tablet_manager.cc:1403] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.007s
I20260709 13:09:14.969034 28759 leader_election.cc:304] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:14.970448 29148 raft_consensus.cc:2804] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.970944 29148 raft_consensus.cc:493] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.971313 29148 raft_consensus.cc:3060] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.972258 29064 tablet_bootstrap.cc:492] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:14.970405 29063 raft_consensus.cc:359] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.977972 29063 raft_consensus.cc:385] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.978310 29063 raft_consensus.cc:740] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.981858 29206 raft_consensus.cc:493] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.982299 29074 raft_consensus.cc:493] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.982465 29206 raft_consensus.cc:515] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:14.982851 29074 raft_consensus.cc:515] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.984959 29206 leader_election.cc:290] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:14.985903 29148 raft_consensus.cc:515] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:14.981637 29063 consensus_queue.cc:260] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:14.986042 29074 leader_election.cc:290] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:14.988828 28867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7caa5ccce9344e3993cdd74c21d6d2d7" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:14.990116 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:14.990927 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7caa5ccce9344e3993cdd74c21d6d2d7" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:14.997321 28758 leader_election.cc:343] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:14.998805 28758 leader_election.cc:343] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.999403 28758 leader_election.cc:304] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:14.999657 29063 ts_tablet_manager.cc:1434] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 13:09:15.001119 29063 tablet_bootstrap.cc:492] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:15.010494 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:15.011351 29017 raft_consensus.cc:2468] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:15.003670 29074 raft_consensus.cc:2749] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:15.004537 28758 leader_election.cc:343] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.013384 28759 leader_election.cc:304] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:15.014065 29148 leader_election.cc:290] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:15.014700 29148 raft_consensus.cc:2804] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.015076 29148 raft_consensus.cc:493] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.015410 29148 raft_consensus.cc:3060] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.015453 29064 tablet_bootstrap.cc:654] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.016171 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
W20260709 13:09:15.017972 28758 leader_election.cc:343] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.019435 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:15.020160 29017 raft_consensus.cc:3060] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.021858 28691 catalog_manager.cc:5697] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.025417 29066 tablet_bootstrap.cc:492] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:15.026048 29066 ts_tablet_manager.cc:1403] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.006s
I20260709 13:09:15.028339 29063 tablet_bootstrap.cc:654] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.029130 29066 raft_consensus.cc:359] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.029878 29066 raft_consensus.cc:385] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.030148 29066 raft_consensus.cc:740] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.025548 29064 tablet_bootstrap.cc:492] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:15.031036 29064 ts_tablet_manager.cc:1403] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.007s
I20260709 13:09:15.030968 29066 consensus_queue.cc:260] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.033234 29066 ts_tablet_manager.cc:1434] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:15.034384 29066 tablet_bootstrap.cc:492] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:15.041752 29066 tablet_bootstrap.cc:654] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.041450 29197 consensus_queue.cc:1048] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.044750 29065 tablet_bootstrap.cc:654] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.051047 29197 raft_consensus.cc:493] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.052157 29197 raft_consensus.cc:515] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.057806 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:15.058027 29197 leader_election.cc:290] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:15.050530 29017 raft_consensus.cc:2468] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:15.058557 28791 raft_consensus.cc:2468] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:15.060271 28984 leader_election.cc:304] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:15.062466 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:15.065975 29197 raft_consensus.cc:2804] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.066458 29197 raft_consensus.cc:493] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.066804 29197 raft_consensus.cc:3060] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:15.068301 28981 leader_election.cc:343] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.069887 29148 raft_consensus.cc:515] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.070171 28759 leader_election.cc:304] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:15.071518 29074 raft_consensus.cc:2804] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.071656 29064 raft_consensus.cc:359] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.072350 29074 raft_consensus.cc:697] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:15.073376 29074 consensus_queue.cc:237] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.078584 29065 tablet_bootstrap.cc:492] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:15.079236 29065 ts_tablet_manager.cc:1403] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.003s
I20260709 13:09:15.072376 29064 raft_consensus.cc:385] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.080154 29064 raft_consensus.cc:740] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.082281 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:15.082479 29065 raft_consensus.cc:359] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:15.083360 29065 raft_consensus.cc:385] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.083690 29065 raft_consensus.cc:740] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.083885 29064 consensus_queue.cc:260] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
W20260709 13:09:15.084293 28758 leader_election.cc:343] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.084714 29255 consensus_queue.cc:1048] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.087493 29064 ts_tablet_manager.cc:1434] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:09:15.088490 29148 leader_election.cc:290] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:15.092144 29063 tablet_bootstrap.cc:492] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:15.093391 29063 ts_tablet_manager.cc:1403] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.002s
I20260709 13:09:15.096511 29063 raft_consensus.cc:359] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.098155 29063 raft_consensus.cc:385] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.098549 29063 raft_consensus.cc:740] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.099291 29063 consensus_queue.cc:260] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.099707 29197 raft_consensus.cc:515] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.101228 29063 ts_tablet_manager.cc:1434] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:09:15.101997 29197 leader_election.cc:290] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:15.102900 29064 tablet_bootstrap.cc:492] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:15.110134 29063 tablet_bootstrap.cc:492] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:15.110327 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:15.111066 28791 raft_consensus.cc:3060] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.112583 29064 tablet_bootstrap.cc:654] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.118160 29063 tablet_bootstrap.cc:654] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.121515 28791 raft_consensus.cc:2468] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:15.123266 28984 leader_election.cc:304] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:15.124663 29255 raft_consensus.cc:2804] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.125264 29255 raft_consensus.cc:697] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:15.126226 29255 consensus_queue.cc:237] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.127696 29064 tablet_bootstrap.cc:492] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:15.129019 29197 raft_consensus.cc:493] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.129647 29197 raft_consensus.cc:515] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.132777 29197 leader_election.cc:290] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:15.133706 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:15.128360 29064 ts_tablet_manager.cc:1403] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 13:09:15.134694 28795 raft_consensus.cc:2468] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:15.136693 28984 leader_election.cc:304] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:15.137737 29197 raft_consensus.cc:2804] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:15.138257 29197 raft_consensus.cc:493] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.138651 29197 raft_consensus.cc:3060] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.141875 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:15.142625 29017 raft_consensus.cc:3060] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.151077 29017 raft_consensus.cc:2468] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:15.155076 29148 raft_consensus.cc:493] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.155654 29148 raft_consensus.cc:515] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.156777 29066 tablet_bootstrap.cc:492] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:15.157379 29066 ts_tablet_manager.cc:1403] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.123s	user 0.029s	sys 0.033s
I20260709 13:09:15.161870 29066 raft_consensus.cc:359] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.162670 29066 raft_consensus.cc:385] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.163515 29066 raft_consensus.cc:740] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.161875 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:15.164747 28941 raft_consensus.cc:2468] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:15.164408 29066 consensus_queue.cc:260] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.163018 29206 raft_consensus.cc:493] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.166077 29206 raft_consensus.cc:515] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.167567 29066 ts_tablet_manager.cc:1434] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:09:15.168834 29066 tablet_bootstrap.cc:492] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:15.161876 29254 raft_consensus.cc:493] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.170949 29254 raft_consensus.cc:515] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:15.169735 28691 catalog_manager.cc:5697] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.167479 29064 raft_consensus.cc:359] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.173105 29064 raft_consensus.cc:385] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.173259 29254 leader_election.cc:290] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:15.174840 29066 tablet_bootstrap.cc:654] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.175187 28867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:15.162079 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:15.180235 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:15.181941 29206 leader_election.cc:290] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:15.186695 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:15.188200 28793 raft_consensus.cc:2393] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate 89867186bb4546988c8fcd2b9fea8757 in this term.
I20260709 13:09:15.190707 28910 leader_election.cc:304] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:15.191939 29254 raft_consensus.cc:3060] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.189136 29148 leader_election.cc:290] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
W20260709 13:09:15.194948 28758 leader_election.cc:343] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.196327 29064 raft_consensus.cc:740] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.197268 29064 consensus_queue.cc:260] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.197142 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:15.202343 28758 leader_election.cc:343] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.204378 29064 ts_tablet_manager.cc:1434] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:09:15.206349 29064 tablet_bootstrap.cc:492] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:15.208546 29063 tablet_bootstrap.cc:492] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:15.210507 29063 ts_tablet_manager.cc:1403] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.101s	user 0.031s	sys 0.011s
I20260709 13:09:15.213768 29063 raft_consensus.cc:359] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.214540 29063 raft_consensus.cc:385] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.214823 29063 raft_consensus.cc:740] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.215481 29063 consensus_queue.cc:260] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.215914 29064 tablet_bootstrap.cc:654] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.171116 29197 raft_consensus.cc:515] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.224485 29312 raft_consensus.cc:493] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.224788 28759 leader_election.cc:304] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:15.225075 29312 raft_consensus.cc:515] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.226118 29148 raft_consensus.cc:2804] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.226622 29148 raft_consensus.cc:697] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:15.227458 29148 consensus_queue.cc:237] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.227843 29312 leader_election.cc:290] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:15.229468 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d9475e96d74d868e148f76bccfb047" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:15.235641 28793 raft_consensus.cc:2468] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:15.234928 29063 ts_tablet_manager.cc:1434] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:15.237272 29063 tablet_bootstrap.cc:492] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:15.238166 28984 leader_election.cc:304] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:15.239456 29255 raft_consensus.cc:2804] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.228506 29065 consensus_queue.cc:260] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:15.240023 29255 raft_consensus.cc:493] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.240200 29139 raft_consensus.cc:493] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.240913 29139 raft_consensus.cc:515] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:15.240646 29255 raft_consensus.cc:3060] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.234543 29111 consensus_queue.cc:1048] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:15.246500 29139 leader_election.cc:290] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:15.247668 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:15.247960 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:15.248438 28791 raft_consensus.cc:2468] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:15.249486 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:15.249665 29111 consensus_queue.cc:1048] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.249850 28836 leader_election.cc:304] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:15.250391 29017 raft_consensus.cc:2468] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:15.251178 29111 raft_consensus.cc:2804] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.251629 29111 raft_consensus.cc:493] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.251995 29111 raft_consensus.cc:3060] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.252425 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
W20260709 13:09:15.254245 28833 leader_election.cc:343] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.253317 29017 raft_consensus.cc:2468] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:15.258567 29250 consensus_queue.cc:1048] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.264117 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:15.264951 28791 raft_consensus.cc:3060] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.267056 29250 raft_consensus.cc:493] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.268689 29250 raft_consensus.cc:515] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.271754 29250 leader_election.cc:290] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:15.274016 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bbc69d44e948e7b6f3a85ea80aec7e" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:15.277832 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bbc69d44e948e7b6f3a85ea80aec7e" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:15.233915 29254 raft_consensus.cc:2749] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.279678 29017 raft_consensus.cc:2468] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:15.284760 28834 leader_election.cc:304] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:15.279717 29064 tablet_bootstrap.cc:492] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:15.287086 29250 raft_consensus.cc:2804] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.291332 29250 raft_consensus.cc:493] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.291812 29250 raft_consensus.cc:3060] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.288897 28791 raft_consensus.cc:2468] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 2.
I20260709 13:09:15.300036 28984 leader_election.cc:304] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:15.301082 29312 raft_consensus.cc:2804] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:15.301534 29255 raft_consensus.cc:515] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.301692 29312 raft_consensus.cc:697] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:15.303216 29312 consensus_queue.cc:237] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.308035 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d9475e96d74d868e148f76bccfb047" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:15.302042 29063 tablet_bootstrap.cc:654] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.308804 28795 raft_consensus.cc:3060] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.303644 29111 raft_consensus.cc:515] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:15.303821 29255 leader_election.cc:290] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:15.314083 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:15.314853 28790 raft_consensus.cc:3060] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.318729 28795 raft_consensus.cc:2468] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:15.324401 28870 raft_consensus.cc:3060] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.331179 28790 raft_consensus.cc:2468] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:15.322194 28984 leader_election.cc:304] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:15.338454 29255 raft_consensus.cc:2804] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.289680 28943 raft_consensus.cc:3060] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.337311 28836 leader_election.cc:304] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:15.341648 29139 raft_consensus.cc:2804] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.342396 29139 raft_consensus.cc:697] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:15.343286 29139 consensus_queue.cc:237] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:15.286921 28833 leader_election.cc:343] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.291394 29064 ts_tablet_manager.cc:1403] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.003s
W20260709 13:09:15.345224 28833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40509, user_credentials={real_user=slave}} blocked reactor thread for 58358.5us
I20260709 13:09:15.346752 29076 consensus_queue.cc:1048] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.347666 29064 raft_consensus.cc:359] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.348987 29064 raft_consensus.cc:385] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.349308 29064 raft_consensus.cc:740] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.359014 29064 consensus_queue.cc:260] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.362440 29064 ts_tablet_manager.cc:1434] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:09:15.362604 29111 leader_election.cc:290] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:15.365515 29064 tablet_bootstrap.cc:492] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:15.307742 29250 raft_consensus.cc:515] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.367626 29231 raft_consensus.cc:493] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.368353 29231 raft_consensus.cc:515] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.371598 29231 leader_election.cc:290] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:15.373202 29063 tablet_bootstrap.cc:492] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:15.373837 29250 leader_election.cc:290] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
W20260709 13:09:15.296162 28981 leader_election.cc:343] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.374557 29063 ts_tablet_manager.cc:1403] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.000s
W20260709 13:09:15.374858 28981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 78731.3us
I20260709 13:09:15.298065 29197 leader_election.cc:290] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:15.339052 29255 raft_consensus.cc:697] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:15.376570 29250 consensus_queue.cc:1048] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.376910 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bbc69d44e948e7b6f3a85ea80aec7e" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:15.377682 29013 raft_consensus.cc:3060] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.379693 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:15.385258 29063 raft_consensus.cc:359] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.386145 29063 raft_consensus.cc:385] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.388276 29063 raft_consensus.cc:740] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.388360 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:15.389251 29063 consensus_queue.cc:260] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.376940 29255 consensus_queue.cc:237] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.402209 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bbc69d44e948e7b6f3a85ea80aec7e" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:15.415207 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:15.416147 29015 raft_consensus.cc:2393] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate 7f68815192fc48a58a67ddf2da3bac70 in this term.
I20260709 13:09:15.421077 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d9475e96d74d868e148f76bccfb047" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:15.424032 29064 tablet_bootstrap.cc:654] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:15.424571 28833 leader_election.cc:343] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:15.425949 28833 leader_election.cc:343] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.428241 28759 leader_election.cc:304] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:15.430045 29074 raft_consensus.cc:2804] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.430482 29074 raft_consensus.cc:493] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.445073 29063 ts_tablet_manager.cc:1434] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.003s
W20260709 13:09:15.448341 28981 leader_election.cc:343] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.441783 28759 leader_election.cc:304] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:15.454866 29148 raft_consensus.cc:2804] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.455299 29148 raft_consensus.cc:493] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.443984 29074 raft_consensus.cc:3060] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.455672 29148 raft_consensus.cc:3060] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.459112 28691 catalog_manager.cc:5697] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.450913 28693 catalog_manager.cc:5697] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.471220 29065 ts_tablet_manager.cc:1434] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.392s	user 0.011s	sys 0.001s
I20260709 13:09:15.475206 29065 tablet_bootstrap.cc:492] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:15.451444 28908 leader_election.cc:304] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
W20260709 13:09:15.472923 29318 log.cc:927] Time spent T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:09:15.476811 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d9475e96d74d868e148f76bccfb047" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:15.477541 29231 raft_consensus.cc:3060] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.471118 29063 tablet_bootstrap.cc:492] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
W20260709 13:09:15.484957 28981 leader_election.cc:343] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.470600 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45159667ba6f4b919ff80fa9d04e360e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:15.517627 29066 tablet_bootstrap.cc:492] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:15.518311 29066 ts_tablet_manager.cc:1403] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.350s	user 0.087s	sys 0.136s
I20260709 13:09:15.503168 29255 raft_consensus.cc:493] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.509249 28944 raft_consensus.cc:3060] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.509231 29111 consensus_queue.cc:1048] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:09:15.519537 29013 raft_consensus.cc:2468] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:15.538048 29074 raft_consensus.cc:515] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.540899 29066 raft_consensus.cc:359] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.541649 29066 raft_consensus.cc:385] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.541940 29066 raft_consensus.cc:740] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.542594 29066 consensus_queue.cc:260] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.551126 29065 tablet_bootstrap.cc:654] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.551294 29231 raft_consensus.cc:2749] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:15.547482 28833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40509, user_credentials={real_user=slave}} blocked reactor thread for 51444.9us
I20260709 13:09:15.562309 29064 tablet_bootstrap.cc:492] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:15.565394 29064 ts_tablet_manager.cc:1403] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.200s	user 0.018s	sys 0.024s
I20260709 13:09:15.524261 29255 raft_consensus.cc:515] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.573743 29255 leader_election.cc:290] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
W20260709 13:09:15.585438 28758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 52715.2us
I20260709 13:09:15.588402 29063 tablet_bootstrap.cc:654] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.615463 29074 leader_election.cc:290] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:15.623250 29064 raft_consensus.cc:359] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.625021 29064 raft_consensus.cc:385] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.625502 29064 raft_consensus.cc:740] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.630568 29066 ts_tablet_manager.cc:1434] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.112s	user 0.019s	sys 0.018s
I20260709 13:09:15.603691 29148 raft_consensus.cc:515] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.634294 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3b31ed6f204a71a8ac57ddbc19e662" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:15.635079 28942 raft_consensus.cc:2468] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:15.636497 29254 raft_consensus.cc:493] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.637077 29254 raft_consensus.cc:515] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.638130 28867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3b31ed6f204a71a8ac57ddbc19e662" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:15.646379 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:15.633571 29064 consensus_queue.cc:260] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.655462 29066 tablet_bootstrap.cc:492] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:15.652041 28981 leader_election.cc:304] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:15.661597 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
W20260709 13:09:15.664911 28758 leader_election.cc:343] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.652609 29013 raft_consensus.cc:3060] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.668251 29064 ts_tablet_manager.cc:1434] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.001s
I20260709 13:09:15.671773 29340 consensus_queue.cc:1048] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:15.667800 28981 leader_election.cc:343] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:15.676259 28981 consensus_peers.cc:597] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.646432 28834 leader_election.cc:304] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:15.666949 29328 raft_consensus.cc:2804] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.684633 29250 raft_consensus.cc:2804] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.685273 29250 raft_consensus.cc:697] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:15.686224 29250 consensus_queue.cc:237] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.682302 29328 raft_consensus.cc:493] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.692262 29328 raft_consensus.cc:3060] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.694082 29063 tablet_bootstrap.cc:492] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:15.694972 29063 ts_tablet_manager.cc:1403] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.235s	user 0.018s	sys 0.000s
I20260709 13:09:15.698879 29064 tablet_bootstrap.cc:492] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
W20260709 13:09:15.681802 28984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 48726.1us
I20260709 13:09:15.701591 28944 raft_consensus.cc:2468] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 2.
I20260709 13:09:15.711410 29254 leader_election.cc:290] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:15.711897 29065 tablet_bootstrap.cc:492] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:15.721764 29065 ts_tablet_manager.cc:1403] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.247s	user 0.015s	sys 0.004s
I20260709 13:09:15.718904 29111 consensus_queue.cc:1048] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.723520 29148 leader_election.cc:290] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:15.724803 29065 raft_consensus.cc:359] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.725713 29065 raft_consensus.cc:385] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.726006 29065 raft_consensus.cc:740] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
W20260709 13:09:15.736140 28758 consensus_peers.cc:597] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.740370 29065 consensus_queue.cc:260] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.752437 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:15.753425 29017 raft_consensus.cc:3060] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.770339 29066 tablet_bootstrap.cc:654] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.795241 29065 ts_tablet_manager.cc:1434] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.073s	user 0.003s	sys 0.006s
I20260709 13:09:15.804342 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6714d660646441d58bea7a912cba0ec8" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:15.806308 29013 raft_consensus.cc:2468] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:15.807578 28867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:15.798702 29255 raft_consensus.cc:493] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.813035 29255 raft_consensus.cc:515] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.815224 29255 leader_election.cc:290] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:15.816066 29017 raft_consensus.cc:2468] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:15.816941 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:15.818331 28867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:15.789470 29250 consensus_queue.cc:1048] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:09:15.819339 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6714d660646441d58bea7a912cba0ec8" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:15.806552 29063 raft_consensus.cc:359] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.826653 29063 raft_consensus.cc:385] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.826925 29063 raft_consensus.cc:740] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.827426 28943 raft_consensus.cc:1275] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer f3d3a97b01f64816a2a769d159dd64d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:15.827759 29063 consensus_queue.cc:260] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.829945 29343 consensus_queue.cc:1048] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.832643 29063 ts_tablet_manager.cc:1434] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.137s	user 0.007s	sys 0.001s
I20260709 13:09:15.833734 29065 tablet_bootstrap.cc:492] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:15.838420 29064 tablet_bootstrap.cc:654] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.850566 29065 tablet_bootstrap.cc:654] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.843355 29328 raft_consensus.cc:515] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:15.861763 29328 leader_election.cc:290] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:15.862289 29066 tablet_bootstrap.cc:492] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:15.862957 29066 ts_tablet_manager.cc:1403] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.215s	user 0.019s	sys 0.015s
I20260709 13:09:15.866758 29066 raft_consensus.cc:359] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:15.869225 29066 raft_consensus.cc:385] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.869611 29066 raft_consensus.cc:740] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.870409 29066 consensus_queue.cc:260] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:15.872310 29065 tablet_bootstrap.cc:492] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:15.872994 29066 ts_tablet_manager.cc:1434] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:09:15.873116 29065 ts_tablet_manager.cc:1403] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.000s
W20260709 13:09:15.874404 28758 leader_election.cc:343] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.875180 29066 tablet_bootstrap.cc:492] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:15.877943 29065 raft_consensus.cc:359] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.878809 29065 raft_consensus.cc:385] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.879130 29065 raft_consensus.cc:740] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.880002 29065 consensus_queue.cc:260] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.883847 29066 tablet_bootstrap.cc:654] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.883831 29064 tablet_bootstrap.cc:492] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:15.885248 29064 ts_tablet_manager.cc:1403] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.206s	user 0.018s	sys 0.000s
I20260709 13:09:15.886385 28790 raft_consensus.cc:1275] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Refusing update from remote peer f3d3a97b01f64816a2a769d159dd64d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:15.890017 29328 consensus_queue.cc:1048] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.892289 29066 tablet_bootstrap.cc:492] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:15.893211 29066 ts_tablet_manager.cc:1403] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 13:09:15.896559 29066 raft_consensus.cc:359] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:15.897289 29066 raft_consensus.cc:385] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.901746 29343 raft_consensus.cc:493] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.902503 29343 raft_consensus.cc:515] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:15.981334 29063 tablet_bootstrap.cc:492] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:16.069245 29343 leader_election.cc:290] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:16.316022 29063 tablet_bootstrap.cc:654] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.320398 29148 raft_consensus.cc:493] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.321166 29148 raft_consensus.cc:515] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:16.323370 29148 leader_election.cc:290] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:16.326488 29065 ts_tablet_manager.cc:1434] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.452s	user 0.008s	sys 0.000s
I20260709 13:09:16.327678 29065 tablet_bootstrap.cc:492] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:16.330605 29063 tablet_bootstrap.cc:492] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:16.331255 29063 ts_tablet_manager.cc:1403] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.350s	user 0.011s	sys 0.006s
I20260709 13:09:16.334355 29063 raft_consensus.cc:359] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:16.334909 29065 tablet_bootstrap.cc:654] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.897594 29066 raft_consensus.cc:740] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.335728 29066 consensus_queue.cc:260] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:16.337798 29066 ts_tablet_manager.cc:1434] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.444s	user 0.007s	sys 0.000s
I20260709 13:09:16.338418 29328 consensus_queue.cc:1048] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:16.340133 29063 raft_consensus.cc:385] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.340490 29063 raft_consensus.cc:740] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.338986 29066 tablet_bootstrap.cc:492] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:16.342433 29063 consensus_queue.cc:260] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:16.349443 29066 tablet_bootstrap.cc:654] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.355014 29327 raft_consensus.cc:493] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.355660 29327 raft_consensus.cc:515] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:16.360193 29063 ts_tablet_manager.cc:1434] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:09:16.361292 29063 tablet_bootstrap.cc:492] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:16.358038 29327 leader_election.cc:290] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:16.367403 28789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0358f1bde5044224a2fb9711b1f990b6" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:16.368214 28788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d918ac438d8147cb8488b64ab616301e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:16.369086 28788 raft_consensus.cc:2468] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:16.368245 28789 raft_consensus.cc:2468] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:16.382946 29063 tablet_bootstrap.cc:654] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.385896 28984 leader_election.cc:304] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:16.387173 28984 leader_election.cc:304] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:16.388110 29343 raft_consensus.cc:2804] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.388614 29343 raft_consensus.cc:493] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.390096 29327 raft_consensus.cc:2804] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.396831 29343 raft_consensus.cc:3060] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.402387 29065 tablet_bootstrap.cc:492] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:16.403221 29066 tablet_bootstrap.cc:492] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:16.404933 29065 ts_tablet_manager.cc:1403] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.004s
I20260709 13:09:16.404948 29066 ts_tablet_manager.cc:1403] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.005s
I20260709 13:09:16.398064 29327 raft_consensus.cc:493] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.407790 29065 raft_consensus.cc:359] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:16.408882 29066 raft_consensus.cc:359] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:16.408550 29065 raft_consensus.cc:385] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.409667 29066 raft_consensus.cc:385] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.409730 29065 raft_consensus.cc:740] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.410018 29066 raft_consensus.cc:740] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.410578 29065 consensus_queue.cc:260] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:16.410657 29066 consensus_queue.cc:260] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:16.408170 29327 raft_consensus.cc:3060] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.412880 29066 ts_tablet_manager.cc:1434] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:16.412899 29065 ts_tablet_manager.cc:1434] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:16.414137 29065 tablet_bootstrap.cc:492] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:16.414137 29066 tablet_bootstrap.cc:492] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:16.421130 29066 tablet_bootstrap.cc:654] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.421130 29065 tablet_bootstrap.cc:654] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.423461 29343 raft_consensus.cc:515] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:16.426718 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0358f1bde5044224a2fb9711b1f990b6" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:16.427554 28790 raft_consensus.cc:3060] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.430627 29343 leader_election.cc:290] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:16.431133 29063 tablet_bootstrap.cc:492] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:16.431931 29063 ts_tablet_manager.cc:1403] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.007s
I20260709 13:09:16.434015 29327 raft_consensus.cc:515] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:16.434831 29063 raft_consensus.cc:359] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:16.435593 29063 raft_consensus.cc:385] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.437623 29063 raft_consensus.cc:740] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.438465 29063 consensus_queue.cc:260] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:16.440541 29063 ts_tablet_manager.cc:1434] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:09:16.441821 29063 tablet_bootstrap.cc:492] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:16.444340 29327 leader_election.cc:290] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:16.447607 28787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d918ac438d8147cb8488b64ab616301e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:16.448436 28790 raft_consensus.cc:2468] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:16.448372 28787 raft_consensus.cc:3060] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.449993 29065 tablet_bootstrap.cc:492] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:16.450537 29065 ts_tablet_manager.cc:1403] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.006s
I20260709 13:09:16.450603 28984 leader_election.cc:304] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:16.452389 29343 raft_consensus.cc:2804] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.453336 29343 raft_consensus.cc:697] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:16.453474 29065 raft_consensus.cc:359] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:16.454195 29065 raft_consensus.cc:385] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.454485 29065 raft_consensus.cc:740] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.455226 29065 consensus_queue.cc:260] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:16.457454 29065 ts_tablet_manager.cc:1434] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:16.455715 29343 consensus_queue.cc:237] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:16.459693 29063 tablet_bootstrap.cc:654] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.461006 29066 tablet_bootstrap.cc:492] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:16.463433 28787 raft_consensus.cc:2468] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:16.465325 28984 leader_election.cc:304] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:16.466352 29343 raft_consensus.cc:2804] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.466709 29063 tablet_bootstrap.cc:492] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:16.467007 29343 raft_consensus.cc:697] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:16.467233 29063 ts_tablet_manager.cc:1403] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.026s	user 0.003s	sys 0.007s
I20260709 13:09:16.468068 29343 consensus_queue.cc:237] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
W20260709 13:09:16.469280 28981 leader_election.cc:343] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.476293 29066 ts_tablet_manager.cc:1403] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.014s
W20260709 13:09:16.478219 28907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 651857us
I20260709 13:09:16.477111 29063 raft_consensus.cc:359] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:16.479015 29063 raft_consensus.cc:385] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.479343 29063 raft_consensus.cc:740] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.479646 29066 raft_consensus.cc:359] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:16.482234 29064 raft_consensus.cc:359] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:16.483060 29064 raft_consensus.cc:385] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.483345 29064 raft_consensus.cc:740] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.486850 29327 consensus_queue.cc:1048] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:16.494464 28833 consensus_peers.cc:597] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.488548 29063 consensus_queue.cc:260] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:16.499930 29063 ts_tablet_manager.cc:1434] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:09:16.501138 29063 tablet_bootstrap.cc:492] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:16.506552 29336 raft_consensus.cc:493] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.507201 29336 raft_consensus.cc:515] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:16.512079 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d918ac438d8147cb8488b64ab616301e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:16.513792 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3b31ed6f204a71a8ac57ddbc19e662" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:16.514537 28935 raft_consensus.cc:3060] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:16.518043 28981 leader_election.cc:343] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.518253 28938 raft_consensus.cc:3060] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.523310 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d918ac438d8147cb8488b64ab616301e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:16.484105 29064 consensus_queue.cc:260] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:16.529182 29336 leader_election.cc:290] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:16.536868 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0358f1bde5044224a2fb9711b1f990b6" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:16.559579 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0358f1bde5044224a2fb9711b1f990b6" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:16.568269 29064 ts_tablet_manager.cc:1434] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.683s	user 0.008s	sys 0.000s
W20260709 13:09:16.568743 29064 ts_tablet_manager.cc:1467] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290: Tablet startup took 683ms
W20260709 13:09:16.569075 29064 ts_tablet_manager.cc:1469] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290: Trace:
0709 13:09:10.959143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.959269 (+   126us) service_pool.cc:224] Handling call
0709 13:09:10.961079 (+  1810us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:10.961225 (+   146us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:11.161156 (+199931us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:11.262634 (+101478us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:11.263132 (+   498us) inbound_call.cc:177] Queueing success response
0709 13:09:15.675722 (+4412590us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:09:15.885683 (+209961us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:09:15.886401 (+   718us) tablet_replica.cc:261] Starting instrumentation
0709 13:09:15.887082 (+   681us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":593181,"raft.queue_time_us":537,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"tablet-open.queue_time_us":4412708}
I20260709 13:09:16.571605 29064 tablet_bootstrap.cc:492] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:16.578378 29356 raft_consensus.cc:493] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.579036 29356 raft_consensus.cc:515] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:16.581732 29360 consensus_queue.cc:1048] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.588188 29356 leader_election.cc:290] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:16.603217 29373 raft_consensus.cc:493] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.603843 29373 raft_consensus.cc:515] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:16.606217 29373 leader_election.cc:290] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
W20260709 13:09:16.609763 28759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:46467, user_credentials={real_user=slave}} blocked reactor thread for 82134.7us
I20260709 13:09:16.610720 28759 leader_election.cc:304] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:16.612033 28759 leader_election.cc:304] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:16.633082 28870 raft_consensus.cc:3060] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.618950 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d9475e96d74d868e148f76bccfb047" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:16.656303 29381 raft_consensus.cc:2804] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.661000 29381 raft_consensus.cc:697] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:16.729390 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:16.730356 28791 raft_consensus.cc:2393] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate 89867186bb4546988c8fcd2b9fea8757 in this term.
W20260709 13:09:16.662653 28836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 81376.2us
W20260709 13:09:16.663007 28833 consensus_peers.cc:597] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.731797 28833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40509, user_credentials={real_user=slave}} blocked reactor thread for 77698.3us
I20260709 13:09:16.761936 29381 consensus_queue.cc:237] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:16.774866 29378 raft_consensus.cc:493] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.775456 29378 raft_consensus.cc:515] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:16.775893 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
W20260709 13:09:16.783592 28758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 120250us
W20260709 13:09:16.785655 28758 leader_election.cc:343] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.786913 28935 raft_consensus.cc:2468] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:16.785960 29383 raft_consensus.cc:2804] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:16.794323 28908 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:46467, user_credentials={real_user=slave}} blocked reactor thread for 60412.1us
I20260709 13:09:16.820302 29378 leader_election.cc:290] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:16.823452 29360 raft_consensus.cc:493] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.824254 29360 raft_consensus.cc:515] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:16.832297 29360 leader_election.cc:290] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:16.833334 29360 raft_consensus.cc:493] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.841194 28758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 52256us
I20260709 13:09:16.842383 29063 tablet_bootstrap.cc:654] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.841816 29360 raft_consensus.cc:515] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:16.855708 29363 raft_consensus.cc:493] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:16.856354 29363 raft_consensus.cc:515] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:16.858541 29363 leader_election.cc:290] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:16.860606 29393 consensus_queue.cc:1048] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 13:09:16.868330 28741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:16.869236 28935 raft_consensus.cc:3060] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.872211 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:16.882632 29383 raft_consensus.cc:697] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:16.896881 29386 raft_consensus.cc:493] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:16.879523 28907 leader_election.cc:304] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:16.897451 29386 raft_consensus.cc:515] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:16.480489 29066 raft_consensus.cc:385] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.909042 29066 raft_consensus.cc:740] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.883926 29383 consensus_queue.cc:237] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:16.918906 29360 leader_election.cc:290] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:16.921675 29386 leader_election.cc:290] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:16.923893 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
W20260709 13:09:16.924742 28907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 55286.1us
I20260709 13:09:16.903362 29381 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:16.925671 29381 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:16.928047 29381 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:16.932978 28938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:16.909950 29066 consensus_queue.cc:260] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:16.911361 29373 raft_consensus.cc:2749] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.932265 29395 raft_consensus.cc:493] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.949615 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3b31ed6f204a71a8ac57ddbc19e662" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.002394 28941 raft_consensus.cc:2393] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89867186bb4546988c8fcd2b9fea8757 in current term 1: Already voted for candidate f3d3a97b01f64816a2a769d159dd64d2 in this term.
I20260709 13:09:17.003413 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7caa5ccce9344e3993cdd74c21d6d2d7" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.003970 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7caa5ccce9344e3993cdd74c21d6d2d7" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.004206 28794 raft_consensus.cc:2468] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:16.986958 29066 ts_tablet_manager.cc:1434] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.510s	user 0.020s	sys 0.013s
I20260709 13:09:16.989092 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:17.005735 29066 ts_tablet_manager.cc:1467] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Tablet startup took 528ms
W20260709 13:09:17.006053 29066 ts_tablet_manager.cc:1469] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Trace:
0709 13:09:11.493140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.493340 (+   200us) service_pool.cc:224] Handling call
0709 13:09:11.495272 (+  1932us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:11.495384 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:11.578539 (+ 83155us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:11.633305 (+ 54766us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:11.633751 (+   446us) inbound_call.cc:177] Queueing success response
0709 13:09:16.413729 (+4779978us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:09:16.476806 (+ 63077us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:09:16.477450 (+   644us) tablet_replica.cc:261] Starting instrumentation
0709 13:09:16.478023 (+   573us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":2406,"tablet-open.queue_time_us":4780043}
I20260709 13:09:17.003468 29395 raft_consensus.cc:515] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.011636 29395 leader_election.cc:290] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:16.993309 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.013096 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:17.008323 29066 tablet_bootstrap.cc:492] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:17.017560 28833 leader_election.cc:343] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.039306 29066 tablet_bootstrap.cc:654] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.125801 29385 raft_consensus.cc:493] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.126485 29395 raft_consensus.cc:493] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.127058 29395 raft_consensus.cc:515] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:17.129169 29395 leader_election.cc:290] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:17.134419 29392 raft_consensus.cc:493] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3d3a97b01f64816a2a769d159dd64d2)
I20260709 13:09:17.138144 29392 raft_consensus.cc:515] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.134449 28836 leader_election.cc:304] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
W20260709 13:09:17.141656 29390 log.cc:927] Time spent T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: Append to log took a long time: real 0.297s	user 0.005s	sys 0.000s
I20260709 13:09:17.143970 29379 raft_consensus.cc:2804] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.144546 29379 raft_consensus.cc:493] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.144920 29379 raft_consensus.cc:3060] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.156641 29392 leader_election.cc:290] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:17.158054 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.165602 29064 tablet_bootstrap.cc:654] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.126515 29385 raft_consensus.cc:515] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:17.165508 29343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.024s	sys 0.038s
W20260709 13:09:17.175071 28981 leader_election.cc:343] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:17.174299 29343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.025s	sys 0.039s
I20260709 13:09:17.192682 29397 raft_consensus.cc:493] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3d3a97b01f64816a2a769d159dd64d2)
I20260709 13:09:17.193349 29397 raft_consensus.cc:515] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:17.195688 29397 leader_election.cc:290] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:17.203780 28863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0358f1bde5044224a2fb9711b1f990b6" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:17.204336 29065 tablet_bootstrap.cc:492] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:17.208869 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3b31ed6f204a71a8ac57ddbc19e662" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:17.209630 28868 raft_consensus.cc:3060] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.213119 28865 raft_consensus.cc:3060] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.215689 29250 raft_consensus.cc:493] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:17.216370 29250 raft_consensus.cc:515] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.217684 28867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0358f1bde5044224a2fb9711b1f990b6" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.218670 29250 leader_election.cc:290] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:17.220645 29327 consensus_queue.cc:1048] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:17.225229 28759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.011s	sys 0.047s
W20260709 13:09:17.225777 28759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.011s	sys 0.047s
W20260709 13:09:17.226488 28759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:46467, user_credentials={real_user=slave}} blocked reactor thread for 614500us
I20260709 13:09:17.226552 28981 leader_election.cc:304] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:17.227842 29399 raft_consensus.cc:2804] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.229465 29399 raft_consensus.cc:697] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:17.227859 29376 consensus_queue.cc:1048] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:17.232376 29327 raft_consensus.cc:493] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:17.220745 28861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.233206 29327 raft_consensus.cc:515] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:17.237066 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3792b36a88e84708afea67ae52341ad1" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.247030 29385 leader_election.cc:290] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:17.252429 28787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c712a67162406ba7f28ef7f9b396b9" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.252947 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3792b36a88e84708afea67ae52341ad1" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.257800 29327 leader_election.cc:290] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:17.230487 29399 consensus_queue.cc:237] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
W20260709 13:09:17.259377 28981 leader_election.cc:343] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.254575 29063 tablet_bootstrap.cc:492] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
W20260709 13:09:17.170897 28984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 193760us
I20260709 13:09:17.270613 29063 ts_tablet_manager.cc:1403] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.770s	user 0.020s	sys 0.021s
I20260709 13:09:17.271380 28981 leader_election.cc:304] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
W20260709 13:09:17.273242 28981 leader_election.cc:343] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.277770 29066 tablet_bootstrap.cc:492] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:17.278348 29066 ts_tablet_manager.cc:1403] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.270s	user 0.026s	sys 0.003s
I20260709 13:09:17.266016 28759 leader_election.cc:304] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.279918 29381 raft_consensus.cc:2749] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.280889 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc4bce7caf4a349b3ce695b2658707" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.281637 28792 raft_consensus.cc:2468] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:17.282232 29406 raft_consensus.cc:493] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:17.285060 29066 raft_consensus.cc:359] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.286574 29066 raft_consensus.cc:385] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.286814 29066 raft_consensus.cc:740] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.287365 29066 consensus_queue.cc:260] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:17.290365 28981 leader_election.cc:343] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.283248 29327 raft_consensus.cc:2749] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.300997 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.301882 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.284459 29406 raft_consensus.cc:515] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:17.310369 29066 ts_tablet_manager.cc:1434] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:09:17.314358 28689 catalog_manager.cc:5697] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 2, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.316176 28689 catalog_manager.cc:5697] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.284794 29343 raft_consensus.cc:493] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:17.324731 29343 raft_consensus.cc:515] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.326308 28868 raft_consensus.cc:2468] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:17.324160 29406 leader_election.cc:290] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:17.267150 28834 leader_election.cc:304] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.335191 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.290020 29395 raft_consensus.cc:493] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:17.339725 29395 raft_consensus.cc:515] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.335840 29255 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:17.341131 29379 raft_consensus.cc:515] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.341521 29255 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.342159 29395 leader_election.cc:290] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:17.343451 29379 leader_election.cc:290] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:17.343724 29255 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:17.346971 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:17.348201 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.348958 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3b31ed6f204a71a8ac57ddbc19e662" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:17.349422 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d50209455e43a6b08ae3f9f45fc6fe" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.353832 28836 leader_election.cc:304] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:17.355692 29066 tablet_bootstrap.cc:492] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:17.327483 29343 leader_election.cc:290] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:17.356453 29065 tablet_bootstrap.cc:654] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.338227 28861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc4bce7caf4a349b3ce695b2658707" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:17.357517 28758 leader_election.cc:343] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.363564 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d50209455e43a6b08ae3f9f45fc6fe" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.364859 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.370941 29016 raft_consensus.cc:2468] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:17.384727 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7caa5ccce9344e3993cdd74c21d6d2d7" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:17.385367 28793 raft_consensus.cc:3060] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.386272 29401 raft_consensus.cc:493] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:17.386863 29401 raft_consensus.cc:515] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.364921 28940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7caa5ccce9344e3993cdd74c21d6d2d7" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:17.392561 29063 raft_consensus.cc:359] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.394335 29063 raft_consensus.cc:385] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.397257 29010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:17.398514 29389 raft_consensus.cc:493] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.394742 29063 raft_consensus.cc:740] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.401080 29063 consensus_queue.cc:260] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
W20260709 13:09:17.380049 28834 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:46467, user_credentials={real_user=slave}} blocked reactor thread for 115648us
I20260709 13:09:17.393067 29363 raft_consensus.cc:2749] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.408160 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d9475e96d74d868e148f76bccfb047" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:17.415057 29395 raft_consensus.cc:493] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.415699 29395 raft_consensus.cc:515] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.417806 29395 leader_election.cc:290] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:17.420083 29064 tablet_bootstrap.cc:492] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:17.420670 29064 ts_tablet_manager.cc:1403] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.849s	user 0.051s	sys 0.014s
I20260709 13:09:17.393445 29343 consensus_queue.cc:1048] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:09:17.423568 29064 raft_consensus.cc:359] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.427635 28907 leader_election.cc:304] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.429049 29371 raft_consensus.cc:2749] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.425297 29063 ts_tablet_manager.cc:1434] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.154s	user 0.004s	sys 0.003s
I20260709 13:09:17.424350 29064 raft_consensus.cc:385] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.431653 29064 raft_consensus.cc:740] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.435024 28793 raft_consensus.cc:2468] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:17.439774 28984 leader_election.cc:304] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:17.436836 29063 tablet_bootstrap.cc:492] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:17.437794 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:17.440750 29017 raft_consensus.cc:2468] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:17.442685 29343 raft_consensus.cc:2804] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.443215 29343 raft_consensus.cc:493] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.443630 29343 raft_consensus.cc:3060] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.399092 29389 raft_consensus.cc:515] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.447690 29389 leader_election.cc:290] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
W20260709 13:09:17.442585 28833 leader_election.cc:343] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.457952 29064 consensus_queue.cc:260] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.459375 29016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:17.461213 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.462870 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ea1e4725643da8ae65abeabbabcd7" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.463274 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:17.404858 28836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 51149.1us
W20260709 13:09:17.465142 28981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40509, user_credentials={real_user=slave}} blocked reactor thread for 53341.3us
W20260709 13:09:17.469762 28981 consensus_peers.cc:597] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.470763 28981 leader_election.cc:304] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.485874 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c712a67162406ba7f28ef7f9b396b9" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:17.486846 29255 raft_consensus.cc:2749] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.489034 29064 ts_tablet_manager.cc:1434] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.001s
I20260709 13:09:17.493778 29379 raft_consensus.cc:2749] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:17.498415 29412 log.cc:927] Time spent T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:09:17.498868 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.508430 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bbc69d44e948e7b6f3a85ea80aec7e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.509260 28759 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:17.510671 29385 raft_consensus.cc:2804] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:17.511085 29385 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:17.511556 29385 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.512408 29255 raft_consensus.cc:493] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89867186bb4546988c8fcd2b9fea8757)
I20260709 13:09:17.514549 29255 raft_consensus.cc:515] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.515759 29065 tablet_bootstrap.cc:492] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:17.516458 29065 ts_tablet_manager.cc:1403] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.312s	user 0.024s	sys 0.010s
I20260709 13:09:17.498485 28908 leader_election.cc:304] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.518354 28908 leader_election.cc:304] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.518613 29371 raft_consensus.cc:2749] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.525274 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.526845 28861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:17.527524 28758 leader_election.cc:343] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.529078 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ea1e4725643da8ae65abeabbabcd7" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.531491 29065 raft_consensus.cc:359] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.532519 29065 raft_consensus.cc:385] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.532909 29065 raft_consensus.cc:740] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.533982 29065 consensus_queue.cc:260] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.536626 29401 leader_election.cc:290] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:17.538446 29065 ts_tablet_manager.cc:1434] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:17.539590 29255 leader_election.cc:290] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:17.539870 29065 tablet_bootstrap.cc:492] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:17.540333 29064 tablet_bootstrap.cc:492] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:17.547317 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.547166 28862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.548121 28869 raft_consensus.cc:2468] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
I20260709 13:09:17.532836 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a577314507499e84f3ce9f1f878ddd" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.549952 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bbc69d44e948e7b6f3a85ea80aec7e" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.551188 28834 leader_election.cc:304] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.542200 29385 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.552220 28794 raft_consensus.cc:1240] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Rejecting Update request from peer 7640ddad6f82422c8a0377a187b4e290 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:17.555444 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:17.557121 29066 tablet_bootstrap.cc:654] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.556838 29335 consensus_queue.cc:1059] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:17.557466 29385 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:17.558077 29335 raft_consensus.cc:3055] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:17.558493 29335 raft_consensus.cc:740] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:17.559392 29335 consensus_queue.cc:260] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.552197 29379 raft_consensus.cc:2749] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.562167 29335 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.562353 29386 raft_consensus.cc:493] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.562559 28836 leader_election.cc:304] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:17.562954 29386 raft_consensus.cc:515] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.563434 29392 raft_consensus.cc:2804] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.563934 29392 raft_consensus.cc:697] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:17.565244 29386 leader_election.cc:290] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:17.564873 29392 consensus_queue.cc:237] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.567178 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7caa5ccce9344e3993cdd74c21d6d2d7" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.568352 28794 raft_consensus.cc:2393] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate 89867186bb4546988c8fcd2b9fea8757 in this term.
I20260709 13:09:17.556732 29063 tablet_bootstrap.cc:654] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.588390 29064 tablet_bootstrap.cc:654] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:17.595741 28981 consensus_peers.cc:597] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.596208 28981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40509, user_credentials={real_user=slave}} blocked reactor thread for 83371.1us
W20260709 13:09:17.597014 28981 leader_election.cc:343] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:17.597298 28965 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6f20 after lost signal to thread 21315
I20260709 13:09:17.596784 29371 raft_consensus.cc:2749] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:17.598809 28965 debug-util.cc:398] Leaking SignalData structure 0x7b08002b36e0 after lost signal to thread 28727
I20260709 13:09:17.599949 28981 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
W20260709 13:09:17.600288 28965 debug-util.cc:398] Leaking SignalData structure 0x7b080005e780 after lost signal to thread 28819
I20260709 13:09:17.600801 29401 raft_consensus.cc:2749] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:17.602069 28965 debug-util.cc:398] Leaking SignalData structure 0x7b08002887a0 after lost signal to thread 28894
W20260709 13:09:17.602455 28981 leader_election.cc:343] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:17.603175 28981 leader_election.cc:343] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:17.603399 28965 debug-util.cc:398] Leaking SignalData structure 0x7b0800059700 after lost signal to thread 28968
W20260709 13:09:17.604152 28981 leader_election.cc:343] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.601672 29343 raft_consensus.cc:515] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:17.604806 28981 leader_election.cc:304] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.605623 29401 raft_consensus.cc:2749] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.607437 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc4bce7caf4a349b3ce695b2658707" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:17.608135 28794 raft_consensus.cc:3060] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.608552 28981 leader_election.cc:304] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.610045 29401 raft_consensus.cc:2749] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:17.604746 28965 debug-util.cc:398] Leaking SignalData structure 0x7b080020c220 after lost signal to thread 29042
W20260709 13:09:17.612027 28965 debug-util.cc:398] Leaking SignalData structure 0x7b0800156da0 after lost signal to thread 29043
I20260709 13:09:17.552717 28834 leader_election.cc:304] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:17.613131 29379 raft_consensus.cc:2804] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:17.613559 29379 raft_consensus.cc:493] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:17.613946 29379 raft_consensus.cc:3060] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:17.617236 28834 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:46467, user_credentials={real_user=slave}} blocked reactor thread for 64589.4us
I20260709 13:09:17.618196 28834 leader_election.cc:304] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.620862 28794 raft_consensus.cc:2468] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:17.621651 29385 consensus_queue.cc:1048] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.629938 28984 leader_election.cc:304] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:17.625057 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a577314507499e84f3ce9f1f878ddd" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.627146 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6714d660646441d58bea7a912cba0ec8" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.628239 29389 raft_consensus.cc:493] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.628644 29066 tablet_bootstrap.cc:492] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:17.633839 29066 ts_tablet_manager.cc:1403] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.278s	user 0.013s	sys 0.003s
I20260709 13:09:17.622463 29343 leader_election.cc:290] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:17.631881 29397 raft_consensus.cc:2749] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.635380 29389 raft_consensus.cc:515] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:17.635663 29408 raft_consensus.cc:2804] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.657050 28981 leader_election.cc:304] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.666182 29408 raft_consensus.cc:697] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:17.667011 29066 raft_consensus.cc:359] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.667166 29408 consensus_queue.cc:237] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:17.667871 29066 raft_consensus.cc:385] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.668215 29066 raft_consensus.cc:740] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.672227 28981 leader_election.cc:304] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.658476 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:17.680001 28981 leader_election.cc:304] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.685639 29065 tablet_bootstrap.cc:654] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.685742 28981 leader_election.cc:304] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.679911 29066 consensus_queue.cc:260] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.687460 29063 tablet_bootstrap.cc:492] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:17.687958 29063 ts_tablet_manager.cc:1403] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.251s	user 0.014s	sys 0.005s
I20260709 13:09:17.681155 28834 leader_election.cc:304] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.689301 29066 ts_tablet_manager.cc:1434] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.055s	user 0.001s	sys 0.006s
I20260709 13:09:17.690441 29066 tablet_bootstrap.cc:492] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:17.692502 29403 raft_consensus.cc:2749] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.689080 29327 raft_consensus.cc:2749] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.679850 29395 raft_consensus.cc:2749] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.694151 29363 raft_consensus.cc:2749] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.698531 28834 leader_election.cc:304] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.694576 29343 raft_consensus.cc:2749] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.703088 29389 leader_election.cc:290] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:17.705832 29360 raft_consensus.cc:2749] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.712147 29064 tablet_bootstrap.cc:492] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:17.712803 29064 ts_tablet_manager.cc:1403] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.199s	user 0.018s	sys 0.018s
I20260709 13:09:17.718709 29343 raft_consensus.cc:493] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.719305 29343 raft_consensus.cc:515] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.680224 29379 raft_consensus.cc:515] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.732194 28759 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.739192 29389 raft_consensus.cc:2749] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.742710 29379 leader_election.cc:290] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:17.746539 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547f10aff2e45b8b40cd1b4bddf42d5" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.749711 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
W20260709 13:09:17.751368 28981 leader_election.cc:343] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.753517 29343 leader_election.cc:290] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:17.758041 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc4bce7caf4a349b3ce695b2658707" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:17.758196 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547f10aff2e45b8b40cd1b4bddf42d5" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.760090 28792 raft_consensus.cc:2468] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:17.755117 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6714d660646441d58bea7a912cba0ec8" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.759057 29389 consensus_queue.cc:1048] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.763003 28984 leader_election.cc:304] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:17.769534 29343 raft_consensus.cc:2804] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.781684 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125abb8d87d437cb630354900d6e5b4" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:17.782017 28981 leader_election.cc:343] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.776743 29343 raft_consensus.cc:493] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.785193 29343 raft_consensus.cc:3060] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.773525 29394 consensus_queue.cc:1048] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:09:17.789590 29063 raft_consensus.cc:359] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.790427 29063 raft_consensus.cc:385] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.795650 28981 leader_election.cc:304] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.797583 29066 tablet_bootstrap.cc:654] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:17.803359 28758 leader_election.cc:343] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.804654 29065 tablet_bootstrap.cc:492] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:17.804563 28758 leader_election.cc:304] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.805240 29065 ts_tablet_manager.cc:1403] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.266s	user 0.014s	sys 0.020s
I20260709 13:09:17.805835 28758 leader_election.cc:304] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:17.807533 29011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:17.807768 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7caa5ccce9344e3993cdd74c21d6d2d7" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.809671 28865 raft_consensus.cc:1240] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Rejecting Update request from peer 7640ddad6f82422c8a0377a187b4e290 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:17.804163 29063 raft_consensus.cc:740] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.810743 29063 consensus_queue.cc:260] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.811617 29381 raft_consensus.cc:2749] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.812363 29381 raft_consensus.cc:2804] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.812729 29381 raft_consensus.cc:493] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.812934 29063 ts_tablet_manager.cc:1434] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.000s
I20260709 13:09:17.809423 29065 raft_consensus.cc:359] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.813747 29065 raft_consensus.cc:385] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.813050 29381 raft_consensus.cc:3060] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.814076 29065 raft_consensus.cc:740] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.816516 29327 raft_consensus.cc:2749] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.817797 29064 raft_consensus.cc:359] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.818465 29064 raft_consensus.cc:385] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.818728 29064 raft_consensus.cc:740] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.819376 29064 consensus_queue.cc:260] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.820894 29063 tablet_bootstrap.cc:492] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:17.824631 29343 raft_consensus.cc:515] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.827451 29381 raft_consensus.cc:515] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:17.828701 28758 leader_election.cc:343] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.827986 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547f10aff2e45b8b40cd1b4bddf42d5" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:17.838447 28794 raft_consensus.cc:3060] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.816404 29065 consensus_queue.cc:260] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.846639 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547f10aff2e45b8b40cd1b4bddf42d5" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
W20260709 13:09:17.850698 28981 leader_election.cc:343] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.826850 29343 leader_election.cc:290] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:17.855998 28758 consensus_peers.cc:597] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.856132 28693 catalog_manager.cc:5697] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.857818 29430 raft_consensus.cc:493] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.858603 29430 raft_consensus.cc:515] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:17.853927 29327 consensus_queue.cc:1048] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:17.860380 28693 catalog_manager.cc:5697] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.862181 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:17.864173 29430 leader_election.cc:290] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:17.849570 29379 raft_consensus.cc:493] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.865554 29379 raft_consensus.cc:515] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:17.857311 28689 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33796 (request call id 55) took 1360 ms. Trace:
I20260709 13:09:17.869601 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:17.873238 28794 raft_consensus.cc:2468] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
W20260709 13:09:17.871169 28833 leader_election.cc:343] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.877010 29064 ts_tablet_manager.cc:1434] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.164s	user 0.007s	sys 0.000s
I20260709 13:09:17.868883 28689 rpcz_store.cc:276] 0709 13:09:16.494701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.500310 (+  5609us) service_pool.cc:224] Handling call
0709 13:09:17.855117 (+1354807us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:17.507036 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:17.568890 (+ 61854us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:17.568947 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:09:17.568966 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:17.569355 (+   389us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:17.569416 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:17.569442 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:09:17.569747 (+   305us) tablet.cc:701] Row locks acquired
0709 13:09:17.569764 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:09:17.569903 (+   139us) write_op.cc:270] Start()
0709 13:09:17.570003 (+   100us) write_op.cc:276] Timestamp: P: 1783602557569847 usec, L: 0
0709 13:09:17.570023 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:09:17.570640 (+   617us) log.cc:844] Serialized 922 byte log entry
0709 13:09:17.774945 (+204305us) op_driver.cc:464] REPLICATION: finished
0709 13:09:17.820121 (+ 45176us) write_op.cc:301] APPLY: starting
0709 13:09:17.820266 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:17.820372 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:17.820522 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:17.820893 (+   371us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:17.821054 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:09:17.821097 (+    43us) write_op.cc:312] APPLY: finished
0709 13:09:17.821290 (+   193us) log.cc:844] Serialized 28 byte log entry
0709 13:09:17.821460 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:17.821545 (+    85us) write_op.cc:454] Released schema lock
0709 13:09:17.821581 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:17.833072 (+ 11491us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:17.833103 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":41210,"apply.run_cpu_time_us":1823,"apply.run_wall_time_us":12914,"num_ops":2,"prepare.queue_time_us":142255,"prepare.run_cpu_time_us":16407,"prepare.run_wall_time_us":163935,"raft.queue_time_us":100464,"raft.run_cpu_time_us":1498,"raft.run_wall_time_us":3751,"replication_time_us":204759,"thread_start_us":189242,"threads_started":4,"wal-append.queue_time_us":61466}]]}
I20260709 13:09:17.880594 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125abb8d87d437cb630354900d6e5b4" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:17.875415 28984 leader_election.cc:304] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:17.870850 29379 leader_election.cc:290] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:17.893579 29065 ts_tablet_manager.cc:1434] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 13:09:17.906184 29065 tablet_bootstrap.cc:492] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:17.906378 29343 raft_consensus.cc:2804] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.907352 29343 raft_consensus.cc:697] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:17.907917 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:17.908252 29343 consensus_queue.cc:237] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
W20260709 13:09:17.909556 28758 leader_election.cc:343] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.910552 28867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:17.911242 28867 raft_consensus.cc:3060] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.895992 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:17.896977 29066 tablet_bootstrap.cc:492] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:17.913020 29066 ts_tablet_manager.cc:1403] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.223s	user 0.024s	sys 0.006s
I20260709 13:09:17.913475 29065 tablet_bootstrap.cc:654] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.915925 29066 raft_consensus.cc:359] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:17.916687 29066 raft_consensus.cc:385] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.916966 29066 raft_consensus.cc:740] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.917140 28908 leader_election.cc:304] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.898195 28690 catalog_manager.cc:5697] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.918674 29430 raft_consensus.cc:2749] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.919489 28690 catalog_manager.cc:5697] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:17.917693 29066 consensus_queue.cc:260] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:17.927282 29066 ts_tablet_manager.cc:1434] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:17.929877 29066 tablet_bootstrap.cc:492] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:17.933087 28741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:17.936203 29066 tablet_bootstrap.cc:654] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.022943 29065 tablet_bootstrap.cc:492] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:18.024778 29065 ts_tablet_manager.cc:1403] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.119s	user 0.024s	sys 0.004s
I20260709 13:09:17.991395 29363 consensus_queue.cc:1048] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.959417 28867 raft_consensus.cc:2468] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:17.984090 28834 leader_election.cc:304] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:17.946484 29381 leader_election.cc:290] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:18.027976 29381 raft_consensus.cc:493] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.028079 29065 raft_consensus.cc:359] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.028537 29381 raft_consensus.cc:515] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:17.974255 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:18.029471 29017 raft_consensus.cc:2468] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:17.993870 29063 tablet_bootstrap.cc:654] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:17.958760 28758 consensus_peers.cc:597] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.904237 29064 tablet_bootstrap.cc:492] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
W20260709 13:09:18.030687 28758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 72052.8us
W20260709 13:09:18.034281 28758 leader_election.cc:343] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.034718 28758 leader_election.cc:304] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:18.036759 29382 raft_consensus.cc:2749] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.949065 28907 leader_election.cc:304] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:17.983518 28693 catalog_manager.cc:5697] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.038120 29430 raft_consensus.cc:3060] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.038538 28693 catalog_manager.cc:5697] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:18.040889 28907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 91969.4us
I20260709 13:09:17.938122 29343 consensus_queue.cc:1048] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:18.040372 28693 catalog_manager.cc:5697] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.047724 28693 catalog_manager.cc:5697] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.028872 29065 raft_consensus.cc:385] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.049572 28693 catalog_manager.cc:5697] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.052977 29394 raft_consensus.cc:2749] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:18.050021 29065 raft_consensus.cc:740] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.054112 29065 consensus_queue.cc:260] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:18.054423 28834 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:46467, user_credentials={real_user=slave}} blocked reactor thread for 70423.5us
I20260709 13:09:18.061673 29065 ts_tablet_manager.cc:1434] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:09:18.062803 28834 leader_election.cc:304] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:18.065164 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bfbcadacb1480fbedbd436808ea85b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:18.066702 29065 tablet_bootstrap.cc:492] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
W20260709 13:09:18.066852 28759 leader_election.cc:343] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.069206 28939 raft_consensus.cc:3060] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.075457 29379 raft_consensus.cc:493] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.076165 29379 raft_consensus.cc:515] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.080144 29379 leader_election.cc:290] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:18.082031 29363 raft_consensus.cc:2804] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.082695 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:18.090780 28690 catalog_manager.cc:5697] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.090785 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:18.094111 29335 consensus_queue.cc:1059] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.065765 29381 leader_election.cc:290] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:18.082031 29065 tablet_bootstrap.cc:654] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.106532 28758 leader_election.cc:304] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:18.107724 29064 tablet_bootstrap.cc:654] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.131417 29335 raft_consensus.cc:3055] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:18.131832 29335 raft_consensus.cc:740] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:18.132629 29335 consensus_queue.cc:260] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.133998 29335 raft_consensus.cc:3060] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:18.105072 29430 raft_consensus.cc:2749] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.111375 29363 raft_consensus.cc:493] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.138943 29066 tablet_bootstrap.cc:492] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:18.141139 29066 ts_tablet_manager.cc:1403] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.213s	user 0.016s	sys 0.008s
I20260709 13:09:18.139372 29382 raft_consensus.cc:2804] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.156368 29382 raft_consensus.cc:697] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:18.157302 29382 consensus_queue.cc:237] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.140189 29363 raft_consensus.cc:3060] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.165390 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bfbcadacb1480fbedbd436808ea85b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:18.177352 28836 leader_election.cc:304] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:18.177480 29066 raft_consensus.cc:359] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.178241 29066 raft_consensus.cc:385] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.178424 29378 raft_consensus.cc:2749] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.179035 29063 tablet_bootstrap.cc:492] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:18.179576 29063 ts_tablet_manager.cc:1403] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.359s	user 0.021s	sys 0.011s
I20260709 13:09:18.178570 29066 raft_consensus.cc:740] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.183063 29063 raft_consensus.cc:359] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.186825 29063 raft_consensus.cc:385] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.187161 29063 raft_consensus.cc:740] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.187443 29066 consensus_queue.cc:260] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.187826 29063 consensus_queue.cc:260] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.190292 29063 ts_tablet_manager.cc:1434] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:09:18.197024 29063 tablet_bootstrap.cc:492] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:18.200704 29378 consensus_queue.cc:1048] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:18.201833 29065 tablet_bootstrap.cc:492] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:18.203392 29066 ts_tablet_manager.cc:1434] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 13:09:18.206385 28865 raft_consensus.cc:3060] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:18.212747 28981 consensus_peers.cc:597] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.205145 29065 ts_tablet_manager.cc:1403] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.139s	user 0.010s	sys 0.009s
W20260709 13:09:18.221089 28758 leader_election.cc:343] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.225912 28758 leader_election.cc:304] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:18.239311 29066 tablet_bootstrap.cc:492] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:18.229543 29328 raft_consensus.cc:493] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.230818 29389 raft_consensus.cc:2749] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.251974 29064 tablet_bootstrap.cc:492] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:18.252614 29064 ts_tablet_manager.cc:1403] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.349s	user 0.016s	sys 0.009s
I20260709 13:09:18.243309 29328 raft_consensus.cc:515] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.280350 29343 consensus_queue.cc:1048] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:18.285631 29328 leader_election.cc:290] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:18.289842 29363 raft_consensus.cc:515] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.292299 29363 leader_election.cc:290] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:18.293895 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
W20260709 13:09:18.295488 28833 leader_election.cc:343] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.303855 29065 raft_consensus.cc:359] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.304855 29065 raft_consensus.cc:385] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.305213 29065 raft_consensus.cc:740] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.306046 29065 consensus_queue.cc:260] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.307772 28691 catalog_manager.cc:5697] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.307909 29408 raft_consensus.cc:493] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.311705 29408 raft_consensus.cc:515] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.315024 29408 leader_election.cc:290] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:18.329476 29065 ts_tablet_manager.cc:1434] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.001s
I20260709 13:09:18.331897 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e0029999088407b9d71307a13c1599b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:18.332631 28867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bfbcadacb1480fbedbd436808ea85b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:18.334846 29065 tablet_bootstrap.cc:492] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:18.338557 29066 tablet_bootstrap.cc:654] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.345253 29064 raft_consensus.cc:359] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.347234 29065 tablet_bootstrap.cc:654] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:18.348307 28981 leader_election.cc:343] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:18.349131 28981 leader_election.cc:343] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.352429 29063 tablet_bootstrap.cc:654] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.353073 29064 raft_consensus.cc:385] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:18.353120 28984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 85004.2us
I20260709 13:09:18.353600 29064 raft_consensus.cc:740] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.357196 29064 consensus_queue.cc:260] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.364190 28791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bfbcadacb1480fbedbd436808ea85b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:18.366586 28791 raft_consensus.cc:2468] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:18.368985 28984 leader_election.cc:304] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:18.369333 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:18.371212 29064 ts_tablet_manager.cc:1434] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.118s	user 0.006s	sys 0.001s
I20260709 13:09:18.372154 29015 raft_consensus.cc:3060] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.372372 29064 tablet_bootstrap.cc:492] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:18.373368 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e0029999088407b9d71307a13c1599b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:18.379488 29064 tablet_bootstrap.cc:654] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.379824 29015 raft_consensus.cc:2468] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:18.390336 29408 raft_consensus.cc:2804] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.390967 29408 raft_consensus.cc:493] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.392575 29408 raft_consensus.cc:3060] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:18.391770 28981 leader_election.cc:343] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.391548 28834 leader_election.cc:304] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:18.391832 29327 consensus_queue.cc:1048] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:18.397758 29378 raft_consensus.cc:2804] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.398380 29378 raft_consensus.cc:697] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:18.399327 29378 consensus_queue.cc:237] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.420552 28981 leader_election.cc:304] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:18.423079 29454 raft_consensus.cc:2749] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.431134 29065 tablet_bootstrap.cc:492] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:18.431981 29065 ts_tablet_manager.cc:1403] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.009s
I20260709 13:09:18.435732 29065 raft_consensus.cc:359] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.437065 29065 raft_consensus.cc:385] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.422268 29408 raft_consensus.cc:515] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.443903 29408 leader_election.cc:290] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:18.437418 29065 raft_consensus.cc:740] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.445392 29065 consensus_queue.cc:260] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
W20260709 13:09:18.452009 28981 consensus_peers.cc:597] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.455279 29063 tablet_bootstrap.cc:492] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:18.455782 29063 ts_tablet_manager.cc:1403] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.259s	user 0.010s	sys 0.003s
I20260709 13:09:18.456430 29066 tablet_bootstrap.cc:492] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:18.458182 29066 ts_tablet_manager.cc:1403] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.221s	user 0.015s	sys 0.002s
I20260709 13:09:18.458278 29065 ts_tablet_manager.cc:1434] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 13:09:18.464552 29065 tablet_bootstrap.cc:492] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:18.464561 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bfbcadacb1480fbedbd436808ea85b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:18.468338 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bfbcadacb1480fbedbd436808ea85b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:18.468642 28792 raft_consensus.cc:3060] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:18.474411 28981 leader_election.cc:343] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.477785 28691 catalog_manager.cc:5697] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.489462 29065 tablet_bootstrap.cc:654] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.493095 28792 raft_consensus.cc:2468] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:18.498219 28984 leader_election.cc:304] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:18.499166 29327 raft_consensus.cc:2804] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.501528 29327 raft_consensus.cc:697] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:18.502435 29327 consensus_queue.cc:237] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.503039 29063 raft_consensus.cc:359] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.503690 29063 raft_consensus.cc:385] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.503921 29063 raft_consensus.cc:740] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.506119 29063 consensus_queue.cc:260] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.508666 29066 raft_consensus.cc:359] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:18.509475 29066 raft_consensus.cc:385] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.509768 29066 raft_consensus.cc:740] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.511152 29066 consensus_queue.cc:260] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:18.518244 29063 ts_tablet_manager.cc:1434] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.002s
I20260709 13:09:18.519469 29063 tablet_bootstrap.cc:492] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:18.524065 29066 ts_tablet_manager.cc:1434] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 13:09:18.522769 28689 catalog_manager.cc:5697] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.531649 29063 tablet_bootstrap.cc:654] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.525247 29066 tablet_bootstrap.cc:492] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:18.536218 29389 raft_consensus.cc:493] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.536808 29389 raft_consensus.cc:515] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:18.538973 29389 leader_election.cc:290] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:18.539769 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e014e29eece34924b34eaf88458e5ab4" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:18.541724 28758 leader_election.cc:343] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.545091 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e014e29eece34924b34eaf88458e5ab4" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
W20260709 13:09:18.546742 28759 leader_election.cc:343] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.547212 28759 leader_election.cc:304] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:18.548447 29398 raft_consensus.cc:2749] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.548707 29064 tablet_bootstrap.cc:492] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:18.553375 29066 tablet_bootstrap.cc:654] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.554338 29064 ts_tablet_manager.cc:1403] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.182s	user 0.047s	sys 0.018s
I20260709 13:09:18.570806 29064 raft_consensus.cc:359] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:18.571447 29064 raft_consensus.cc:385] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.571656 29064 raft_consensus.cc:740] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.572822 29066 tablet_bootstrap.cc:492] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:18.572266 29064 consensus_queue.cc:260] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:18.573513 29066 ts_tablet_manager.cc:1403] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.000s
I20260709 13:09:18.584014 29064 ts_tablet_manager.cc:1434] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:09:18.591704 29065 tablet_bootstrap.cc:492] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:18.592291 29065 ts_tablet_manager.cc:1403] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.014s
I20260709 13:09:18.593521 29066 raft_consensus.cc:359] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.595150 29066 raft_consensus.cc:385] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.596127 29066 raft_consensus.cc:740] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.595809 29065 raft_consensus.cc:359] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.596632 29065 raft_consensus.cc:385] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.597029 29065 raft_consensus.cc:740] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.597009 29066 consensus_queue.cc:260] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.597931 29064 tablet_bootstrap.cc:492] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:18.600816 29065 consensus_queue.cc:260] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.603374 29066 ts_tablet_manager.cc:1434] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:09:18.606053 29066 tablet_bootstrap.cc:492] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:18.608568 29065 ts_tablet_manager.cc:1434] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:09:18.614892 29063 tablet_bootstrap.cc:492] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:18.615486 29063 ts_tablet_manager.cc:1403] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.096s	user 0.025s	sys 0.011s
I20260709 13:09:18.617048 29066 tablet_bootstrap.cc:654] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.620131 29064 tablet_bootstrap.cc:654] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.621776 29063 raft_consensus.cc:359] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.622543 29063 raft_consensus.cc:385] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.622843 29063 raft_consensus.cc:740] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.624828 29065 tablet_bootstrap.cc:492] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:18.629843 29063 consensus_queue.cc:260] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.633446 29065 tablet_bootstrap.cc:654] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.637220 29063 ts_tablet_manager.cc:1434] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:09:18.638646 29063 tablet_bootstrap.cc:492] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:18.648006 29064 tablet_bootstrap.cc:492] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:18.648600 29064 ts_tablet_manager.cc:1403] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.000s
I20260709 13:09:18.651458 29064 raft_consensus.cc:359] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.652129 29064 raft_consensus.cc:385] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.652406 29064 raft_consensus.cc:740] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.655156 29064 consensus_queue.cc:260] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.656971 29063 tablet_bootstrap.cc:654] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.657256 29363 raft_consensus.cc:493] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.657788 29363 raft_consensus.cc:515] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.659825 29363 leader_election.cc:290] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:18.660490 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0358f1bde5044224a2fb9711b1f990b6" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:18.666141 29065 tablet_bootstrap.cc:492] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:18.666177 29398 raft_consensus.cc:493] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.666898 29065 ts_tablet_manager.cc:1403] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.003s
I20260709 13:09:18.666864 29398 raft_consensus.cc:515] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.667356 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0358f1bde5044224a2fb9711b1f990b6" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:18.669273 29398 leader_election.cc:290] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:18.669361 28836 leader_election.cc:304] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:18.670735 29065 raft_consensus.cc:359] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.671128 29379 raft_consensus.cc:2749] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.671839 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3ea20eff10460186a8e96381d02883" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:18.673395 29066 tablet_bootstrap.cc:492] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
W20260709 13:09:18.673607 28758 leader_election.cc:343] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.673928 29066 ts_tablet_manager.cc:1403] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.002s
I20260709 13:09:18.674893 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3ea20eff10460186a8e96381d02883" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:18.676967 28758 leader_election.cc:343] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.677435 28758 leader_election.cc:304] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:18.678558 29066 raft_consensus.cc:359] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.679344 29066 raft_consensus.cc:385] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.679600 29066 raft_consensus.cc:740] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.680397 29066 consensus_queue.cc:260] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.678571 29385 raft_consensus.cc:2749] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.682896 29066 ts_tablet_manager.cc:1434] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:18.685890 29066 tablet_bootstrap.cc:492] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:18.689615 29386 raft_consensus.cc:493] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.690224 29386 raft_consensus.cc:515] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.690779 29065 raft_consensus.cc:385] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.691144 29065 raft_consensus.cc:740] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.691174 29063 tablet_bootstrap.cc:492] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:18.691978 29065 consensus_queue.cc:260] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.692582 29386 leader_election.cc:290] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:18.698383 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bbc69d44e948e7b6f3a85ea80aec7e" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:18.700865 29064 ts_tablet_manager.cc:1434] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:09:18.705933 29064 tablet_bootstrap.cc:492] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:18.712949 29064 tablet_bootstrap.cc:654] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.693190 29066 tablet_bootstrap.cc:654] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.694660 29065 ts_tablet_manager.cc:1434] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.004s
I20260709 13:09:18.715499 29065 tablet_bootstrap.cc:492] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:18.716673 28869 raft_consensus.cc:3060] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.691972 29063 ts_tablet_manager.cc:1403] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.001s
I20260709 13:09:18.695029 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bbc69d44e948e7b6f3a85ea80aec7e" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:18.721464 28907 leader_election.cc:304] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:18.722568 29386 raft_consensus.cc:2749] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.729918 28936 raft_consensus.cc:3060] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.722838 29063 raft_consensus.cc:359] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:18.731364 29063 raft_consensus.cc:385] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.731703 29063 raft_consensus.cc:740] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.738230 29398 raft_consensus.cc:493] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.749614 29398 raft_consensus.cc:515] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.752252 29398 leader_election.cc:290] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:18.733487 29065 tablet_bootstrap.cc:654] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.743489 29327 raft_consensus.cc:493] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.755406 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:18.747606 29389 consensus_queue.cc:1048] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:18.756541 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:18.736819 29378 raft_consensus.cc:493] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.759212 29378 raft_consensus.cc:515] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.761485 29378 leader_election.cc:290] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:18.764405 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:18.765220 28794 raft_consensus.cc:2468] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:18.766897 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:18.768870 28935 raft_consensus.cc:3060] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.769872 28836 leader_election.cc:304] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:18.770833 29379 raft_consensus.cc:2804] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.771234 29379 raft_consensus.cc:493] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.771570 29379 raft_consensus.cc:3060] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.755235 29327 raft_consensus.cc:515] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.775542 29327 leader_election.cc:290] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
W20260709 13:09:18.771903 28833 leader_election.cc:343] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.777750 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:18.776196 29015 raft_consensus.cc:2468] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 0.
W20260709 13:09:18.781877 28758 leader_election.cc:343] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.782070 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:18.782837 28792 raft_consensus.cc:2468] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:18.784299 28759 leader_election.cc:304] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:18.785230 29389 raft_consensus.cc:2804] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.785611 29389 raft_consensus.cc:493] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.785954 29389 raft_consensus.cc:3060] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.788496 29385 consensus_queue.cc:1048] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:18.783721 28981 leader_election.cc:343] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.738569 29063 consensus_queue.cc:260] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:18.794606 29063 ts_tablet_manager.cc:1434] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.003s
I20260709 13:09:18.802775 28984 leader_election.cc:304] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:18.807471 29064 tablet_bootstrap.cc:492] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:18.808076 29064 ts_tablet_manager.cc:1403] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.008s
I20260709 13:09:18.807340 29454 raft_consensus.cc:2804] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.810858 29454 raft_consensus.cc:493] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.811225 29454 raft_consensus.cc:3060] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.780149 29379 raft_consensus.cc:515] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.819360 29389 raft_consensus.cc:515] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.827373 29063 tablet_bootstrap.cc:492] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:18.820715 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:18.848884 28792 raft_consensus.cc:3060] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.845008 29363 raft_consensus.cc:493] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.853459 29363 raft_consensus.cc:515] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.856118 29363 leader_election.cc:290] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:18.857848 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d50209455e43a6b08ae3f9f45fc6fe" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:18.859570 28833 leader_election.cc:343] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.861907 29017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d50209455e43a6b08ae3f9f45fc6fe" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:18.862633 29017 raft_consensus.cc:2468] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:18.862843 29454 raft_consensus.cc:515] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.865540 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:18.828027 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:18.866808 29015 raft_consensus.cc:2393] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7f68815192fc48a58a67ddf2da3bac70 in current term 1: Already voted for candidate f3d3a97b01f64816a2a769d159dd64d2 in this term.
I20260709 13:09:18.842890 28942 raft_consensus.cc:3060] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.865648 28834 leader_election.cc:304] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:18.873344 29378 raft_consensus.cc:2804] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.873947 29378 raft_consensus.cc:493] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.874387 29378 raft_consensus.cc:3060] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:18.881253 28833 leader_election.cc:343] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.883152 29063 tablet_bootstrap.cc:654] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.888211 29066 tablet_bootstrap.cc:492] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:18.888777 29066 ts_tablet_manager.cc:1403] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.203s	user 0.006s	sys 0.009s
I20260709 13:09:18.826260 29064 raft_consensus.cc:359] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.893251 29064 raft_consensus.cc:385] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.893594 29064 raft_consensus.cc:740] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.898825 29064 consensus_queue.cc:260] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.889216 29379 leader_election.cc:290] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
W20260709 13:09:18.892772 29450 log.cc:927] Time spent T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: Append to log took a long time: real 0.056s	user 0.002s	sys 0.016s
I20260709 13:09:18.927884 29065 tablet_bootstrap.cc:492] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:18.910540 29408 raft_consensus.cc:493] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.928552 29065 ts_tablet_manager.cc:1403] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.213s	user 0.030s	sys 0.020s
I20260709 13:09:18.930536 28862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:18.932735 29065 raft_consensus.cc:359] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.933513 29065 raft_consensus.cc:385] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.933799 29065 raft_consensus.cc:740] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.938679 29379 consensus_queue.cc:1048] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:18.928660 29408 raft_consensus.cc:515] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:18.944633 29408 leader_election.cc:290] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:18.934551 29065 consensus_queue.cc:260] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:18.948110 28792 raft_consensus.cc:2468] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:18.926106 29454 leader_election.cc:290] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:18.949846 28836 leader_election.cc:304] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:18.950491 29066 raft_consensus.cc:359] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.951063 29363 raft_consensus.cc:2804] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.951278 29066 raft_consensus.cc:385] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.951710 29066 raft_consensus.cc:740] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.951740 29363 raft_consensus.cc:697] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:18.953075 29363 consensus_queue.cc:237] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:18.958954 28981 consensus_peers.cc:597] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.959710 28981 leader_election.cc:343] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.950985 29065 ts_tablet_manager.cc:1434] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:18.914485 29389 leader_election.cc:290] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:18.979661 29066 consensus_queue.cc:260] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:18.982009 29065 tablet_bootstrap.cc:492] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:19.003005 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7fd30052d142679c225954b5b5724b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:19.010478 29064 ts_tablet_manager.cc:1434] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.202s	user 0.007s	sys 0.002s
W20260709 13:09:19.012948 28981 leader_election.cc:343] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.979748 29453 consensus_queue.cc:1048] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:09:19.030738 29064 tablet_bootstrap.cc:492] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:18.997435 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:19.023849 28862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:19.052575 29066 ts_tablet_manager.cc:1434] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.164s	user 0.003s	sys 0.005s
I20260709 13:09:19.064201 29066 tablet_bootstrap.cc:492] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:19.065860 29063 tablet_bootstrap.cc:492] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:19.066417 29063 ts_tablet_manager.cc:1403] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.259s	user 0.009s	sys 0.010s
W20260709 13:09:19.070883 28758 leader_election.cc:343] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.071461 28758 leader_election.cc:304] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:19.091401 29063 raft_consensus.cc:359] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.096063 29063 raft_consensus.cc:385] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.096405 29063 raft_consensus.cc:740] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
W20260709 13:09:19.097419 28984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 118263us
I20260709 13:09:19.090786 28792 raft_consensus.cc:2393] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 in current term 1: Already voted for candidate 7f68815192fc48a58a67ddf2da3bac70 in this term.
I20260709 13:09:19.100768 29063 consensus_queue.cc:260] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.072085 29378 raft_consensus.cc:515] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.120265 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7fd30052d142679c225954b5b5724b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:19.109351 29479 raft_consensus.cc:2749] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.136715 29063 ts_tablet_manager.cc:1434] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.002s
I20260709 13:09:19.139361 29065 tablet_bootstrap.cc:654] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.161417 29063 tablet_bootstrap.cc:492] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:19.182265 29479 raft_consensus.cc:493] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.182874 29479 raft_consensus.cc:515] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:19.185111 29479 leader_election.cc:290] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:19.186632 29066 tablet_bootstrap.cc:654] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.193972 29378 leader_election.cc:290] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:19.219148 28867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f7afbd6bd14202b784bc4c24b71bd1" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:19.180888 29360 raft_consensus.cc:493] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.220908 28758 leader_election.cc:343] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.220811 29360 raft_consensus.cc:515] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:19.223294 29360 leader_election.cc:290] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:19.225885 28741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:19.233922 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f7afbd6bd14202b784bc4c24b71bd1" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:19.203006 29453 raft_consensus.cc:493] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.228240 29064 tablet_bootstrap.cc:654] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:19.253150 28759 leader_election.cc:343] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.253830 28759 leader_election.cc:304] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:19.256145 29385 raft_consensus.cc:2749] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.256862 29385 raft_consensus.cc:493] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.257323 29385 raft_consensus.cc:515] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.260082 29385 leader_election.cc:290] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:19.264102 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1293cb1f6ed468da880ff1ee758b3b4" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:19.265964 28758 leader_election.cc:343] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.268093 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1293cb1f6ed468da880ff1ee758b3b4" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:19.237082 29453 raft_consensus.cc:515] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.272099 29453 leader_election.cc:290] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:19.274848 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e014e29eece34924b34eaf88458e5ab4" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:19.276767 28981 leader_election.cc:343] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.277257 28942 raft_consensus.cc:3060] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:19.287322 28758 leader_election.cc:343] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.287918 28758 leader_election.cc:304] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:19.288841 29479 raft_consensus.cc:2749] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.290169 29335 raft_consensus.cc:493] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.290791 29335 raft_consensus.cc:515] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.294405 29063 tablet_bootstrap.cc:654] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.302102 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d50209455e43a6b08ae3f9f45fc6fe" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:19.304912 29453 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:19.303460 29335 leader_election.cc:290] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:19.305634 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:19.305961 29453 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.305619 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:19.307402 28869 raft_consensus.cc:2468] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:19.308176 29453 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:19.308640 28907 leader_election.cc:304] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:19.308524 29479 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.311939 29479 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.314589 29479 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
W20260709 13:09:19.306792 28833 leader_election.cc:343] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:19.320168 28981 leader_election.cc:343] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.320744 28981 leader_election.cc:304] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:19.321647 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc4bce7caf4a349b3ce695b2658707" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:19.324074 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:19.324841 28941 raft_consensus.cc:2468] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:19.325681 29335 raft_consensus.cc:2804] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:19.326144 29335 raft_consensus.cc:493] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.326503 29335 raft_consensus.cc:3060] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.329097 29493 raft_consensus.cc:493] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.329854 29493 raft_consensus.cc:515] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.344679 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:19.346148 28758 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:19.345494 28941 raft_consensus.cc:2468] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 2.
I20260709 13:09:19.350297 29327 raft_consensus.cc:2749] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.353484 29494 raft_consensus.cc:2804] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:19.354043 29494 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.354418 29494 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.357072 29011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d50209455e43a6b08ae3f9f45fc6fe" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:19.357864 29011 raft_consensus.cc:3060] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:19.366350 28981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 46215.5us
I20260709 13:09:19.369089 29066 tablet_bootstrap.cc:492] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:19.370622 29493 leader_election.cc:290] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:19.373533 29066 ts_tablet_manager.cc:1403] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.306s	user 0.014s	sys 0.003s
I20260709 13:09:19.373164 28981 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:19.375789 29065 tablet_bootstrap.cc:492] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:19.377766 29065 ts_tablet_manager.cc:1403] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.397s	user 0.065s	sys 0.048s
I20260709 13:09:19.374554 29490 raft_consensus.cc:493] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.379979 29490 raft_consensus.cc:515] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.380657 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e0029999088407b9d71307a13c1599b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:19.379019 29408 raft_consensus.cc:2804] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:19.383776 29490 leader_election.cc:290] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:19.384243 29408 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:19.384863 29408 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:19.392699 29018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dc4bce7caf4a349b3ce695b2658707" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:19.383853 29066 raft_consensus.cc:359] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.394567 29066 raft_consensus.cc:385] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.394881 29066 raft_consensus.cc:740] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.395305 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:19.394331 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e0029999088407b9d71307a13c1599b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:19.400890 29009 raft_consensus.cc:2468] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:19.401507 28864 raft_consensus.cc:3060] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.403846 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:19.395720 29066 consensus_queue.cc:260] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.394171 28984 leader_election.cc:304] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:19.408506 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:19.409974 29399 raft_consensus.cc:2749] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.415014 28908 leader_election.cc:304] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:19.415254 28690 catalog_manager.cc:5697] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.419404 29063 tablet_bootstrap.cc:492] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:19.419992 29063 ts_tablet_manager.cc:1403] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.272s	user 0.016s	sys 0.000s
I20260709 13:09:19.416370 29490 raft_consensus.cc:2749] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:19.415045 29065 raft_consensus.cc:359] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.422415 29065 raft_consensus.cc:385] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.422796 29065 raft_consensus.cc:740] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.423604 29065 consensus_queue.cc:260] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.432703 29066 ts_tablet_manager.cc:1434] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.056s	user 0.002s	sys 0.005s
I20260709 13:09:19.434020 29066 tablet_bootstrap.cc:492] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:19.436996 29011 raft_consensus.cc:2468] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:19.438390 29408 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.440029 29066 tablet_bootstrap.cc:654] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.440908 28834 leader_election.cc:304] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
W20260709 13:09:19.383745 28833 leader_election.cc:343] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.444996 29065 ts_tablet_manager.cc:1434] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.001s
I20260709 13:09:19.447377 29494 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.452726 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e014e29eece34924b34eaf88458e5ab4" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:19.452718 28834 leader_election.cc:304] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:19.453619 28792 raft_consensus.cc:2468] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:19.454556 29494 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:19.454672 28834 leader_election.cc:304] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:19.420084 29493 consensus_queue.cc:1048] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.071s
I20260709 13:09:19.455338 29378 raft_consensus.cc:2804] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.455924 29378 raft_consensus.cc:493] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.456342 29378 raft_consensus.cc:3060] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.463764 29064 tablet_bootstrap.cc:492] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:19.464395 29064 ts_tablet_manager.cc:1403] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.437s	user 0.015s	sys 0.004s
I20260709 13:09:19.465674 29486 raft_consensus.cc:493] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.466320 29486 raft_consensus.cc:515] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.468559 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:19.470595 29063 raft_consensus.cc:359] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.471889 29453 raft_consensus.cc:493] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7640ddad6f82422c8a0377a187b4e290)
I20260709 13:09:19.472429 29453 raft_consensus.cc:515] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.471171 29064 raft_consensus.cc:359] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.475258 29064 raft_consensus.cc:385] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.476960 29064 raft_consensus.cc:740] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.476174 29015 raft_consensus.cc:2468] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:19.485745 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:19.486608 28792 raft_consensus.cc:2368] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 for earlier term 2. Current term is 3.
I20260709 13:09:19.474448 29453 leader_election.cc:290] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:19.491755 29064 consensus_queue.cc:260] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.493685 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ea2b150b444aab3e1430624fe2a3d" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:19.495012 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:19.495878 28869 raft_consensus.cc:2393] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 in current term 2: Already voted for candidate 89867186bb4546988c8fcd2b9fea8757 in this term.
I20260709 13:09:19.496899 28787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ea2b150b444aab3e1430624fe2a3d" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:19.497692 28787 raft_consensus.cc:2468] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:19.491803 29408 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:19.499068 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:19.500586 29064 ts_tablet_manager.cc:1434] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
W20260709 13:09:19.450428 28833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40509, user_credentials={real_user=slave}} blocked reactor thread for 66718.8us
I20260709 13:09:19.477823 29486 leader_election.cc:290] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:19.481616 29065 tablet_bootstrap.cc:492] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:19.483659 29335 raft_consensus.cc:515] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.511667 28984 leader_election.cc:304] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:19.512800 29335 leader_election.cc:290] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 3 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:19.484368 29495 raft_consensus.cc:2804] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.513806 29495 raft_consensus.cc:697] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:19.514007 28984 leader_election.cc:400] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969) with higher term. Message: Invalid argument: T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 for earlier term 2. Current term is 3.
I20260709 13:09:19.514760 28935 raft_consensus.cc:2368] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 for earlier term 2. Current term is 3.
I20260709 13:09:19.515488 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:19.516158 28869 raft_consensus.cc:3060] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.517943 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:19.518623 28942 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.512867 29408 raft_consensus.cc:2804] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.521131 29408 raft_consensus.cc:493] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.521535 29408 raft_consensus.cc:3060] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.528822 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:19.529790 28790 raft_consensus.cc:2368] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 for earlier term 2. Current term is 3.
W20260709 13:09:19.530627 28833 consensus_peers.cc:597] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.533967 29379 raft_consensus.cc:493] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.534595 29379 raft_consensus.cc:515] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.535517 28942 raft_consensus.cc:2468] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 3.
I20260709 13:09:19.537590 29379 leader_election.cc:290] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:19.538779 28787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125abb8d87d437cb630354900d6e5b4" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:19.539860 28787 raft_consensus.cc:2468] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:19.541260 29495 consensus_queue.cc:237] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.544504 29379 consensus_queue.cc:1048] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.545562 29065 tablet_bootstrap.cc:654] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.551929 28836 leader_election.cc:304] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:19.553747 29493 raft_consensus.cc:2804] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.471449 29063 raft_consensus.cc:385] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.554651 29063 raft_consensus.cc:740] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
W20260709 13:09:19.501631 28981 leader_election.cc:343] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.553529 29378 raft_consensus.cc:515] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.562155 29493 raft_consensus.cc:493] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.654129 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125abb8d87d437cb630354900d6e5b4" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:19.657462 28984 leader_election.cc:304] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:19.657960 29493 raft_consensus.cc:3060] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:19.658188 28984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 137196us
I20260709 13:09:19.658527 29378 leader_election.cc:290] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:19.643011 29063 consensus_queue.cc:260] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
W20260709 13:09:19.662277 28981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40509, user_credentials={real_user=slave}} blocked reactor thread for 160669us
I20260709 13:09:19.663774 29063 ts_tablet_manager.cc:1434] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.243s	user 0.017s	sys 0.005s
I20260709 13:09:19.672780 29063 tablet_bootstrap.cc:492] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
I20260709 13:09:19.646713 29064 tablet_bootstrap.cc:492] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:19.680706 29493 raft_consensus.cc:515] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.659242 29486 raft_consensus.cc:2804] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.647801 29408 raft_consensus.cc:515] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.682214 29486 raft_consensus.cc:493] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.682629 29486 raft_consensus.cc:3060] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.683593 29408 leader_election.cc:290] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:19.683794 29493 leader_election.cc:290] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:19.684034 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125abb8d87d437cb630354900d6e5b4" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:19.684757 28790 raft_consensus.cc:3060] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.685088 29492 raft_consensus.cc:2749] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.690325 29065 tablet_bootstrap.cc:492] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
W20260709 13:09:19.690521 28758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 131847us
I20260709 13:09:19.690929 29065 ts_tablet_manager.cc:1403] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.216s	user 0.011s	sys 0.003s
I20260709 13:09:19.692070 28758 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:19.692891 29494 raft_consensus.cc:2804] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:19.693955 29494 raft_consensus.cc:697] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:19.694275 29065 raft_consensus.cc:359] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:19.695072 29065 raft_consensus.cc:385] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.695353 29065 raft_consensus.cc:740] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.696002 29065 consensus_queue.cc:260] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:19.697620 29065 ts_tablet_manager.cc:1434] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:09:19.698144 29066 tablet_bootstrap.cc:492] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: No bootstrap required, opened a new log
I20260709 13:09:19.670317 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128ca54c3ca34865935113dc7a9f0d21" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:19.695088 29494 consensus_queue.cc:237] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.698583 29065 tablet_bootstrap.cc:492] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:19.698659 29015 raft_consensus.cc:3060] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.652113 28869 raft_consensus.cc:2468] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 3.
I20260709 13:09:19.702119 28790 raft_consensus.cc:2468] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:19.705195 29065 tablet_bootstrap.cc:654] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:19.675087 28833 leader_election.cc:343] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.681901 29063 tablet_bootstrap.cc:654] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.660218 28984 leader_election.cc:400] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Vote denied by peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969) with higher term. Message: Invalid argument: T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 for earlier term 2. Current term is 3.
I20260709 13:09:19.706575 28984 leader_election.cc:403] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:09:19.707115 28984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 47032.3us
I20260709 13:09:19.681840 29064 tablet_bootstrap.cc:654] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.710342 29399 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.712770 29015 raft_consensus.cc:2468] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 3.
I20260709 13:09:19.714864 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e0029999088407b9d71307a13c1599b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:19.715564 29011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e0029999088407b9d71307a13c1599b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:19.716225 29011 raft_consensus.cc:3060] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.716893 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125abb8d87d437cb630354900d6e5b4" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
W20260709 13:09:19.719808 28833 leader_election.cc:343] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:19.721123 28833 leader_election.cc:343] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.727008 29399 raft_consensus.cc:2749] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969) with higher term. Message: Invalid argument: T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 for earlier term 2. Current term is 3.
I20260709 13:09:19.671172 28981 leader_election.cc:400] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509) with higher term. Message: Invalid argument: T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 for earlier term 2. Current term is 3.
I20260709 13:09:19.731961 28981 leader_election.cc:403] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:19.732652 29408 raft_consensus.cc:2749] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509) with higher term. Message: Invalid argument: T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 for earlier term 2. Current term is 3.
W20260709 13:09:19.732735 28981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.3:40509, user_credentials={real_user=slave}} blocked reactor thread for 61715.1us
I20260709 13:09:19.733901 29066 ts_tablet_manager.cc:1403] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.300s	user 0.012s	sys 0.008s
W20260709 13:09:19.744051 29487 log.cc:927] Time spent T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757: Append to log took a long time: real 0.053s	user 0.005s	sys 0.005s
I20260709 13:09:19.750155 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e014e29eece34924b34eaf88458e5ab4" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:19.664000 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:19.751778 28935 raft_consensus.cc:2368] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 for earlier term 2. Current term is 3.
I20260709 13:09:19.752059 28907 leader_election.cc:304] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:19.752985 29490 raft_consensus.cc:2804] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:19.731317 29011 raft_consensus.cc:2468] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:19.753726 29490 raft_consensus.cc:697] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 3 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
W20260709 13:09:19.755007 28981 leader_election.cc:343] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.754685 29490 consensus_queue.cc:237] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.755927 28981 leader_election.cc:400] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Vote denied by peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509) with higher term. Message: Invalid argument: T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d3a97b01f64816a2a769d159dd64d2 for earlier term 2. Current term is 3.
I20260709 13:09:19.759635 29064 tablet_bootstrap.cc:492] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:19.760131 29064 ts_tablet_manager.cc:1403] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.114s	user 0.008s	sys 0.002s
I20260709 13:09:19.763217 28693 catalog_manager.cc:5697] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.768668 28834 leader_election.cc:304] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:19.770395 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e014e29eece34924b34eaf88458e5ab4" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:19.775638 29495 raft_consensus.cc:2804] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.776096 28793 raft_consensus.cc:3060] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.776161 29495 raft_consensus.cc:697] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:19.776785 29399 raft_consensus.cc:493] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.777123 29495 consensus_queue.cc:237] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.772120 28836 leader_election.cc:304] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:19.787302 29399 raft_consensus.cc:515] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.792779 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:19.794483 28981 leader_election.cc:343] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.801119 29386 raft_consensus.cc:493] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.801733 29386 raft_consensus.cc:515] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.803871 28793 raft_consensus.cc:2468] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
W20260709 13:09:19.789659 28759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:46467, user_credentials={real_user=slave}} blocked reactor thread for 46958.9us
I20260709 13:09:19.789508 29399 leader_election.cc:290] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:19.811892 29486 raft_consensus.cc:515] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.791018 29493 raft_consensus.cc:2804] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.819133 29063 tablet_bootstrap.cc:492] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:19.819774 29063 ts_tablet_manager.cc:1403] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.147s	user 0.014s	sys 0.023s
I20260709 13:09:19.823004 29063 raft_consensus.cc:359] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.823848 29063 raft_consensus.cc:385] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.824199 29493 raft_consensus.cc:697] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:19.825219 29493 consensus_queue.cc:237] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.824218 29063 raft_consensus.cc:740] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.834429 29064 raft_consensus.cc:359] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.830165 28984 leader_election.cc:304] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:19.837122 29386 leader_election.cc:290] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:19.836954 29399 raft_consensus.cc:2804] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.838227 28789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:19.828306 29063 consensus_queue.cc:260] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.838946 29399 raft_consensus.cc:697] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:19.839885 29399 consensus_queue.cc:237] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.841612 29063 ts_tablet_manager.cc:1434] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.005s
I20260709 13:09:19.841089 28689 catalog_manager.cc:5697] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 3, leader changed from 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.844293 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ea2b150b444aab3e1430624fe2a3d" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:19.845284 29064 raft_consensus.cc:385] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.846139 29064 raft_consensus.cc:740] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
W20260709 13:09:19.847210 28981 leader_election.cc:343] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.854846 29486 leader_election.cc:290] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:19.855429 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:19.855644 29065 tablet_bootstrap.cc:492] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:19.856309 29065 ts_tablet_manager.cc:1403] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.158s	user 0.033s	sys 0.005s
I20260709 13:09:19.857456 28907 leader_election.cc:304] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:19.857877 29066 raft_consensus.cc:359] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.858502 29066 raft_consensus.cc:385] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.858704 29066 raft_consensus.cc:740] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.859242 29066 consensus_queue.cc:260] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.863153 29064 consensus_queue.cc:260] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:19.865945 29386 raft_consensus.cc:2749] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.868832 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:19.870823 28693 catalog_manager.cc:5697] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.871356 29065 raft_consensus.cc:359] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.865945 28789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ea2b150b444aab3e1430624fe2a3d" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:19.879142 29065 raft_consensus.cc:385] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.881973 29063 tablet_bootstrap.cc:492] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2: Bootstrap starting.
W20260709 13:09:19.883569 28981 leader_election.cc:343] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.884171 28981 leader_election.cc:304] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:19.882615 29065 raft_consensus.cc:740] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.886961 29065 consensus_queue.cc:260] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:19.860837 29486 raft_consensus.cc:493] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.889345 28789 raft_consensus.cc:3060] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.900614 29486 raft_consensus.cc:515] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.902889 29486 leader_election.cc:290] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:19.907079 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5ec54e7c44d24bc7d08fb0e839618" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:19.908759 28981 leader_election.cc:343] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.908166 28941 raft_consensus.cc:3060] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.919859 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5ec54e7c44d24bc7d08fb0e839618" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:19.920636 28794 raft_consensus.cc:2468] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:19.924937 29065 ts_tablet_manager.cc:1434] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:09:19.889814 29497 raft_consensus.cc:2749] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.930603 28984 leader_election.cc:304] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:19.931456 29066 ts_tablet_manager.cc:1434] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.197s	user 0.005s	sys 0.002s
I20260709 13:09:19.933395 29453 raft_consensus.cc:2804] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.933939 29453 raft_consensus.cc:493] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.934316 29453 raft_consensus.cc:3060] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.935585 29064 ts_tablet_manager.cc:1434] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.175s	user 0.008s	sys 0.001s
I20260709 13:09:19.936650 29065 tablet_bootstrap.cc:492] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:19.939409 28789 raft_consensus.cc:2468] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:19.961467 29064 tablet_bootstrap.cc:492] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:19.961983 28984 leader_election.cc:304] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
W20260709 13:09:19.937551 28759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.4:46467, user_credentials={real_user=slave}} blocked reactor thread for 115385us
I20260709 13:09:19.965514 29408 raft_consensus.cc:2804] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.966917 29408 raft_consensus.cc:697] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:19.967795 29408 consensus_queue.cc:237] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:19.970400 28690 catalog_manager.cc:5697] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.978587 29064 tablet_bootstrap.cc:654] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.978271 28690 catalog_manager.cc:5697] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.996670 29453 raft_consensus.cc:515] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:20.022927 29518 consensus_queue.cc:1048] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.032758 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5ec54e7c44d24bc7d08fb0e839618" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
W20260709 13:09:20.034410 28981 leader_election.cc:343] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.039848 28789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5ec54e7c44d24bc7d08fb0e839618" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:20.041237 28865 raft_consensus.cc:3060] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.042203 28789 raft_consensus.cc:3060] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.053635 29453 leader_election.cc:290] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:20.056996 29065 tablet_bootstrap.cc:654] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.059707 29064 tablet_bootstrap.cc:492] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:20.063854 29064 ts_tablet_manager.cc:1403] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.118s	user 0.028s	sys 0.034s
I20260709 13:09:20.066898 29064 raft_consensus.cc:359] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:20.067669 29064 raft_consensus.cc:385] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.067977 29064 raft_consensus.cc:740] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.068841 29064 consensus_queue.cc:260] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:20.071148 29064 ts_tablet_manager.cc:1434] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:09:20.059754 29063 tablet_bootstrap.cc:654] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.072209 29064 tablet_bootstrap.cc:492] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:20.078094 28789 raft_consensus.cc:2468] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:20.084362 28984 leader_election.cc:304] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:20.087738 29453 raft_consensus.cc:2804] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.088541 29453 raft_consensus.cc:697] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:20.089489 29453 consensus_queue.cc:237] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:20.093611 29064 tablet_bootstrap.cc:654] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.097213 29065 tablet_bootstrap.cc:492] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:20.103353 29065 ts_tablet_manager.cc:1403] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.000s
I20260709 13:09:20.107234 29063 tablet_bootstrap.cc:492] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2: No bootstrap required, opened a new log
I20260709 13:09:20.107859 29063 ts_tablet_manager.cc:1403] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2: Time spent bootstrapping tablet: real 0.249s	user 0.008s	sys 0.009s
I20260709 13:09:20.110323 29065 raft_consensus.cc:359] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.110532 29063 raft_consensus.cc:359] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.111078 29065 raft_consensus.cc:385] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.111411 29065 raft_consensus.cc:740] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.114778 29063 raft_consensus.cc:385] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.115146 29063 raft_consensus.cc:740] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.116282 29063 consensus_queue.cc:260] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.117707 28941 raft_consensus.cc:3060] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.119282 29063 ts_tablet_manager.cc:1434] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 13:09:20.120313 29065 consensus_queue.cc:260] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.123035 29065 ts_tablet_manager.cc:1434] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:20.123950 29064 tablet_bootstrap.cc:492] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:20.124603 29064 ts_tablet_manager.cc:1403] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.004s
I20260709 13:09:20.127260 29064 raft_consensus.cc:359] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.127920 29064 raft_consensus.cc:385] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.128197 29064 raft_consensus.cc:740] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.129073 29064 consensus_queue.cc:260] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.130123 29520 raft_consensus.cc:493] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.130663 29520 raft_consensus.cc:515] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:20.124066 29065 tablet_bootstrap.cc:492] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:20.133651 29520 leader_election.cc:290] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:20.133786 29011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547f10aff2e45b8b40cd1b4bddf42d5" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:20.134043 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547f10aff2e45b8b40cd1b4bddf42d5" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:20.135535 29064 ts_tablet_manager.cc:1434] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:20.135756 28908 leader_election.cc:304] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:20.136658 29064 tablet_bootstrap.cc:492] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:20.136761 29335 raft_consensus.cc:2749] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:20.139171 29065 tablet_bootstrap.cc:654] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.143397 29064 tablet_bootstrap.cc:654] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.149080 29064 tablet_bootstrap.cc:492] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:20.149376 29065 tablet_bootstrap.cc:492] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:20.149720 29064 ts_tablet_manager.cc:1403] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:09:20.149916 29065 ts_tablet_manager.cc:1403] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:09:20.152653 29064 raft_consensus.cc:359] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.152897 29065 raft_consensus.cc:359] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.153473 29064 raft_consensus.cc:385] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.153692 29065 raft_consensus.cc:385] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.153952 29064 raft_consensus.cc:740] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.154970 29064 consensus_queue.cc:260] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.157712 29064 ts_tablet_manager.cc:1434] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:20.158767 29064 tablet_bootstrap.cc:492] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:20.159498 29493 consensus_queue.cc:1048] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.154142 29065 raft_consensus.cc:740] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.166591 29065 consensus_queue.cc:260] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.170643 29065 ts_tablet_manager.cc:1434] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:09:20.171727 29065 tablet_bootstrap.cc:492] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:20.173499 28942 raft_consensus.cc:1275] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:20.175480 29398 consensus_queue.cc:1048] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:20.185428 28865 raft_consensus.cc:1275] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:20.187750 29011 raft_consensus.cc:1275] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:20.189440 29520 consensus_queue.cc:1048] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:20.190762 29335 consensus_queue.cc:1048] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:20.193790 29065 tablet_bootstrap.cc:654] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.196961 28689 catalog_manager.cc:5697] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.205886 29495 consensus_queue.cc:1048] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.227713 29064 tablet_bootstrap.cc:654] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.233743 29065 tablet_bootstrap.cc:492] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:20.234532 29065 ts_tablet_manager.cc:1403] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.000s
I20260709 13:09:20.243404 28940 raft_consensus.cc:3060] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.251348 29065 raft_consensus.cc:359] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.252386 29065 raft_consensus.cc:385] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.252686 29065 raft_consensus.cc:740] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.263979 29492 consensus_queue.cc:1048] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.264349 29011 raft_consensus.cc:1275] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:20.268409 29521 consensus_queue.cc:1048] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:20.274590 29520 raft_consensus.cc:493] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.275511 29520 raft_consensus.cc:515] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.279366 29520 leader_election.cc:290] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:20.280262 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e0029999088407b9d71307a13c1599b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:20.281044 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e0029999088407b9d71307a13c1599b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:20.253373 29065 consensus_queue.cc:260] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.286307 29065 ts_tablet_manager.cc:1434] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:09:20.287577 29493 consensus_queue.cc:1048] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.292943 29065 tablet_bootstrap.cc:492] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:20.294523 28908 leader_election.cc:304] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:20.293677 29497 consensus_queue.cc:1048] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:20.295840 29520 raft_consensus.cc:2749] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:20.319360 29495 raft_consensus.cc:493] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.312047 29360 raft_consensus.cc:493] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.319990 29495 raft_consensus.cc:515] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.320775 29360 raft_consensus.cc:515] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.322943 29360 leader_election.cc:290] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:20.323154 29495 leader_election.cc:290] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:20.324292 28935 raft_consensus.cc:3060] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.324141 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3ea20eff10460186a8e96381d02883" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:20.324918 29065 tablet_bootstrap.cc:654] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.356244 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3ea20eff10460186a8e96381d02883" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:20.357092 28793 raft_consensus.cc:2468] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:20.348678 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:20.358709 28790 raft_consensus.cc:2393] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89867186bb4546988c8fcd2b9fea8757 in current term 1: Already voted for candidate 7f68815192fc48a58a67ddf2da3bac70 in this term.
I20260709 13:09:20.358795 28836 leader_election.cc:304] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:20.332010 29490 raft_consensus.cc:493] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.361158 29363 raft_consensus.cc:2804] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.361671 29363 raft_consensus.cc:493] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:20.360873 28833 leader_election.cc:343] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.349224 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:20.364648 29009 raft_consensus.cc:2393] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89867186bb4546988c8fcd2b9fea8757 in current term 1: Already voted for candidate f3d3a97b01f64816a2a769d159dd64d2 in this term.
I20260709 13:09:20.367785 28834 leader_election.cc:304] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:20.369841 29492 raft_consensus.cc:3060] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.361296 29490 raft_consensus.cc:515] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.374609 29490 leader_election.cc:290] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:20.375770 28936 raft_consensus.cc:3060] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.376350 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125abb8d87d437cb630354900d6e5b4" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:20.362048 29363 raft_consensus.cc:3060] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.383134 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125abb8d87d437cb630354900d6e5b4" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:20.386677 28907 leader_election.cc:304] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:20.391870 28689 catalog_manager.cc:5697] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.394421 28689 catalog_manager.cc:5697] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.461913 29497 raft_consensus.cc:493] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.451294 29520 raft_consensus.cc:2749] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:20.466176 29497 raft_consensus.cc:515] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.482631 29453 consensus_queue.cc:1048] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.496958 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f7afbd6bd14202b784bc4c24b71bd1" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
W20260709 13:09:20.464288 29541 log.cc:927] Time spent T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:20.503129 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f7afbd6bd14202b784bc4c24b71bd1" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:20.504056 28795 raft_consensus.cc:2468] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 0.
I20260709 13:09:20.476171 29497 leader_election.cc:290] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:20.440464 29492 raft_consensus.cc:2749] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:20.514986 28984 leader_election.cc:304] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:20.515466 29363 raft_consensus.cc:515] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.518539 29065 tablet_bootstrap.cc:492] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:20.522701 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3ea20eff10460186a8e96381d02883" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:20.523288 29065 ts_tablet_manager.cc:1403] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.231s	user 0.028s	sys 0.007s
I20260709 13:09:20.523761 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3ea20eff10460186a8e96381d02883" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
W20260709 13:09:20.523979 28833 leader_election.cc:343] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.518985 29408 raft_consensus.cc:2804] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:20.526919 28981 consensus_peers.cc:597] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.526175 29065 raft_consensus.cc:359] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.528327 29065 raft_consensus.cc:385] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.528698 29065 raft_consensus.cc:740] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
W20260709 13:09:20.528918 28981 leader_election.cc:343] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.533146 29065 consensus_queue.cc:260] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.524400 28793 raft_consensus.cc:3060] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.527737 29408 raft_consensus.cc:493] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.524784 29363 leader_election.cc:290] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:20.551426 29065 ts_tablet_manager.cc:1434] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:09:20.561087 29065 tablet_bootstrap.cc:492] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757: Bootstrap starting.
I20260709 13:09:20.562999 29064 tablet_bootstrap.cc:492] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:20.563581 29064 ts_tablet_manager.cc:1403] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.405s	user 0.048s	sys 0.036s
I20260709 13:09:20.553251 29379 raft_consensus.cc:493] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.554455 29408 raft_consensus.cc:3060] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.581339 29378 raft_consensus.cc:493] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.581919 29378 raft_consensus.cc:515] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.563357 29363 consensus_queue.cc:1048] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:09:20.583972 29378 leader_election.cc:290] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:20.588363 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7fd30052d142679c225954b5b5724b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:20.604430 28833 leader_election.cc:343] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.617660 29064 raft_consensus.cc:359] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:20.618562 29064 raft_consensus.cc:385] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.618860 29064 raft_consensus.cc:740] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.619577 29064 consensus_queue.cc:260] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:20.594847 29379 raft_consensus.cc:515] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.622704 29379 leader_election.cc:290] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:20.626322 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1293cb1f6ed468da880ff1ee758b3b4" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
W20260709 13:09:20.628381 28833 leader_election.cc:343] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.633659 28789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1293cb1f6ed468da880ff1ee758b3b4" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:20.634464 28789 raft_consensus.cc:2468] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
W20260709 13:09:20.639411 28981 consensus_peers.cc:597] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.646965 29065 tablet_bootstrap.cc:654] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:20.636574 28741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:20.644950 28836 leader_election.cc:304] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:20.650828 29064 ts_tablet_manager.cc:1434] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.000s
W20260709 13:09:20.652042 28984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 119332us
I20260709 13:09:20.654029 29492 raft_consensus.cc:2804] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.670054 29492 raft_consensus.cc:493] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.670491 29492 raft_consensus.cc:3060] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.687330 29064 tablet_bootstrap.cc:492] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:20.690171 29408 raft_consensus.cc:515] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.731294 28793 raft_consensus.cc:2468] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:20.734557 28836 leader_election.cc:304] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:20.735756 29379 raft_consensus.cc:2804] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.736313 29379 raft_consensus.cc:697] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:20.737097 29408 leader_election.cc:290] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:20.737628 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7fd30052d142679c225954b5b5724b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:20.737138 29379 consensus_queue.cc:237] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.738255 29015 raft_consensus.cc:2468] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:20.746773 29064 tablet_bootstrap.cc:654] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.728221 29492 raft_consensus.cc:515] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.760489 29492 leader_election.cc:290] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:20.761183 28793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1293cb1f6ed468da880ff1ee758b3b4" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:20.762548 28935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1293cb1f6ed468da880ff1ee758b3b4" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
W20260709 13:09:20.764345 28833 leader_election.cc:343] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.762526 28793 raft_consensus.cc:3060] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.771329 29065 tablet_bootstrap.cc:492] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757: No bootstrap required, opened a new log
I20260709 13:09:20.771955 29065 ts_tablet_manager.cc:1403] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757: Time spent bootstrapping tablet: real 0.211s	user 0.011s	sys 0.003s
I20260709 13:09:20.782768 29065 raft_consensus.cc:359] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.783574 29065 raft_consensus.cc:385] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.789961 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f7afbd6bd14202b784bc4c24b71bd1" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:20.784046 29065 raft_consensus.cc:740] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.795539 28793 raft_consensus.cc:2468] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:20.795718 29065 consensus_queue.cc:260] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.803921 29492 raft_consensus.cc:493] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.818390 29492 raft_consensus.cc:515] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.822708 28836 leader_election.cc:304] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:20.817855 28869 raft_consensus.cc:3060] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.823525 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:20.823868 29360 raft_consensus.cc:2804] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.825870 29360 raft_consensus.cc:697] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:20.826704 29360 consensus_queue.cc:237] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:20.829356 28833 leader_election.cc:343] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.832260 29548 raft_consensus.cc:493] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.832582 29492 leader_election.cc:290] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
W20260709 13:09:20.836428 28981 consensus_peers.cc:597] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.841086 28834 leader_election.cc:304] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:20.844790 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f7afbd6bd14202b784bc4c24b71bd1" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:20.845588 28794 raft_consensus.cc:3060] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.838943 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:20.843667 29548 raft_consensus.cc:515] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:20.847031 29553 consensus_queue.cc:1048] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:09:20.856175 28794 raft_consensus.cc:2468] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:20.835155 28869 raft_consensus.cc:2468] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:20.849386 29495 raft_consensus.cc:2804] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.857461 29495 raft_consensus.cc:493] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.857816 29495 raft_consensus.cc:3060] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.858151 29009 raft_consensus.cc:2468] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 0.
I20260709 13:09:20.862540 28984 leader_election.cc:304] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:20.863991 29563 raft_consensus.cc:2804] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.864553 29563 raft_consensus.cc:697] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:20.865401 29563 consensus_queue.cc:237] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.867854 29065 ts_tablet_manager.cc:1434] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.006s
I20260709 13:09:20.868817 29398 raft_consensus.cc:493] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.869421 29398 raft_consensus.cc:515] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.873803 28834 leader_election.cc:304] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:20.880173 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e014e29eece34924b34eaf88458e5ab4" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:20.881481 29548 leader_election.cc:290] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:20.889813 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e014e29eece34924b34eaf88458e5ab4" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:20.891911 28910 leader_election.cc:304] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:20.892931 29064 tablet_bootstrap.cc:492] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:20.893232 29548 raft_consensus.cc:2749] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:20.893469 29064 ts_tablet_manager.cc:1403] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.211s	user 0.019s	sys 0.037s
I20260709 13:09:20.885106 29518 raft_consensus.cc:2804] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.896095 29518 raft_consensus.cc:493] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.896452 29518 raft_consensus.cc:3060] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.897240 29064 raft_consensus.cc:359] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.898005 29064 raft_consensus.cc:385] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.898384 29064 raft_consensus.cc:740] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.899165 29064 consensus_queue.cc:260] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:20.901358 29064 ts_tablet_manager.cc:1434] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:20.903839 29398 leader_election.cc:290] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:20.904632 28690 catalog_manager.cc:5697] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.908289 29064 tablet_bootstrap.cc:492] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:20.913281 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:20.914067 29014 raft_consensus.cc:2468] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:20.916743 29495 raft_consensus.cc:515] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.917629 29064 tablet_bootstrap.cc:654] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.918643 28759 leader_election.cc:304] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:20.919749 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7fd30052d142679c225954b5b5724b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
W20260709 13:09:20.921196 28833 leader_election.cc:343] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.922995 29398 raft_consensus.cc:2804] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.923497 29398 raft_consensus.cc:493] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.923902 29398 raft_consensus.cc:3060] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.946641 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:20.957222 28869 raft_consensus.cc:2468] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 1.
I20260709 13:09:20.949754 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7fd30052d142679c225954b5b5724b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:20.949993 28692 catalog_manager.cc:5697] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.958739 29495 leader_election.cc:290] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:20.947165 29518 raft_consensus.cc:515] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:20.988009 29014 raft_consensus.cc:3060] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.989902 29518 leader_election.cc:290] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:20.962105 29398 raft_consensus.cc:515] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:20.991307 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:20.991978 29398 leader_election.cc:290] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:20.992010 29015 raft_consensus.cc:3060] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.994982 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:20.995651 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:20.998898 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:20.999581 29009 raft_consensus.cc:3060] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.004804 29014 raft_consensus.cc:2468] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:21.006106 28834 leader_election.cc:304] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:21.006429 29015 raft_consensus.cc:2468] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
W20260709 13:09:21.007440 28833 leader_election.cc:343] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.007966 28834 leader_election.cc:304] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:21.008189 29495 raft_consensus.cc:2804] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.009164 29492 raft_consensus.cc:2804] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.009528 29495 raft_consensus.cc:697] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:21.009773 29492 raft_consensus.cc:697] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:21.010445 29495 consensus_queue.cc:237] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:21.010766 29492 consensus_queue.cc:237] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:21.021010 28936 raft_consensus.cc:3060] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.022739 29009 raft_consensus.cc:2468] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:21.026147 28759 leader_election.cc:304] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:21.024260 28693 catalog_manager.cc:5697] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 1 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.027550 29398 raft_consensus.cc:2804] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.028090 29398 raft_consensus.cc:697] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:21.028980 29398 consensus_queue.cc:237] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:21.040632 29064 tablet_bootstrap.cc:492] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:21.041205 29064 ts_tablet_manager.cc:1403] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.133s	user 0.035s	sys 0.022s
I20260709 13:09:21.062028 29064 raft_consensus.cc:359] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:21.062736 29064 raft_consensus.cc:385] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.063014 29064 raft_consensus.cc:740] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.063755 29064 consensus_queue.cc:260] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:21.067054 29064 ts_tablet_manager.cc:1434] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:09:21.068178 29064 tablet_bootstrap.cc:492] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:21.074182 29064 tablet_bootstrap.cc:654] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.079502 28691 catalog_manager.cc:5697] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.097281 29064 tablet_bootstrap.cc:492] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:21.097867 29064 ts_tablet_manager.cc:1403] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.000s
I20260709 13:09:21.101132 29064 raft_consensus.cc:359] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:21.101830 29064 raft_consensus.cc:385] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.102070 29548 raft_consensus.cc:493] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.102610 29548 raft_consensus.cc:515] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:21.104830 29548 leader_election.cc:290] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:21.106199 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ea2b150b444aab3e1430624fe2a3d" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:21.102083 29064 raft_consensus.cc:740] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.109439 29064 consensus_queue.cc:260] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:21.111723 29064 ts_tablet_manager.cc:1434] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:21.112849 29064 tablet_bootstrap.cc:492] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:21.114225 28693 catalog_manager.cc:5697] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.116430 28693 catalog_manager.cc:5697] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.119053 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ea2b150b444aab3e1430624fe2a3d" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:21.121055 28908 leader_election.cc:304] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:21.121850 29548 raft_consensus.cc:2749] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:21.124240 29064 tablet_bootstrap.cc:654] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.131450 29064 tablet_bootstrap.cc:492] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:21.131886 29064 ts_tablet_manager.cc:1403] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.005s
I20260709 13:09:21.134022 29064 raft_consensus.cc:359] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:21.134644 29064 raft_consensus.cc:385] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.134912 29064 raft_consensus.cc:740] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.135680 29064 consensus_queue.cc:260] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:21.138440 29064 ts_tablet_manager.cc:1434] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:09:21.143689 29064 tablet_bootstrap.cc:492] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:21.150640 29064 tablet_bootstrap.cc:654] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.155200 29064 tablet_bootstrap.cc:492] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:21.155623 29064 ts_tablet_manager.cc:1403] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:09:21.157611 29064 raft_consensus.cc:359] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:21.158144 29064 raft_consensus.cc:385] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.158353 29064 raft_consensus.cc:740] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.158927 29064 consensus_queue.cc:260] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:21.160653 29064 ts_tablet_manager.cc:1434] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:21.163730 29064 tablet_bootstrap.cc:492] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290: Bootstrap starting.
I20260709 13:09:21.169454 29064 tablet_bootstrap.cc:654] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.173728 29064 tablet_bootstrap.cc:492] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290: No bootstrap required, opened a new log
I20260709 13:09:21.174218 29064 ts_tablet_manager.cc:1403] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:09:21.176855 29064 raft_consensus.cc:359] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:21.177467 29064 raft_consensus.cc:385] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.177697 29064 raft_consensus.cc:740] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.178332 29064 consensus_queue.cc:260] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:21.182703 29064 ts_tablet_manager.cc:1434] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:09:21.209970 28936 raft_consensus.cc:3060] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.217998 29495 consensus_queue.cc:1048] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:21.244796 29490 raft_consensus.cc:493] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.245339 29490 raft_consensus.cc:515] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:21.247484 29490 leader_election.cc:290] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:21.248428 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5ec54e7c44d24bc7d08fb0e839618" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:21.248987 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5ec54e7c44d24bc7d08fb0e839618" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:21.251514 28908 leader_election.cc:304] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:21.252410 29490 raft_consensus.cc:2749] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:21.258689 28936 raft_consensus.cc:3060] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.265731 29492 consensus_queue.cc:1048] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.271826 29562 consensus_queue.cc:1048] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:21.324083 29563 consensus_queue.cc:1048] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.358330 29495 consensus_queue.cc:1048] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.359217 29548 raft_consensus.cc:493] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.364679 29548 raft_consensus.cc:515] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:21.370380 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:21.371580 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:21.372363 29015 raft_consensus.cc:2393] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 1: Already voted for candidate 89867186bb4546988c8fcd2b9fea8757 in this term.
I20260709 13:09:21.375164 28907 leader_election.cc:304] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:21.366947 29548 leader_election.cc:290] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:21.378151 29490 raft_consensus.cc:3060] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.385218 28936 raft_consensus.cc:3060] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.398748 29490 raft_consensus.cc:2749] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:21.401120 29495 consensus_queue.cc:1048] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.448812 28864 raft_consensus.cc:3060] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.454838 28864 raft_consensus.cc:1275] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:21.456103 29398 consensus_queue.cc:1048] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.474342 29015 raft_consensus.cc:1275] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:21.478220 29555 consensus_queue.cc:1048] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.500962 29495 consensus_queue.cc:1048] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.520002 29495 consensus_queue.cc:1048] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.539096 29518 consensus_queue.cc:1048] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.550165 28935 raft_consensus.cc:3060] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.582015 29490 raft_consensus.cc:493] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.582537 29490 raft_consensus.cc:515] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:21.586143 29490 leader_election.cc:290] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:21.586504 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7fd30052d142679c225954b5b5724b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:21.588308 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7fd30052d142679c225954b5b5724b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:21.589944 28908 leader_election.cc:304] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:21.590000 28936 raft_consensus.cc:3060] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.591233 29490 raft_consensus.cc:2749] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.593572 29518 consensus_queue.cc:1048] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.957042 21312 tablet_server.cc:179] TabletServer@127.20.208.1:0 shutting down...
W20260709 13:09:22.973393 28984 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 513 similar messages]
W20260709 13:09:22.990273 28984 consensus_peers.cc:597] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.995829 28984 consensus_peers.cc:597] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.996897 28836 consensus_peers.cc:597] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.018851 28984 consensus_peers.cc:597] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.027944 28836 consensus_peers.cc:597] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.032969 28984 consensus_peers.cc:597] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.036329 28910 consensus_peers.cc:597] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.039007 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:23.040025 28836 consensus_peers.cc:597] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.040783 21312 tablet_replica.cc:333] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.041738 21312 raft_consensus.cc:2243] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.042354 21312 raft_consensus.cc:2272] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.045126 21312 tablet_replica.cc:333] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.045915 21312 raft_consensus.cc:2243] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.047371 21312 raft_consensus.cc:2272] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.050074 21312 tablet_replica.cc:333] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.050936 21312 raft_consensus.cc:2243] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.051498 21312 raft_consensus.cc:2272] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.053956 21312 tablet_replica.cc:333] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
W20260709 13:09:23.053988 28984 consensus_peers.cc:597] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.054858 21312 raft_consensus.cc:2243] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.055375 21312 raft_consensus.cc:2272] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:23.065610 28984 consensus_peers.cc:597] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.070830 28836 consensus_peers.cc:597] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.072337 21312 tablet_replica.cc:333] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.073135 21312 raft_consensus.cc:2243] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.073601 21312 raft_consensus.cc:2272] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.075732 21312 tablet_replica.cc:333] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.076537 21312 raft_consensus.cc:2243] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.076980 21312 raft_consensus.cc:2272] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:23.077162 28910 consensus_peers.cc:597] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.078791 21312 tablet_replica.cc:333] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.079538 21312 raft_consensus.cc:2243] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.079970 21312 raft_consensus.cc:2272] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.084465 21312 tablet_replica.cc:333] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.085608 21312 raft_consensus.cc:2243] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.086174 21312 raft_consensus.cc:2272] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.088758 21312 tablet_replica.cc:333] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.089565 21312 raft_consensus.cc:2243] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.090466 21312 raft_consensus.cc:2272] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.093477 21312 tablet_replica.cc:333] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.094339 21312 raft_consensus.cc:2243] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.094905 21312 raft_consensus.cc:2272] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.097106 21312 tablet_replica.cc:333] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.097702 21312 raft_consensus.cc:2243] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.098165 21312 raft_consensus.cc:2272] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.100271 21312 tablet_replica.cc:333] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.100868 21312 raft_consensus.cc:2243] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.101619 21312 raft_consensus.cc:2272] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.103526 21312 tablet_replica.cc:333] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.104076 21312 raft_consensus.cc:2243] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.104918 21312 raft_consensus.cc:2272] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.107292 21312 tablet_replica.cc:333] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.108105 21312 raft_consensus.cc:2243] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.108677 21312 raft_consensus.cc:2272] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.111326 21312 tablet_replica.cc:333] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
W20260709 13:09:23.111981 28984 consensus_peers.cc:597] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.112067 21312 raft_consensus.cc:2243] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.113265 21312 raft_consensus.cc:2272] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.115247 21312 tablet_replica.cc:333] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.115897 21312 raft_consensus.cc:2243] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.116339 21312 raft_consensus.cc:2272] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.118649 21312 tablet_replica.cc:333] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.119269 21312 raft_consensus.cc:2243] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.120654 21312 raft_consensus.cc:2272] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.123587 21312 tablet_replica.cc:333] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.124415 21312 raft_consensus.cc:2243] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.124918 21312 raft_consensus.cc:2272] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.128245 21312 tablet_replica.cc:333] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.129420 21312 raft_consensus.cc:2243] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.129952 21312 raft_consensus.cc:2272] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:23.130559 28984 consensus_peers.cc:597] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.132315 21312 tablet_replica.cc:333] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.133245 21312 raft_consensus.cc:2243] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.133816 21312 raft_consensus.cc:2272] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.136549 21312 tablet_replica.cc:333] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.137315 21312 raft_consensus.cc:2243] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.138309 21312 raft_consensus.cc:2272] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.141284 21312 tablet_replica.cc:333] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.142030 21312 raft_consensus.cc:2243] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.142537 21312 raft_consensus.cc:2272] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.145231 21312 tablet_replica.cc:333] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.146020 21312 raft_consensus.cc:2243] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.146579 21312 raft_consensus.cc:2272] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.149197 21312 tablet_replica.cc:333] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.149996 21312 raft_consensus.cc:2243] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.150838 21312 raft_consensus.cc:2272] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.153901 21312 tablet_replica.cc:333] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.154713 21312 raft_consensus.cc:2243] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.155280 21312 raft_consensus.cc:2272] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.158054 21312 tablet_replica.cc:333] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
W20260709 13:09:23.158609 28984 consensus_peers.cc:597] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.158876 21312 raft_consensus.cc:2243] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.159546 21312 raft_consensus.cc:2272] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.162282 21312 tablet_replica.cc:333] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.163087 21312 raft_consensus.cc:2243] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.163638 21312 raft_consensus.cc:2272] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.166437 21312 tablet_replica.cc:333] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.167234 21312 raft_consensus.cc:2243] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.167761 21312 raft_consensus.cc:2272] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.170490 21312 tablet_replica.cc:333] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.171332 21312 raft_consensus.cc:2243] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.171871 21312 raft_consensus.cc:2272] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.174510 21312 tablet_replica.cc:333] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.175271 21312 raft_consensus.cc:2243] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.175833 21312 raft_consensus.cc:2272] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.178625 21312 tablet_replica.cc:333] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.179383 21312 raft_consensus.cc:2243] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.180375 21312 raft_consensus.cc:2272] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.183583 21312 tablet_replica.cc:333] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.184350 21312 raft_consensus.cc:2243] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.184947 21312 raft_consensus.cc:2272] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.187578 21312 tablet_replica.cc:333] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.188365 21312 raft_consensus.cc:2243] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.189469 21312 raft_consensus.cc:2272] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.192126 21312 tablet_replica.cc:333] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.192911 21312 raft_consensus.cc:2243] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.193436 21312 raft_consensus.cc:2272] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.196112 21312 tablet_replica.cc:333] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.196902 21312 raft_consensus.cc:2243] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.197446 21312 raft_consensus.cc:2272] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.200268 21312 tablet_replica.cc:333] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.201041 21312 raft_consensus.cc:2243] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.201606 21312 raft_consensus.cc:2272] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.204516 21312 tablet_replica.cc:333] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.205313 21312 raft_consensus.cc:2243] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.206327 21312 raft_consensus.cc:2272] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.209316 21312 tablet_replica.cc:333] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.210078 21312 raft_consensus.cc:2243] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.211112 21312 raft_consensus.cc:2272] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.225732 21312 tablet_replica.cc:333] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.226593 21312 raft_consensus.cc:2243] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.227195 21312 raft_consensus.cc:2272] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.233515 21312 tablet_replica.cc:333] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.234282 21312 raft_consensus.cc:2243] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.235356 21312 raft_consensus.cc:2272] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:23.235520 28836 consensus_peers.cc:597] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.236452 28836 consensus_peers.cc:597] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.238317 21312 tablet_replica.cc:333] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.239257 21312 raft_consensus.cc:2243] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.239856 21312 raft_consensus.cc:2272] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.242528 21312 tablet_replica.cc:333] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.243254 21312 raft_consensus.cc:2243] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.244375 21312 raft_consensus.cc:2272] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:23.246094 28984 consensus_peers.cc:597] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.247155 21312 tablet_replica.cc:333] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
W20260709 13:09:23.246244 28836 consensus_peers.cc:597] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.247931 21312 raft_consensus.cc:2243] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.248508 21312 raft_consensus.cc:2272] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.251241 21312 tablet_replica.cc:333] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
W20260709 13:09:23.251878 28984 consensus_peers.cc:597] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.252071 21312 raft_consensus.cc:2243] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.252737 21312 raft_consensus.cc:2272] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:23.253760 28984 consensus_peers.cc:597] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.254441 28984 consensus_peers.cc:597] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.255143 21312 tablet_replica.cc:333] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: stopping tablet replica
I20260709 13:09:23.255873 21312 raft_consensus.cc:2243] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.256410 21312 raft_consensus.cc:2272] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:23.261790 28836 consensus_peers.cc:597] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.267508 28984 consensus_peers.cc:597] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.280340 28984 consensus_peers.cc:597] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.312263 28836 consensus_peers.cc:597] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.336717 28984 consensus_peers.cc:597] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.348367 21312 tablet_server.cc:196] TabletServer@127.20.208.1:0 shutdown complete.
W20260709 13:09:23.366477 28984 consensus_peers.cc:597] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.443531 28836 consensus_peers.cc:597] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.456560 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:23.467235 29605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.482204 28836 consensus_peers.cc:597] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.496273 29606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:23.501164 28910 consensus_peers.cc:597] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.516906 29610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:23.523703 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:23.526778 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:23.527098 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:23.527319 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602563527300 us; error 0 us; skew 500 ppm
I20260709 13:09:23.528051 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:09:23.567927 28836 consensus_peers.cc:597] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.688995 21312 webserver.cc:533] Webserver started at http://127.20.208.1:40589/ using document root <none> and password file <none>
I20260709 13:09:23.689651 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:23.689867 21312 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:23.694224 21312 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:09:23.702857 29617 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:23.704603 21312 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:23.705015 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-0-root
uuid: "7f68815192fc48a58a67ddf2da3bac70"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-6j4g"
I20260709 13:09:23.705588 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326409895-21312-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:23.735971 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:23.737681 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:23.740947 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:23.754207 29624 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:09:24.129083 29597 raft_consensus.cc:493] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.130927 29597 raft_consensus.cc:515] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.135017 29564 raft_consensus.cc:493] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.149480 29564 raft_consensus.cc:515] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.162088 29597 leader_election.cc:290] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:24.171885 28910 leader_election.cc:336] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.186993 29564 leader_election.cc:290] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:24.199409 29628 raft_consensus.cc:493] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.200363 29628 raft_consensus.cc:515] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.207763 29628 leader_election.cc:290] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.220134 29603 raft_consensus.cc:493] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.229663 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.221100 29603 raft_consensus.cc:515] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:24.231822 28984 leader_election.cc:336] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.232936 29603 leader_election.cc:290] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.235598 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:24.238577 28908 leader_election.cc:304] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:24.240635 29597 raft_consensus.cc:2749] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.241681 29495 raft_consensus.cc:493] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.245689 29495 raft_consensus.cc:515] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.248116 29495 leader_election.cc:290] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.251196 29597 raft_consensus.cc:493] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.252262 29597 raft_consensus.cc:515] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.253759 29613 raft_consensus.cc:493] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.254637 29613 raft_consensus.cc:515] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.258607 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:09:24.259173 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.512s	user 0.014s	sys 0.000s
I20260709 13:09:24.259740 21312 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:09:24.261714 29613 leader_election.cc:290] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:24.262840 28910 leader_election.cc:336] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
W20260709 13:09:24.265394 28984 leader_election.cc:336] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.269073 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f5b8a34d8d42c7958b3e1a2423802c" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.270349 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:24.270771 29597 leader_election.cc:290] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:24.271968 28981 leader_election.cc:304] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:24.277716 29564 raft_consensus.cc:2749] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.285244 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:24.288412 29492 raft_consensus.cc:493] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.289288 29492 raft_consensus.cc:515] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.290503 28907 leader_election.cc:304] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:24.291988 29597 raft_consensus.cc:2749] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.293020 29564 raft_consensus.cc:493] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.293649 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.293936 29564 raft_consensus.cc:515] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.294497 29014 raft_consensus.cc:2468] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:24.295786 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.296275 29564 leader_election.cc:290] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:24.297457 29597 raft_consensus.cc:493] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.298275 29597 raft_consensus.cc:515] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.298753 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:24.299523 28936 raft_consensus.cc:2468] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:24.300845 28833 leader_election.cc:304] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:24.301937 29627 raft_consensus.cc:2804] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.302002 29624 tablet_bootstrap.cc:492] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:24.306975 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.291857 29492 leader_election.cc:290] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
W20260709 13:09:24.310859 28910 leader_election.cc:336] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.311647 29597 leader_election.cc:290] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.310814 28981 leader_election.cc:304] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:24.303603 29627 raft_consensus.cc:493] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.313421 29627 raft_consensus.cc:3060] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.316972 28908 leader_election.cc:304] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:24.317982 29597 raft_consensus.cc:2804] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.318358 29628 raft_consensus.cc:2749] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.318424 29597 raft_consensus.cc:493] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.321118 29597 raft_consensus.cc:3060] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:24.323112 28836 leader_election.cc:336] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.323668 28836 leader_election.cc:304] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
W20260709 13:09:24.329624 28910 leader_election.cc:336] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.329792 29492 raft_consensus.cc:2749] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.330207 28910 leader_election.cc:304] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:24.330983 29613 raft_consensus.cc:2749] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:24.331887 28836 leader_election.cc:336] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.332517 28836 leader_election.cc:304] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:24.333263 29492 raft_consensus.cc:2749] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.334452 29614 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.335184 29614 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
W20260709 13:09:24.337469 28984 leader_election.cc:336] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.337164 29628 raft_consensus.cc:493] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.338263 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:24.341306 29628 raft_consensus.cc:515] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.343910 29628 leader_election.cc:290] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
W20260709 13:09:24.339313 28836 leader_election.cc:336] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.345818 29614 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.346500 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.347260 28981 leader_election.cc:304] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:24.347776 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f5b8a34d8d42c7958b3e1a2423802c" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:24.348421 28869 raft_consensus.cc:2468] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:24.348624 29597 raft_consensus.cc:515] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.350762 28981 leader_election.cc:304] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.351043 29597 leader_election.cc:290] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.351634 29558 raft_consensus.cc:2804] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.352130 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996feb2bbcd43b4b8cef11d3cea4e91" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:24.351327 29628 raft_consensus.cc:2749] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.352850 29014 raft_consensus.cc:3060] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.352069 29558 raft_consensus.cc:493] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.355093 29558 raft_consensus.cc:3060] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.361184 29627 raft_consensus.cc:515] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.369696 29014 raft_consensus.cc:2468] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
W20260709 13:09:24.371158 28836 leader_election.cc:336] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.372241 29626 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.379490 29626 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.379837 28908 leader_election.cc:304] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.380759 29614 raft_consensus.cc:2804] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.381424 29614 raft_consensus.cc:697] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:24.382592 29614 consensus_queue.cc:237] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.383018 29626 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.378906 29624 tablet_bootstrap.cc:492] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.384600 29624 tablet_bootstrap.cc:492] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:24.384713 29627 leader_election.cc:290] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:24.385388 29624 ts_tablet_manager.cc:1403] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.014s
I20260709 13:09:24.388036 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:24.388797 28942 raft_consensus.cc:3060] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.396749 29558 raft_consensus.cc:515] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.397403 28942 raft_consensus.cc:2468] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 2.
W20260709 13:09:24.397951 28910 leader_election.cc:336] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.399035 28833 leader_election.cc:304] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:24.399897 29627 raft_consensus.cc:2804] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.399577 29624 raft_consensus.cc:359] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.400413 29624 raft_consensus.cc:740] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.400466 29627 raft_consensus.cc:697] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:24.401732 29627 consensus_queue.cc:237] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.401842 29624 consensus_queue.cc:260] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.405125 29492 raft_consensus.cc:493] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.405908 29492 raft_consensus.cc:515] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.408838 28910 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:24.409718 29597 raft_consensus.cc:2749] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:24.409952 28910 leader_election.cc:336] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.410849 29634 raft_consensus.cc:493] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.411502 29634 raft_consensus.cc:515] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.411945 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:24.412668 28942 raft_consensus.cc:2468] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 3.
I20260709 13:09:24.413877 29634 leader_election.cc:290] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.416290 29624 ts_tablet_manager.cc:1434] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.009s
I20260709 13:09:24.417343 29624 tablet_bootstrap.cc:492] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:24.420117 28836 leader_election.cc:336] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.423065 28981 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.423893 29626 raft_consensus.cc:493] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.424983 29492 leader_election.cc:290] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.423990 29628 raft_consensus.cc:2804] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:24.425858 29628 raft_consensus.cc:493] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.426245 29628 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.424772 29626 raft_consensus.cc:515] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:24.438820 28836 leader_election.cc:336] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.441462 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f5b8a34d8d42c7958b3e1a2423802c" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:24.442070 28869 raft_consensus.cc:3060] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.442807 29626 leader_election.cc:290] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:24.443468 29558 leader_election.cc:290] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
W20260709 13:09:24.441355 28984 leader_election.cc:336] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.446290 29624 tablet_bootstrap.cc:492] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.435858 28692 catalog_manager.cc:5697] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 1 to 2, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.447526 29624 tablet_bootstrap.cc:492] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:24.448292 29624 ts_tablet_manager.cc:1403] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 13:09:24.456257 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:24.457015 28868 raft_consensus.cc:2468] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:24.455933 29624 raft_consensus.cc:359] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.458047 29624 raft_consensus.cc:740] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.458043 28869 raft_consensus.cc:2468] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 2.
I20260709 13:09:24.458920 29624 consensus_queue.cc:260] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.460918 28981 leader_election.cc:304] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.461947 28981 leader_election.cc:304] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.462885 29626 raft_consensus.cc:2804] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.463335 29626 raft_consensus.cc:493] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.463912 29626 raft_consensus.cc:3060] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.467847 29624 ts_tablet_manager.cc:1434] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:24.468400 29558 raft_consensus.cc:2804] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.468626 29632 raft_consensus.cc:493] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.468858 29624 tablet_bootstrap.cc:492] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:24.469275 29632 raft_consensus.cc:515] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.450744 29628 raft_consensus.cc:515] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.472764 29632 leader_election.cc:290] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.473358 29558 raft_consensus.cc:697] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:24.474684 29558 consensus_queue.cc:237] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.479612 29628 leader_election.cc:290] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.479995 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d945783c31437981498fa3ba0887ff" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:24.482573 28942 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.494473 29564 raft_consensus.cc:493] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.495160 29564 raft_consensus.cc:515] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.497783 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.500206 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.500924 29015 raft_consensus.cc:2468] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:24.527408 29564 leader_election.cc:290] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:24.528735 28836 leader_election.cc:336] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.537374 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.537899 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:24.538242 29015 raft_consensus.cc:2468] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 2.
I20260709 13:09:24.538609 28936 raft_consensus.cc:2468] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:24.539065 28689 catalog_manager.cc:5697] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 1 to 2, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.545723 28981 leader_election.cc:304] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.530773 29626 raft_consensus.cc:515] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.547331 29564 raft_consensus.cc:2804] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.547760 29564 raft_consensus.cc:493] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.548113 29564 raft_consensus.cc:3060] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:24.548384 28984 leader_election.cc:336] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.547351 29014 raft_consensus.cc:2393] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89867186bb4546988c8fcd2b9fea8757 in current term 2: Already voted for candidate f3d3a97b01f64816a2a769d159dd64d2 in this term.
I20260709 13:09:24.554592 29626 leader_election.cc:290] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:24.555518 28942 raft_consensus.cc:2468] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 4.
I20260709 13:09:24.559953 28981 leader_election.cc:304] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.561805 29564 raft_consensus.cc:515] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.562721 28834 leader_election.cc:304] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:24.563948 29627 raft_consensus.cc:2804] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.564384 29627 raft_consensus.cc:493] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.564795 29627 raft_consensus.cc:3060] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.566049 29564 leader_election.cc:290] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.567862 29564 raft_consensus.cc:2804] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:24.569129 29564 raft_consensus.cc:697] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 4 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:24.569939 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:24.572579 28869 raft_consensus.cc:3060] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.572758 29627 raft_consensus.cc:515] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.576049 29627 leader_election.cc:290] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.576361 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:24.576992 28936 raft_consensus.cc:3060] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.581032 28834 leader_election.cc:304] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:24.582226 29634 raft_consensus.cc:2804] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:24.582588 28869 raft_consensus.cc:2468] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 2.
I20260709 13:09:24.582625 29634 raft_consensus.cc:493] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.583422 29634 raft_consensus.cc:3060] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.584334 29564 consensus_queue.cc:237] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.588124 28693 catalog_manager.cc:5697] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 1 to 2, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.591246 29628 raft_consensus.cc:493] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.591738 29631 raft_consensus.cc:493] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.591950 29628 raft_consensus.cc:515] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.592387 29631 raft_consensus.cc:515] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.594197 29628 leader_election.cc:290] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:24.594542 29631 leader_election.cc:290] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.597864 28936 raft_consensus.cc:2468] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 2.
I20260709 13:09:24.600306 28834 leader_election.cc:304] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:24.605669 29632 raft_consensus.cc:2749] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.606765 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:24.607702 28941 raft_consensus.cc:2468] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:24.602208 29624 tablet_bootstrap.cc:492] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.608847 29634 raft_consensus.cc:515] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.609318 29624 tablet_bootstrap.cc:492] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:24.609663 28981 leader_election.cc:304] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.610438 29624 ts_tablet_manager.cc:1403] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.142s	user 0.027s	sys 0.026s
W20260709 13:09:24.611678 28984 leader_election.cc:336] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.613046 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:24.613324 29624 raft_consensus.cc:359] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:24.613691 28984 leader_election.cc:336] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.614032 29624 raft_consensus.cc:740] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.614604 29634 leader_election.cc:290] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 3 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.615072 29624 consensus_queue.cc:260] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:24.616539 28984 leader_election.cc:336] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.617478 29624 ts_tablet_manager.cc:1434] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:24.618353 29624 tablet_bootstrap.cc:492] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:24.618631 28981 leader_election.cc:304] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.611917 29564 raft_consensus.cc:2804] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.619648 29558 raft_consensus.cc:2804] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.620208 29558 raft_consensus.cc:697] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:24.621047 29564 raft_consensus.cc:697] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:24.621248 29558 consensus_queue.cc:237] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.622119 29564 consensus_queue.cc:237] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.626585 28981 leader_election.cc:304] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.627453 29628 raft_consensus.cc:2804] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.627879 29628 raft_consensus.cc:493] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.628270 29628 raft_consensus.cc:3060] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.637132 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde8f4a342f345cf90f76ba21b614c2b" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:24.637907 29014 raft_consensus.cc:3060] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:24.638561 28984 leader_election.cc:336] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
W20260709 13:09:24.639318 28984 leader_election.cc:336] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
W20260709 13:09:24.643771 28836 leader_election.cc:336] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.644914 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34810d0af154f329fec45e857a80d99" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:24.645597 29009 raft_consensus.cc:3060] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.646298 29628 raft_consensus.cc:515] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.649310 29628 leader_election.cc:290] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:24.650084 28836 leader_election.cc:336] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.654630 29627 raft_consensus.cc:493] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.655792 29614 raft_consensus.cc:493] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.656495 29614 raft_consensus.cc:515] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.654290 29014 raft_consensus.cc:2468] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 2.
I20260709 13:09:24.656793 29009 raft_consensus.cc:2468] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 3.
I20260709 13:09:24.658695 29614 leader_election.cc:290] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:24.655254 29627 raft_consensus.cc:515] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.660445 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:24.660746 29627 leader_election.cc:290] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:24.661243 28868 raft_consensus.cc:2468] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 1.
I20260709 13:09:24.662115 28936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:24.662825 28936 raft_consensus.cc:2468] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:24.663331 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:24.664040 28941 raft_consensus.cc:3060] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.664332 28833 leader_election.cc:304] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:24.666736 29634 raft_consensus.cc:2804] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.667168 29634 raft_consensus.cc:493] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
W20260709 13:09:24.667425 28836 leader_election.cc:336] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.664040 28907 leader_election.cc:304] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:24.669268 29597 raft_consensus.cc:2804] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.667572 29634 raft_consensus.cc:3060] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.669690 29597 raft_consensus.cc:493] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.670163 29597 raft_consensus.cc:3060] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.686187 28941 raft_consensus.cc:2468] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 2.
I20260709 13:09:24.687881 29627 raft_consensus.cc:493] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.691689 28834 leader_election.cc:304] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
W20260709 13:09:24.692754 28984 leader_election.cc:336] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
W20260709 13:09:24.693719 28984 leader_election.cc:336] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.694115 28984 leader_election.cc:304] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:24.689777 28981 leader_election.cc:304] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.699613 28834 leader_election.cc:304] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
W20260709 13:09:24.700556 28984 leader_election.cc:336] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.700711 29492 raft_consensus.cc:2804] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.703163 29492 raft_consensus.cc:697] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:24.701581 29628 raft_consensus.cc:2804] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.708938 29633 raft_consensus.cc:2804] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:24.709455 29597 raft_consensus.cc:515] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.711539 29597 leader_election.cc:290] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:24.709539 29633 raft_consensus.cc:697] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 3 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:24.713042 29633 consensus_queue.cc:237] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.706306 29603 raft_consensus.cc:493] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.714162 29603 raft_consensus.cc:515] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.702906 29631 raft_consensus.cc:2749] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.688611 29627 raft_consensus.cc:515] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.716993 29492 consensus_queue.cc:237] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.714187 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:24.720100 29627 leader_election.cc:290] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:24.722781 28910 leader_election.cc:336] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.724395 29628 raft_consensus.cc:697] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:24.725440 29628 consensus_queue.cc:237] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
W20260709 13:09:24.726238 28910 leader_election.cc:336] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.719051 29634 raft_consensus.cc:515] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.734678 28868 raft_consensus.cc:2393] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7640ddad6f82422c8a0377a187b4e290 in current term 2: Already voted for candidate 89867186bb4546988c8fcd2b9fea8757 in this term.
I20260709 13:09:24.735644 29634 leader_election.cc:290] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
W20260709 13:09:24.737418 28984 leader_election.cc:336] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.738068 29015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.738744 29015 raft_consensus.cc:2468] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:24.716442 29603 leader_election.cc:290] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.740163 28907 leader_election.cc:304] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:24.745609 28834 leader_election.cc:304] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:24.743883 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
W20260709 13:09:24.742594 28836 leader_election.cc:336] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.748433 29597 raft_consensus.cc:2749] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.749894 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:24.751999 29603 raft_consensus.cc:2804] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.792125 28941 raft_consensus.cc:2393] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89867186bb4546988c8fcd2b9fea8757 in current term 2: Already voted for candidate 7640ddad6f82422c8a0377a187b4e290 in this term.
I20260709 13:09:24.791965 29014 raft_consensus.cc:2468] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:24.792028 29603 raft_consensus.cc:493] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.794955 29603 raft_consensus.cc:3060] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.796048 29624 tablet_bootstrap.cc:492] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.796851 28834 leader_election.cc:304] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:24.749930 29564 raft_consensus.cc:493] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.805657 29564 raft_consensus.cc:515] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.806191 29629 raft_consensus.cc:2804] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.806792 29629 raft_consensus.cc:493] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.807143 29629 raft_consensus.cc:3060] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.808198 29564 leader_election.cc:290] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:24.815631 28836 leader_election.cc:336] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
W20260709 13:09:24.822692 28984 leader_election.cc:336] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
W20260709 13:09:24.826007 28836 leader_election.cc:336] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.833066 29624 tablet_bootstrap.cc:492] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:24.833995 29624 ts_tablet_manager.cc:1403] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.216s	user 0.014s	sys 0.004s
I20260709 13:09:24.835587 29629 raft_consensus.cc:515] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.837764 29603 raft_consensus.cc:515] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:24.841023 29624 raft_consensus.cc:359] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.841820 29624 raft_consensus.cc:740] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.844807 29624 consensus_queue.cc:260] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.842926 29603 leader_election.cc:290] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:24.852630 28833 leader_election.cc:304] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:24.854698 29492 raft_consensus.cc:2749] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.858817 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6c055b4c440bbb4cbecf2a32bf6e2" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:24.859529 29014 raft_consensus.cc:3060] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.863844 29624 ts_tablet_manager.cc:1434] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:09:24.864974 29624 tablet_bootstrap.cc:492] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:24.869225 29629 leader_election.cc:290] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:24.873885 28910 consensus_peers.cc:597] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:24.866513 28836 leader_election.cc:336] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.877655 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:24.878388 29009 raft_consensus.cc:3060] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.885166 28693 catalog_manager.cc:5697] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 1 to 2, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.890408 28693 catalog_manager.cc:5697] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 2 to 3, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.892196 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:24.893309 28868 raft_consensus.cc:2468] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 1.
I20260709 13:09:24.899174 28981 leader_election.cc:304] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:24.901352 29631 raft_consensus.cc:2804] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.901860 29631 raft_consensus.cc:493] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:24.902279 29631 raft_consensus.cc:3060] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.902472 29014 raft_consensus.cc:2468] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 2.
I20260709 13:09:24.905097 29009 raft_consensus.cc:2468] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 2.
W20260709 13:09:24.908788 28836 leader_election.cc:336] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.918834 29009 raft_consensus.cc:1275] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:24.920513 29631 raft_consensus.cc:515] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.928050 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3841cb2f1364534b341ed93ebd0f73f" candidate_uuid: "f3d3a97b01f64816a2a769d159dd64d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:24.928785 28868 raft_consensus.cc:3060] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.921051 29597 consensus_queue.cc:1048] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:09:24.941268 29631 leader_election.cc:290] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:24.946641 28984 leader_election.cc:336] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:24.951514 28942 raft_consensus.cc:1275] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer 89867186bb4546988c8fcd2b9fea8757: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:24.954075 29633 consensus_queue.cc:1048] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:24.956354 29624 tablet_bootstrap.cc:492] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.957406 29624 tablet_bootstrap.cc:492] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:24.957775 28868 raft_consensus.cc:2468] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d3a97b01f64816a2a769d159dd64d2 in term 2.
I20260709 13:09:24.958099 29624 ts_tablet_manager.cc:1403] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.009s
I20260709 13:09:24.959017 28981 leader_election.cc:304] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:24.960556 29631 raft_consensus.cc:2804] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.961314 29631 raft_consensus.cc:697] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Becoming Leader. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:24.965315 29631 consensus_queue.cc:237] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:24.970274 29624 raft_consensus.cc:359] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:24.971133 29624 raft_consensus.cc:740] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.971230 28834 leader_election.cc:304] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:24.972043 29624 consensus_queue.cc:260] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:25.008185 29624 ts_tablet_manager.cc:1434] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:09:25.009472 29624 tablet_bootstrap.cc:492] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:25.009891 29629 raft_consensus.cc:2804] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:25.010567 29629 raft_consensus.cc:697] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
W20260709 13:09:24.981175 28984 consensus_peers.cc:597] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.019838 29629 consensus_queue.cc:237] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:25.025897 28984 consensus_peers.cc:597] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:25.017655 28836 consensus_peers.cc:597] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.021467 28834 leader_election.cc:304] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89867186bb4546988c8fcd2b9fea8757, f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:25.031829 29633 raft_consensus.cc:2804] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:25.032390 29633 raft_consensus.cc:697] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:25.033341 29633 consensus_queue.cc:237] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:25.038010 28984 consensus_peers.cc:597] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.056396 29624 tablet_bootstrap.cc:492] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.057488 29624 tablet_bootstrap.cc:492] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:25.058172 29624 ts_tablet_manager.cc:1403] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.007s
I20260709 13:09:25.063021 29624 raft_consensus.cc:359] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:25.063733 29624 raft_consensus.cc:740] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
W20260709 13:09:25.063902 28984 consensus_peers.cc:597] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.056499 28693 catalog_manager.cc:5697] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 3 to 4, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 4 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.066593 28693 catalog_manager.cc:5697] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 1 to 2, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.068284 29624 consensus_queue.cc:260] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:25.069715 28834 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.4:46467, user_credentials={real_user=slave}} blocked reactor thread for 48337.4us
I20260709 13:09:25.074832 29624 ts_tablet_manager.cc:1434] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:25.075843 29624 tablet_bootstrap.cc:492] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:25.080708 28942 raft_consensus.cc:1275] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 4 FOLLOWER]: Refusing update from remote peer f3d3a97b01f64816a2a769d159dd64d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:25.068303 28693 catalog_manager.cc:5697] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 1 to 2, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.086237 29659 consensus_queue.cc:1048] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:25.090480 28936 raft_consensus.cc:1275] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer f3d3a97b01f64816a2a769d159dd64d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.094676 29658 consensus_queue.cc:1048] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:25.104245 28693 catalog_manager.cc:5697] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 1 to 2, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.119805 28868 raft_consensus.cc:1275] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer f3d3a97b01f64816a2a769d159dd64d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.135924 29631 consensus_queue.cc:1048] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:25.184684 28836 consensus_peers.cc:597] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:25.186056 28836 consensus_peers.cc:597] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.196306 29009 raft_consensus.cc:1275] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 89867186bb4546988c8fcd2b9fea8757: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.208098 28868 raft_consensus.cc:1275] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer f3d3a97b01f64816a2a769d159dd64d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.211408 29629 consensus_queue.cc:1048] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:25.214180 29631 consensus_queue.cc:1048] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:25.218124 28689 catalog_manager.cc:5697] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 1 to 2, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.221355 29009 raft_consensus.cc:1275] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Refusing update from remote peer 89867186bb4546988c8fcd2b9fea8757: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:25.229885 29624 tablet_bootstrap.cc:492] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.229419 29657 consensus_queue.cc:1048] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:25.230932 29624 tablet_bootstrap.cc:492] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:25.231693 29624 ts_tablet_manager.cc:1403] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.156s	user 0.068s	sys 0.046s
I20260709 13:09:25.234484 29624 raft_consensus.cc:359] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:25.235183 29624 raft_consensus.cc:740] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.265077 29624 consensus_queue.cc:260] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:25.277051 29624 ts_tablet_manager.cc:1434] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:09:25.277951 29624 tablet_bootstrap.cc:492] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:25.287133 21312 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:09:25.287688 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 1.028s	user 0.293s	sys 0.019s
I20260709 13:09:25.295974 28689 catalog_manager.cc:5697] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 1 to 2, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.309293 28942 raft_consensus.cc:1275] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer f3d3a97b01f64816a2a769d159dd64d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:25.317653 28984 consensus_peers.cc:597] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.319795 29651 consensus_queue.cc:1048] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:25.322924 28693 catalog_manager.cc:5697] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 reported cstate change: term changed from 1 to 2, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4). New cstate: current_term: 2 leader_uuid: "f3d3a97b01f64816a2a769d159dd64d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.324855 29624 tablet_bootstrap.cc:492] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.326435 29624 tablet_bootstrap.cc:492] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:25.327453 29624 ts_tablet_manager.cc:1403] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.000s
W20260709 13:09:25.339659 28984 consensus_peers.cc:597] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.340852 29624 raft_consensus.cc:359] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:25.341665 29624 raft_consensus.cc:740] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.342535 29624 consensus_queue.cc:260] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:25.344647 29624 ts_tablet_manager.cc:1434] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:09:25.345571 29624 tablet_bootstrap.cc:492] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:25.371966 28984 consensus_peers.cc:597] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.374266 28984 consensus_peers.cc:597] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.375909 29624 tablet_bootstrap.cc:492] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.377070 29624 tablet_bootstrap.cc:492] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:25.377964 29624 ts_tablet_manager.cc:1403] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.003s
I20260709 13:09:25.383643 29624 raft_consensus.cc:359] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:25.384351 29624 raft_consensus.cc:740] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.385973 29624 consensus_queue.cc:260] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:25.404580 29624 ts_tablet_manager.cc:1434] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:09:25.406433 29624 tablet_bootstrap.cc:492] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:25.412739 28836 consensus_peers.cc:597] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.420396 28836 consensus_peers.cc:597] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.428068 28984 consensus_peers.cc:597] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.457523 29014 raft_consensus.cc:1275] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 89867186bb4546988c8fcd2b9fea8757: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.459510 29495 consensus_queue.cc:1048] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:25.475075 28836 consensus_peers.cc:597] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:25.487164 28836 consensus_peers.cc:597] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.487289 28984 consensus_peers.cc:597] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.495784 28869 raft_consensus.cc:1275] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer f3d3a97b01f64816a2a769d159dd64d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.497458 29631 consensus_queue.cc:1048] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.512149 29624 tablet_bootstrap.cc:492] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.513411 29624 tablet_bootstrap.cc:492] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:25.514213 29624 ts_tablet_manager.cc:1403] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.005s
I20260709 13:09:25.546967 29624 raft_consensus.cc:359] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:25.547748 29624 raft_consensus.cc:740] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.549983 29624 consensus_queue.cc:260] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:25.562880 29624 ts_tablet_manager.cc:1434] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.003s
I20260709 13:09:25.563799 29624 tablet_bootstrap.cc:492] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:25.569762 28984 consensus_peers.cc:597] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.581179 29638 raft_consensus.cc:493] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.581918 29638 raft_consensus.cc:515] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
W20260709 13:09:25.560261 28836 consensus_peers.cc:597] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.604125 28984 consensus_peers.cc:597] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.608603 28910 consensus_peers.cc:597] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.616734 29638 leader_election.cc:290] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:25.644857 29009 raft_consensus.cc:1275] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 89867186bb4546988c8fcd2b9fea8757: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.646430 29603 consensus_queue.cc:1048] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:25.652729 28836 consensus_peers.cc:597] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:25.653205 28836 consensus_peers.cc:597] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.656589 28984 consensus_peers.cc:597] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.664613 29624 tablet_bootstrap.cc:492] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.666425 29624 tablet_bootstrap.cc:492] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:25.667012 29624 ts_tablet_manager.cc:1403] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.103s	user 0.025s	sys 0.023s
W20260709 13:09:25.663183 28984 consensus_peers.cc:597] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.691980 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:25.691888 29624 raft_consensus.cc:359] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:25.692894 29624 raft_consensus.cc:740] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
W20260709 13:09:25.684886 28984 consensus_peers.cc:597] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.706503 28984 consensus_peers.cc:597] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.700311 29624 consensus_queue.cc:260] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
W20260709 13:09:25.728430 28984 consensus_peers.cc:597] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.734723 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd25378f6794f9ab52ee328577124e3" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2" is_pre_election: true
I20260709 13:09:25.736775 29619 leader_election.cc:304] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2
I20260709 13:09:25.738405 29638 raft_consensus.cc:2749] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:25.736804 29624 ts_tablet_manager.cc:1434] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 13:09:25.741537 29624 tablet_bootstrap.cc:492] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:25.754654 28910 consensus_peers.cc:597] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.761704 28836 consensus_peers.cc:597] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.766188 28984 consensus_peers.cc:597] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.796931 29624 tablet_bootstrap.cc:492] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.798084 29624 tablet_bootstrap.cc:492] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:25.798853 29624 ts_tablet_manager.cc:1403] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.006s
W20260709 13:09:25.801294 28836 consensus_peers.cc:597] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.803429 29624 raft_consensus.cc:359] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:25.804378 29624 raft_consensus.cc:740] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.805263 29624 consensus_queue.cc:260] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:25.807614 29624 ts_tablet_manager.cc:1434] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:25.808560 29624 tablet_bootstrap.cc:492] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:25.872959 28984 consensus_peers.cc:597] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.888881 29624 tablet_bootstrap.cc:492] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.890041 29624 tablet_bootstrap.cc:492] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:25.890887 29624 ts_tablet_manager.cc:1403] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.083s	user 0.031s	sys 0.019s
I20260709 13:09:25.893998 29624 raft_consensus.cc:359] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:25.894766 29624 raft_consensus.cc:740] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.895628 29624 consensus_queue.cc:260] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:25.897972 29624 ts_tablet_manager.cc:1434] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:25.898907 29624 tablet_bootstrap.cc:492] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:25.902014 28984 consensus_peers.cc:597] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.906529 28836 consensus_peers.cc:597] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.910079 28836 consensus_peers.cc:597] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.914007 28910 consensus_peers.cc:597] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.916863 28984 consensus_peers.cc:597] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.925427 28836 consensus_peers.cc:597] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.925597 29624 tablet_bootstrap.cc:492] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.927495 29624 tablet_bootstrap.cc:492] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:25.928339 29624 ts_tablet_manager.cc:1403] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.004s
I20260709 13:09:25.933686 29624 raft_consensus.cc:359] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:25.936985 29624 raft_consensus.cc:740] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.938515 29624 consensus_queue.cc:260] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
W20260709 13:09:25.940837 28984 consensus_peers.cc:597] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.940816 29624 ts_tablet_manager.cc:1434] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:25.942586 29624 tablet_bootstrap.cc:492] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:25.958310 28836 consensus_peers.cc:597] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.967795 29624 tablet_bootstrap.cc:492] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.968976 29624 tablet_bootstrap.cc:492] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:25.969671 29624 ts_tablet_manager.cc:1403] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.009s
I20260709 13:09:25.972461 29624 raft_consensus.cc:359] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:25.973335 29624 raft_consensus.cc:740] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.974110 29624 consensus_queue.cc:260] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:25.976537 29624 ts_tablet_manager.cc:1434] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:09:25.977442 29624 tablet_bootstrap.cc:492] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:26.002291 29624 tablet_bootstrap.cc:492] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.003336 29624 tablet_bootstrap.cc:492] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:26.004017 29624 ts_tablet_manager.cc:1403] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.001s
I20260709 13:09:26.006672 29624 raft_consensus.cc:359] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:26.007428 29624 raft_consensus.cc:740] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.008436 29624 consensus_queue.cc:260] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:26.010730 29624 ts_tablet_manager.cc:1434] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.007s
I20260709 13:09:26.011715 29624 tablet_bootstrap.cc:492] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:26.039108 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.1:41969
I20260709 13:09:26.039304 29752 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.1:41969 every 8 connection(s)
I20260709 13:09:26.040283 29624 tablet_bootstrap.cc:492] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.041504 29624 tablet_bootstrap.cc:492] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:26.048205 29624 ts_tablet_manager.cc:1403] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.037s	user 0.024s	sys 0.000s
I20260709 13:09:26.051234 29624 raft_consensus.cc:359] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:26.051998 29624 raft_consensus.cc:740] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.052932 29624 consensus_queue.cc:260] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:26.055922 29624 ts_tablet_manager.cc:1434] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:09:26.056911 29624 tablet_bootstrap.cc:492] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:26.087493 29624 tablet_bootstrap.cc:492] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.089059 29624 tablet_bootstrap.cc:492] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:26.091379 29624 ts_tablet_manager.cc:1403] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.003s
I20260709 13:09:26.094046 29624 raft_consensus.cc:359] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:26.094753 29624 raft_consensus.cc:740] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.095466 29624 consensus_queue.cc:260] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:26.105333 29624 ts_tablet_manager.cc:1434] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:26.106335 29624 tablet_bootstrap.cc:492] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:26.136303 29718 raft_consensus.cc:3060] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:26.138170 28984 consensus_peers.cc:597] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:26.175402 29624 tablet_bootstrap.cc:492] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.176678 29624 tablet_bootstrap.cc:492] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:26.177367 29624 ts_tablet_manager.cc:1403] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.071s	user 0.047s	sys 0.015s
I20260709 13:09:26.179980 29624 raft_consensus.cc:359] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:26.181715 29624 raft_consensus.cc:740] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.182412 29624 consensus_queue.cc:260] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:26.187027 29624 ts_tablet_manager.cc:1434] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:26.187959 29624 tablet_bootstrap.cc:492] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:26.236574 29760 raft_consensus.cc:493] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.237224 29760 raft_consensus.cc:515] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.239835 29760 leader_election.cc:290] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:26.265998 28940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125abb8d87d437cb630354900d6e5b4" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:26.286235 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8125abb8d87d437cb630354900d6e5b4" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89867186bb4546988c8fcd2b9fea8757" is_pre_election: true
I20260709 13:09:26.287854 29618 leader_election.cc:304] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70; no voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:26.288648 29722 raft_consensus.cc:3060] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.289124 29760 raft_consensus.cc:2749] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.319298 29754 heartbeater.cc:344] Connected to a master server at 127.20.208.62:34427
I20260709 13:09:26.319881 29754 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:26.320885 29754 heartbeater.cc:507] Master 127.20.208.62:34427 requested a full tablet report, sending...
I20260709 13:09:26.327147 29624 tablet_bootstrap.cc:492] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.328254 29624 tablet_bootstrap.cc:492] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:26.329085 29624 ts_tablet_manager.cc:1403] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.141s	user 0.040s	sys 0.050s
I20260709 13:09:26.328917 29718 raft_consensus.cc:3060] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.332926 29624 raft_consensus.cc:359] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.333670 29624 raft_consensus.cc:740] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.334507 29624 consensus_queue.cc:260] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.340193 29624 ts_tablet_manager.cc:1434] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:09:26.341130 29624 tablet_bootstrap.cc:492] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:26.349835 28689 ts_manager.cc:194] Re-registered known tserver with Master: 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
I20260709 13:09:26.384171 29624 tablet_bootstrap.cc:492] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.385488 29624 tablet_bootstrap.cc:492] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:26.386317 29624 ts_tablet_manager.cc:1403] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.008s
I20260709 13:09:26.389283 29624 raft_consensus.cc:359] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.390264 29624 raft_consensus.cc:740] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.391115 29624 consensus_queue.cc:260] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.393078 29624 ts_tablet_manager.cc:1434] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:26.393785 29624 tablet_bootstrap.cc:492] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:26.398021 28689 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36750
I20260709 13:09:26.404048 29754 heartbeater.cc:499] Master 127.20.208.62:34427 was elected leader, sending a full tablet report...
I20260709 13:09:26.428323 29718 raft_consensus.cc:3060] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.541049 29627 raft_consensus.cc:493] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.541697 29627 raft_consensus.cc:515] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.544224 29627 leader_election.cc:290] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:26.540979 29624 tablet_bootstrap.cc:492] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.547900 29624 tablet_bootstrap.cc:492] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:26.548964 29624 ts_tablet_manager.cc:1403] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.155s	user 0.035s	sys 0.076s
I20260709 13:09:26.551092 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290" is_pre_election: true
I20260709 13:09:26.551798 28942 raft_consensus.cc:2468] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 2.
I20260709 13:09:26.560012 29624 raft_consensus.cc:359] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:26.560921 29624 raft_consensus.cc:740] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.565172 29722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70" is_pre_election: true
I20260709 13:09:26.565917 29722 raft_consensus.cc:2468] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 1.
I20260709 13:09:26.575016 29721 raft_consensus.cc:3060] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.580066 28833 leader_election.cc:304] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:26.581095 29771 raft_consensus.cc:2804] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:26.581586 29771 raft_consensus.cc:493] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.581949 29771 raft_consensus.cc:3060] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.592243 29723 raft_consensus.cc:3060] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.612323 29771 raft_consensus.cc:515] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.614638 29771 leader_election.cc:290] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 3 election: Requested vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:26.617699 29722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
I20260709 13:09:26.618336 29722 raft_consensus.cc:3060] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.621281 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd628bc39b04e3eb0cad27972841737" candidate_uuid: "89867186bb4546988c8fcd2b9fea8757" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:26.621928 28942 raft_consensus.cc:3060] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.562244 29624 consensus_queue.cc:260] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:26.630635 29624 ts_tablet_manager.cc:1434] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.000s
I20260709 13:09:26.631592 29624 tablet_bootstrap.cc:492] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:26.632192 28942 raft_consensus.cc:2468] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 3.
I20260709 13:09:26.655963 29722 raft_consensus.cc:2468] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89867186bb4546988c8fcd2b9fea8757 in term 3.
W20260709 13:09:26.701920 28833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40509, user_credentials={real_user=slave}} blocked reactor thread for 62841.1us
I20260709 13:09:26.702850 28833 leader_election.cc:304] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:26.709111 29777 raft_consensus.cc:2804] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:26.789254 28981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:40509, user_credentials={real_user=slave}} blocked reactor thread for 71303.6us
I20260709 13:09:26.796418 29777 raft_consensus.cc:697] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 3 LEADER]: Becoming Leader. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:26.797784 29777 consensus_queue.cc:237] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.869325 29624 tablet_bootstrap.cc:492] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.894065 29624 tablet_bootstrap.cc:492] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:26.894699 29624 ts_tablet_manager.cc:1403] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.263s	user 0.020s	sys 0.001s
W20260709 13:09:26.894876 28984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.1:41969, user_credentials={real_user=slave}} blocked reactor thread for 57101.8us
I20260709 13:09:26.902346 29624 raft_consensus.cc:359] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
W20260709 13:09:26.902976 28981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:41345, user_credentials={real_user=slave}} blocked reactor thread for 88933.5us
I20260709 13:09:26.903273 29624 raft_consensus.cc:740] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.912460 29624 consensus_queue.cc:260] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.915699 29624 ts_tablet_manager.cc:1434] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:26.935179 28689 catalog_manager.cc:5697] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 reported cstate change: term changed from 1 to 3, leader changed from 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1) to 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2). New cstate: current_term: 3 leader_uuid: "89867186bb4546988c8fcd2b9fea8757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.942890 29624 tablet_bootstrap.cc:492] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:26.967033 29624 tablet_bootstrap.cc:492] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.967778 29624 tablet_bootstrap.cc:492] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:26.968392 29624 ts_tablet_manager.cc:1403] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 13:09:26.970885 29624 raft_consensus.cc:359] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.971424 29624 raft_consensus.cc:740] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.972040 29624 consensus_queue.cc:260] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:26.973924 29624 ts_tablet_manager.cc:1434] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:09:26.976358 29624 tablet_bootstrap.cc:492] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.004359 29624 tablet_bootstrap.cc:492] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.005220 29624 tablet_bootstrap.cc:492] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.005893 29624 ts_tablet_manager.cc:1403] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.007s
I20260709 13:09:27.010200 29624 raft_consensus.cc:359] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.010910 29624 raft_consensus.cc:740] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.011718 29624 consensus_queue.cc:260] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.013662 29624 ts_tablet_manager.cc:1434] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:27.014504 29624 tablet_bootstrap.cc:492] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.043506 29624 tablet_bootstrap.cc:492] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.044658 29624 tablet_bootstrap.cc:492] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.045375 29624 ts_tablet_manager.cc:1403] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.001s
I20260709 13:09:27.050055 29624 raft_consensus.cc:359] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:27.050801 29624 raft_consensus.cc:740] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.051571 29624 consensus_queue.cc:260] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:27.058557 29624 ts_tablet_manager.cc:1434] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 13:09:27.059404 29624 tablet_bootstrap.cc:492] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.076906 29624 tablet_bootstrap.cc:492] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.078277 29624 tablet_bootstrap.cc:492] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.078855 29624 ts_tablet_manager.cc:1403] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:09:27.081557 29624 raft_consensus.cc:359] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.082240 29624 raft_consensus.cc:740] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.082943 29624 consensus_queue.cc:260] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.088228 29624 ts_tablet_manager.cc:1434] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:09:27.089159 29624 tablet_bootstrap.cc:492] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.114661 29624 tablet_bootstrap.cc:492] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.115654 29624 tablet_bootstrap.cc:492] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.116308 29624 ts_tablet_manager.cc:1403] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.008s
I20260709 13:09:27.118369 29624 raft_consensus.cc:359] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:27.118853 29624 raft_consensus.cc:740] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.119413 29624 consensus_queue.cc:260] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:27.121451 29624 ts_tablet_manager.cc:1434] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:27.122258 29624 tablet_bootstrap.cc:492] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.137692 29624 tablet_bootstrap.cc:492] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.138624 29624 tablet_bootstrap.cc:492] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.139335 29624 ts_tablet_manager.cc:1403] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:09:27.141937 29624 raft_consensus.cc:359] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.142650 29624 raft_consensus.cc:740] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.143409 29624 consensus_queue.cc:260] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.145434 29624 ts_tablet_manager.cc:1434] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:27.148062 29624 tablet_bootstrap.cc:492] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.167433 29624 tablet_bootstrap.cc:492] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.168499 29624 tablet_bootstrap.cc:492] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.169202 29624 ts_tablet_manager.cc:1403] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:09:27.171514 29722 raft_consensus.cc:3060] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.171671 29624 raft_consensus.cc:359] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.172516 29624 raft_consensus.cc:740] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.173331 29624 consensus_queue.cc:260] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.175604 29624 ts_tablet_manager.cc:1434] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:27.176438 29624 tablet_bootstrap.cc:492] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.211457 29624 tablet_bootstrap.cc:492] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.212493 29624 tablet_bootstrap.cc:492] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.213245 29624 ts_tablet_manager.cc:1403] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.007s
I20260709 13:09:27.216542 29624 raft_consensus.cc:359] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:27.217373 29624 raft_consensus.cc:740] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.218500 29624 consensus_queue.cc:260] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:27.221982 29624 ts_tablet_manager.cc:1434] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:27.223079 29624 tablet_bootstrap.cc:492] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.224030 29716 raft_consensus.cc:3060] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.265153 29716 raft_consensus.cc:3060] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.282310 29721 raft_consensus.cc:1275] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Refusing update from remote peer 89867186bb4546988c8fcd2b9fea8757: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:27.286864 29778 consensus_queue.cc:1048] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:27.291407 29624 tablet_bootstrap.cc:492] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.292577 29624 tablet_bootstrap.cc:492] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.293365 29624 ts_tablet_manager.cc:1403] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.071s	user 0.028s	sys 0.038s
I20260709 13:09:27.296037 29624 raft_consensus.cc:359] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.296842 29624 raft_consensus.cc:740] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.297739 29624 consensus_queue.cc:260] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.300168 29624 ts_tablet_manager.cc:1434] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:27.301193 29624 tablet_bootstrap.cc:492] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.330256 29624 tablet_bootstrap.cc:492] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.331398 29624 tablet_bootstrap.cc:492] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.332188 29624 ts_tablet_manager.cc:1403] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.005s
I20260709 13:09:27.333254 28941 raft_consensus.cc:1275] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Refusing update from remote peer 89867186bb4546988c8fcd2b9fea8757: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:27.335206 29624 raft_consensus.cc:359] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.336061 29624 raft_consensus.cc:740] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.336666 29777 consensus_queue.cc:1048] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:27.336998 29624 consensus_queue.cc:260] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.339735 29624 ts_tablet_manager.cc:1434] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:27.340700 29624 tablet_bootstrap.cc:492] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:27.418906 28910 consensus_peers.cc:597] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:27.428138 29624 tablet_bootstrap.cc:492] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.429147 29624 tablet_bootstrap.cc:492] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.429797 29624 ts_tablet_manager.cc:1403] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.089s	user 0.044s	sys 0.024s
I20260709 13:09:27.432337 29624 raft_consensus.cc:359] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.433025 29624 raft_consensus.cc:740] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.434866 29624 consensus_queue.cc:260] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.437080 29624 ts_tablet_manager.cc:1434] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:27.442065 29624 tablet_bootstrap.cc:492] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.482008 29624 tablet_bootstrap.cc:492] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.482972 29624 tablet_bootstrap.cc:492] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.483695 29624 ts_tablet_manager.cc:1403] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.014s
I20260709 13:09:27.486261 29624 raft_consensus.cc:359] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.486961 29624 raft_consensus.cc:740] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.487684 29624 consensus_queue.cc:260] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.489936 29624 ts_tablet_manager.cc:1434] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:09:27.490727 29624 tablet_bootstrap.cc:492] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
W20260709 13:09:27.561543 28836 consensus_peers.cc:597] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:27.572367 29624 tablet_bootstrap.cc:492] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.573406 29624 tablet_bootstrap.cc:492] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.574713 29624 ts_tablet_manager.cc:1403] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.084s	user 0.036s	sys 0.041s
I20260709 13:09:27.576939 29624 raft_consensus.cc:359] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.577452 29624 raft_consensus.cc:740] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.580220 29624 consensus_queue.cc:260] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.583422 29624 ts_tablet_manager.cc:1434] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:27.584309 29624 tablet_bootstrap.cc:492] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.599140 29624 tablet_bootstrap.cc:492] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.600082 29624 tablet_bootstrap.cc:492] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.600791 29624 ts_tablet_manager.cc:1403] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:09:27.603006 29624 raft_consensus.cc:359] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.603592 29624 raft_consensus.cc:740] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.604182 29624 consensus_queue.cc:260] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.606017 29624 ts_tablet_manager.cc:1434] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:27.607136 29624 tablet_bootstrap.cc:492] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.623306 29624 tablet_bootstrap.cc:492] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.624351 29624 tablet_bootstrap.cc:492] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
W20260709 13:09:27.625000 28836 consensus_peers.cc:597] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:27.625140 29624 ts_tablet_manager.cc:1403] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:09:27.628355 29624 raft_consensus.cc:359] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.629276 29624 raft_consensus.cc:740] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.630034 29624 consensus_queue.cc:260] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.633004 29624 ts_tablet_manager.cc:1434] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:27.634091 29624 tablet_bootstrap.cc:492] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.654838 29624 tablet_bootstrap.cc:492] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.655767 29624 tablet_bootstrap.cc:492] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.656454 29624 ts_tablet_manager.cc:1403] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 13:09:27.658991 29624 raft_consensus.cc:359] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.659677 29624 raft_consensus.cc:740] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.660452 29624 consensus_queue.cc:260] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.662982 29624 ts_tablet_manager.cc:1434] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:09:27.663825 29624 tablet_bootstrap.cc:492] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.685286 29624 tablet_bootstrap.cc:492] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.686199 29624 tablet_bootstrap.cc:492] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.686874 29624 ts_tablet_manager.cc:1403] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:09:27.689337 29624 raft_consensus.cc:359] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.690001 29624 raft_consensus.cc:740] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.690678 29624 consensus_queue.cc:260] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.692807 29624 ts_tablet_manager.cc:1434] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:27.694087 29624 tablet_bootstrap.cc:492] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.719791 29624 tablet_bootstrap.cc:492] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.720715 29624 tablet_bootstrap.cc:492] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.721395 29624 ts_tablet_manager.cc:1403] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:09:27.723868 29624 raft_consensus.cc:359] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.724568 29624 raft_consensus.cc:740] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.725328 29624 consensus_queue.cc:260] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.727408 29624 ts_tablet_manager.cc:1434] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:09:27.728168 29624 tablet_bootstrap.cc:492] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.774277 29624 tablet_bootstrap.cc:492] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.775767 29624 tablet_bootstrap.cc:492] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.776515 29624 ts_tablet_manager.cc:1403] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.049s	user 0.027s	sys 0.005s
I20260709 13:09:27.779084 29624 raft_consensus.cc:359] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:27.779764 29624 raft_consensus.cc:740] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.780454 29624 consensus_queue.cc:260] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:27.782915 29624 ts_tablet_manager.cc:1434] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:09:27.783758 29624 tablet_bootstrap.cc:492] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.806670 29624 tablet_bootstrap.cc:492] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.807828 29624 tablet_bootstrap.cc:492] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.808604 29624 ts_tablet_manager.cc:1403] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 13:09:27.823069 29624 raft_consensus.cc:359] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:27.823809 29624 raft_consensus.cc:740] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.824538 29624 consensus_queue.cc:260] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:27.827566 29624 ts_tablet_manager.cc:1434] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:27.837560 29624 tablet_bootstrap.cc:492] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.861562 29722 raft_consensus.cc:3060] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.870191 29624 tablet_bootstrap.cc:492] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.871291 29624 tablet_bootstrap.cc:492] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.872001 29624 ts_tablet_manager.cc:1403] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.008s
I20260709 13:09:27.874686 29624 raft_consensus.cc:359] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.875404 29624 raft_consensus.cc:740] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.876228 29624 consensus_queue.cc:260] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:27.879443 29624 ts_tablet_manager.cc:1434] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.004s
I20260709 13:09:27.880383 29624 tablet_bootstrap.cc:492] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap starting.
I20260709 13:09:27.920857 29624 tablet_bootstrap.cc:492] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.921842 29624 tablet_bootstrap.cc:492] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: Bootstrap complete.
I20260709 13:09:27.922601 29624 ts_tablet_manager.cc:1403] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.009s
I20260709 13:09:27.926288 29624 raft_consensus.cc:359] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.926972 29624 raft_consensus.cc:740] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.927649 29624 consensus_queue.cc:260] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:27.929867 29624 ts_tablet_manager.cc:1434] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:28.012220 29716 raft_consensus.cc:3060] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.059757 29716 raft_consensus.cc:3060] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.099191 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:36.160738 28864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:36.161652 28864 raft_consensus.cc:606] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Received request to transfer leadership to TS 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:36.164333 28864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:36.164860 28864 raft_consensus.cc:606] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Received request to transfer leadership to TS 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:36.176259 29011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1"
dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:45054
I20260709 13:09:36.176842 29011 raft_consensus.cc:606] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:36.179486 28864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:36.179988 28864 raft_consensus.cc:606] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:36.182351 28864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b029f39d79fe45a2914c451500924304"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:36.182948 28864 raft_consensus.cc:606] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:36.185909 28864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da7fd30052d142679c225954b5b5724b"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:36.186520 28864 raft_consensus.cc:606] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Received request to transfer leadership to TS 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:36.187949 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:36.189818 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:36.331094 29778 raft_consensus.cc:993] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:36.331645 29849 raft_consensus.cc:1081] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:36.333469 29718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39424
I20260709 13:09:36.334141 29718 raft_consensus.cc:493] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.334553 29718 raft_consensus.cc:3060] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.341843 29718 raft_consensus.cc:515] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:36.343713 29718 leader_election.cc:290] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:36.344827 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:36.345332 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427717c9f3e4422b4864beddbf36d0c" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:36.345669 28868 raft_consensus.cc:3055] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:36.345919 28942 raft_consensus.cc:3060] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.346029 28868 raft_consensus.cc:740] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:36.346998 28868 consensus_queue.cc:260] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:36.348363 28868 raft_consensus.cc:3060] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.353875 28942 raft_consensus.cc:2468] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 3.
I20260709 13:09:36.355374 29618 leader_election.cc:304] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:36.356854 28868 raft_consensus.cc:2468] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 3.
I20260709 13:09:36.358034 29853 raft_consensus.cc:2804] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:36.359314 29853 raft_consensus.cc:697] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 3 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:36.360167 29853 consensus_queue.cc:237] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:36.370112 28693 catalog_manager.cc:5697] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 2 to 3, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.427277 29834 raft_consensus.cc:993] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:36.427870 29791 raft_consensus.cc:1081] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:36.429355 29718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:09:36.429795 29718 raft_consensus.cc:493] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.430076 29718 raft_consensus.cc:3060] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.441826 29718 raft_consensus.cc:515] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:36.450923 29718 leader_election.cc:290] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:36.451697 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:36.452257 29011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c946f5606ec4af895c04195b74db3e1" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:36.452987 29011 raft_consensus.cc:3055] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:36.453302 29011 raft_consensus.cc:740] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:36.452355 28942 raft_consensus.cc:3060] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.456943 29011 consensus_queue.cc:260] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:36.458498 29011 raft_consensus.cc:3060] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.465037 29849 raft_consensus.cc:993] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:36.465615 29849 raft_consensus.cc:1081] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Signalling peer 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:36.465955 28942 raft_consensus.cc:2468] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 3.
I20260709 13:09:36.467494 28941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da7fd30052d142679c225954b5b5724b"
dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:33652
I20260709 13:09:36.468163 28941 raft_consensus.cc:493] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.468156 29011 raft_consensus.cc:2468] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 3.
I20260709 13:09:36.468782 28941 raft_consensus.cc:3060] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.470432 29619 leader_election.cc:304] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:36.471429 29853 raft_consensus.cc:2804] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:36.471926 29853 raft_consensus.cc:697] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:36.472968 29853 consensus_queue.cc:237] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:36.475170 29849 raft_consensus.cc:993] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:36.475709 29849 raft_consensus.cc:1081] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Signalling peer 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:36.478057 28940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966"
dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:33652
I20260709 13:09:36.478600 28940 raft_consensus.cc:493] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.478916 28940 raft_consensus.cc:3060] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.494635 28941 raft_consensus.cc:515] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:36.498435 28941 leader_election.cc:290] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:36.500553 28868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7fd30052d142679c225954b5b5724b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:36.501154 28868 raft_consensus.cc:3055] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.501451 28868 raft_consensus.cc:740] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:36.501664 29778 raft_consensus.cc:993] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:36.502135 29778 raft_consensus.cc:1081] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Signalling peer 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:36.502307 28868 consensus_queue.cc:260] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:36.503206 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7fd30052d142679c225954b5b5724b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:36.503789 29014 raft_consensus.cc:3060] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.504199 28868 raft_consensus.cc:3060] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.511969 29014 raft_consensus.cc:2468] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:36.510926 28693 catalog_manager.cc:5697] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 2 to 3, leader changed from f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.513716 28868 raft_consensus.cc:2468] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:36.521521 29778 raft_consensus.cc:993] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:36.521996 29778 raft_consensus.cc:1081] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:36.522385 28907 leader_election.cc:304] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:36.523699 29847 raft_consensus.cc:2804] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.525033 28942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e"
dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:33652
I20260709 13:09:36.525671 28942 raft_consensus.cc:493] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.526014 28942 raft_consensus.cc:3060] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.527145 29721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b029f39d79fe45a2914c451500924304"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39424
I20260709 13:09:36.527855 29721 raft_consensus.cc:493] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.528208 29721 raft_consensus.cc:3060] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.534523 28942 raft_consensus.cc:515] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:36.541728 29721 raft_consensus.cc:515] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:36.541591 29847 raft_consensus.cc:697] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:36.544816 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b029f39d79fe45a2914c451500924304" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:36.543665 29847 consensus_queue.cc:237] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:36.545617 28864 raft_consensus.cc:3055] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.546509 28864 raft_consensus.cc:740] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:36.547509 28864 consensus_queue.cc:260] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:36.549718 28942 leader_election.cc:290] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:36.550199 28864 raft_consensus.cc:3060] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.563604 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:36.564325 28869 raft_consensus.cc:3055] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.564654 28869 raft_consensus.cc:740] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:36.523912 28940 raft_consensus.cc:515] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:36.565689 28869 consensus_queue.cc:260] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:36.567288 28940 leader_election.cc:290] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:36.568135 28869 raft_consensus.cc:3060] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.571873 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:36.572559 29009 raft_consensus.cc:3060] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.573181 28864 raft_consensus.cc:2468] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:36.574385 29618 leader_election.cc:304] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:36.575273 29853 raft_consensus.cc:2804] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.575423 29721 leader_election.cc:290] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:36.575836 29853 raft_consensus.cc:697] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:36.576712 28940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b029f39d79fe45a2914c451500924304" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:36.576932 29853 consensus_queue.cc:237] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:36.577899 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fcfba163a74ac1b6aa94f2022c252e" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:36.577401 28940 raft_consensus.cc:3060] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.578574 29014 raft_consensus.cc:3060] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.592861 29009 raft_consensus.cc:2468] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:36.592372 28693 catalog_manager.cc:5697] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 1 to 2, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.582010 28869 raft_consensus.cc:2468] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:36.597608 28907 leader_election.cc:304] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:36.593933 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37be0dd46a214f7d9eef969ee4d69966" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:36.594401 28908 leader_election.cc:304] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:36.600312 29866 raft_consensus.cc:2804] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.600893 29866 raft_consensus.cc:697] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:36.601596 28940 raft_consensus.cc:2468] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:36.601812 29866 consensus_queue.cc:237] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:36.598605 29014 raft_consensus.cc:2468] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:36.599390 29863 raft_consensus.cc:2804] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.598878 28864 raft_consensus.cc:3055] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.609880 28864 raft_consensus.cc:740] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:36.610734 28864 consensus_queue.cc:260] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:36.612068 28864 raft_consensus.cc:3060] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.613514 28693 catalog_manager.cc:5697] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.616775 29863 raft_consensus.cc:697] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:36.619266 29863 consensus_queue.cc:237] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:36.623420 28864 raft_consensus.cc:2468] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:36.631459 28693 catalog_manager.cc:5697] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 1 to 2, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.651582 28693 catalog_manager.cc:5697] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 1 to 2, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.873242 29014 raft_consensus.cc:1275] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:36.874330 29853 consensus_queue.cc:1048] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:36.884443 28942 raft_consensus.cc:1275] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:36.888967 29853 consensus_queue.cc:1048] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:36.899864 28864 raft_consensus.cc:1275] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:36.901217 29873 consensus_queue.cc:1048] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:36.922195 28942 raft_consensus.cc:1275] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:36.928412 29873 consensus_queue.cc:1048] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:36.979070 28864 raft_consensus.cc:1275] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.980259 29863 consensus_queue.cc:1048] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.989298 29014 raft_consensus.cc:1275] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.990944 29847 consensus_queue.cc:1048] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.001600 28864 raft_consensus.cc:1275] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.003746 29866 consensus_queue.cc:1048] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.024339 29014 raft_consensus.cc:1275] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.029856 29863 consensus_queue.cc:1048] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.054315 29009 raft_consensus.cc:1275] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.055734 29863 consensus_queue.cc:1048] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.068683 28864 raft_consensus.cc:1275] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.071873 29866 consensus_queue.cc:1048] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.113219 28864 raft_consensus.cc:1275] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.114606 29854 consensus_queue.cc:1048] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:37.127074 28942 raft_consensus.cc:1275] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.128770 29873 consensus_queue.cc:1048] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.190954 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.228847 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.262681 29009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c3b31ed6f204a71a8ac57ddbc19e662"
dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
mode: GRACEFUL
new_leader_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:45054
I20260709 13:09:37.263326 29009 raft_consensus.cc:606] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Received request to transfer leadership to TS 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:37.265961 28864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:37.266450 28864 raft_consensus.cc:606] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:37.268817 28864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:37.269297 28864 raft_consensus.cc:606] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:37.271600 28864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:37.272032 28864 raft_consensus.cc:606] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:37.274346 28864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:37.274865 28864 raft_consensus.cc:606] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:37.277144 28864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1293cb1f6ed468da880ff1ee758b3b4"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:37.277588 28864 raft_consensus.cc:606] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:37.278571 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:37.279765 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:37.318480 29861 raft_consensus.cc:993] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:37.318958 29861 raft_consensus.cc:1081] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:37.320348 29721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39424
I20260709 13:09:37.320873 29721 raft_consensus.cc:493] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.321139 29721 raft_consensus.cc:3060] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.326611 29721 raft_consensus.cc:515] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.328510 29721 leader_election.cc:290] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:37.329700 28940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:37.330163 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca66f80367c145af96bd99c7df4ccbd0" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:37.330356 28940 raft_consensus.cc:3060] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.330754 28864 raft_consensus.cc:3055] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.331071 28864 raft_consensus.cc:740] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:37.332151 28864 consensus_queue.cc:260] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.334782 28864 raft_consensus.cc:3060] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.340082 28940 raft_consensus.cc:2468] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:37.341411 29618 leader_election.cc:304] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:37.342247 29888 raft_consensus.cc:2804] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.342720 29888 raft_consensus.cc:697] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:37.343631 29888 consensus_queue.cc:237] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.343844 28864 raft_consensus.cc:2468] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:37.352437 28691 catalog_manager.cc:5697] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.418386 29778 raft_consensus.cc:993] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:37.418877 29861 raft_consensus.cc:1081] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:37.420398 29721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39424
I20260709 13:09:37.420953 29721 raft_consensus.cc:493] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.421247 29721 raft_consensus.cc:3060] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.426151 29721 raft_consensus.cc:515] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.427620 29721 leader_election.cc:290] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:37.428421 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:37.428737 28940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbc309858774a56b5464235e918e3d5" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:37.429143 28864 raft_consensus.cc:3055] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.429270 28940 raft_consensus.cc:3060] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.429484 28864 raft_consensus.cc:740] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:37.430265 28864 consensus_queue.cc:260] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.431470 28864 raft_consensus.cc:3060] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.434413 28940 raft_consensus.cc:2468] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:37.435559 29618 leader_election.cc:304] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:37.436280 29888 raft_consensus.cc:2804] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.436378 28864 raft_consensus.cc:2468] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:37.436771 29888 raft_consensus.cc:697] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:37.437724 29888 consensus_queue.cc:237] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.450654 28691 catalog_manager.cc:5697] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.475072 29778 raft_consensus.cc:993] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:37.475502 29861 raft_consensus.cc:1081] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:37.477234 29721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39424
I20260709 13:09:37.477783 29721 raft_consensus.cc:493] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.478085 29721 raft_consensus.cc:3060] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.483625 29721 raft_consensus.cc:515] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:37.485481 29721 leader_election.cc:290] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:37.486088 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:37.486719 29009 raft_consensus.cc:3060] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.490090 28864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18d000a8ebe429caa1c1c23e30e8c46" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:37.490696 28864 raft_consensus.cc:3055] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:37.490993 28864 raft_consensus.cc:740] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:37.491823 28864 consensus_queue.cc:260] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:37.493260 28864 raft_consensus.cc:3060] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.495056 29009 raft_consensus.cc:2468] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 3.
I20260709 13:09:37.496409 29619 leader_election.cc:304] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:37.497213 29888 raft_consensus.cc:2804] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:37.497726 29888 raft_consensus.cc:697] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:37.498551 29888 consensus_queue.cc:237] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:37.500752 28864 raft_consensus.cc:2468] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 3.
I20260709 13:09:37.512332 28691 catalog_manager.cc:5697] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 2 to 3, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.583153 29791 raft_consensus.cc:993] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2: : Instructing follower 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:37.584614 29882 raft_consensus.cc:1081] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Signalling peer 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:37.586093 28940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c3b31ed6f204a71a8ac57ddbc19e662"
dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:33668
I20260709 13:09:37.586711 28940 raft_consensus.cc:493] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.587006 28940 raft_consensus.cc:3060] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.592636 28940 raft_consensus.cc:515] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:37.596520 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3b31ed6f204a71a8ac57ddbc19e662" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:37.597445 28869 raft_consensus.cc:3060] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.598675 28940 leader_election.cc:290] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:37.600302 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3b31ed6f204a71a8ac57ddbc19e662" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:37.600996 29009 raft_consensus.cc:3055] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.601751 29009 raft_consensus.cc:740] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:37.602564 29009 consensus_queue.cc:260] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:37.603929 29009 raft_consensus.cc:3060] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.608603 28869 raft_consensus.cc:2468] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:37.610811 28907 leader_election.cc:304] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:37.611361 29009 raft_consensus.cc:2468] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:37.611593 29866 raft_consensus.cc:2804] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.612181 29866 raft_consensus.cc:697] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:37.613086 29866 consensus_queue.cc:237] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:37.623396 28689 catalog_manager.cc:5697] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 1 to 2, leader changed from f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4) to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.698846 29849 raft_consensus.cc:993] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:37.699412 29778 raft_consensus.cc:1081] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:37.701001 29721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1293cb1f6ed468da880ff1ee758b3b4"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39424
I20260709 13:09:37.701527 29721 raft_consensus.cc:493] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.701996 29721 raft_consensus.cc:3060] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.708926 29721 raft_consensus.cc:515] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.710855 29721 leader_election.cc:290] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:37.711897 28940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1293cb1f6ed468da880ff1ee758b3b4" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:37.712698 28940 raft_consensus.cc:3060] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.712735 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1293cb1f6ed468da880ff1ee758b3b4" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:37.713436 28869 raft_consensus.cc:3055] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.713850 28869 raft_consensus.cc:740] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:37.714706 28869 consensus_queue.cc:260] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.716009 28869 raft_consensus.cc:3060] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.725060 28869 raft_consensus.cc:2468] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:37.726369 29618 leader_election.cc:304] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:37.726519 28940 raft_consensus.cc:2468] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:37.727299 29853 raft_consensus.cc:2804] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.727834 29853 raft_consensus.cc:697] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:37.728871 29853 consensus_queue.cc:237] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.739717 28689 catalog_manager.cc:5697] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.809247 29849 raft_consensus.cc:993] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:37.809684 29897 raft_consensus.cc:1081] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:37.811312 29718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39424
I20260709 13:09:37.811885 29718 raft_consensus.cc:493] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.812141 29718 raft_consensus.cc:3060] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.817371 29718 raft_consensus.cc:515] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.819023 29718 leader_election.cc:290] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509)
I20260709 13:09:37.819983 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:37.820269 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df6dbe75ce424697576f62262f2c02" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:37.820631 28869 raft_consensus.cc:3055] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.820955 28869 raft_consensus.cc:740] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:37.820982 28942 raft_consensus.cc:3060] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.821805 28869 consensus_queue.cc:260] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.823261 28869 raft_consensus.cc:3060] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.828656 28942 raft_consensus.cc:2468] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:37.829038 28869 raft_consensus.cc:2468] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:37.830144 29618 leader_election.cc:304] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:37.830940 29853 raft_consensus.cc:2804] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.831355 29853 raft_consensus.cc:697] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:37.832032 29853 consensus_queue.cc:237] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } }
I20260709 13:09:37.840914 28942 raft_consensus.cc:1275] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.842159 29853 consensus_queue.cc:1048] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.842128 28689 catalog_manager.cc:5697] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.865348 28869 raft_consensus.cc:1275] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.866673 29873 consensus_queue.cc:1048] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.943929 29009 raft_consensus.cc:1275] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:37.945493 29873 consensus_queue.cc:1048] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:37.945876 28869 raft_consensus.cc:1275] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.947108 29873 consensus_queue.cc:1048] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.955246 28864 raft_consensus.cc:1275] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:37.956831 29853 consensus_queue.cc:1048] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:37.972047 28942 raft_consensus.cc:1275] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.977501 29873 consensus_queue.cc:1048] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.075515 28869 raft_consensus.cc:1275] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.076956 29863 consensus_queue.cc:1048] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.085947 29009 raft_consensus.cc:1275] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.087287 29863 consensus_queue.cc:1048] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.109766 28865 raft_consensus.cc:1275] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.111181 29873 consensus_queue.cc:1048] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.129500 28940 raft_consensus.cc:1275] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.130861 29888 consensus_queue.cc:1048] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.216389 28940 raft_consensus.cc:1275] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.217803 29888 consensus_queue.cc:1048] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.228258 28865 raft_consensus.cc:1275] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.229918 29853 consensus_queue.cc:1048] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.280691 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:38.316294 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:38.359493 28869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e0029999088407b9d71307a13c1599b"
dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
mode: GRACEFUL
new_leader_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:38958
I20260709 13:09:38.360250 28869 raft_consensus.cc:606] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Received request to transfer leadership to TS 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:38.363196 29014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ba5ec54e7c44d24bc7d08fb0e839618"
dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:45054
I20260709 13:09:38.363785 29014 raft_consensus.cc:606] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:38.366442 29014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7"
dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
mode: GRACEFUL
new_leader_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:45054
I20260709 13:09:38.366927 29014 raft_consensus.cc:606] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Received request to transfer leadership to TS 7640ddad6f82422c8a0377a187b4e290
I20260709 13:09:38.369246 29014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9547f10aff2e45b8b40cd1b4bddf42d5"
dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:45054
I20260709 13:09:38.369721 29014 raft_consensus.cc:606] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:38.371958 29014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b"
dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:45054
I20260709 13:09:38.372393 29014 raft_consensus.cc:606] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:38.373409 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:38.374742 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:38.466086 29914 raft_consensus.cc:993] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:38.466650 29914 raft_consensus.cc:1081] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:38.468140 29718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ba5ec54e7c44d24bc7d08fb0e839618"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:09:38.468668 29718 raft_consensus.cc:493] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.468968 29718 raft_consensus.cc:3060] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.474452 29718 raft_consensus.cc:515] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:38.476234 29718 leader_election.cc:290] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:38.477023 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5ec54e7c44d24bc7d08fb0e839618" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:38.477429 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5ec54e7c44d24bc7d08fb0e839618" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:38.477784 28942 raft_consensus.cc:3060] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.478030 29014 raft_consensus.cc:3055] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.478392 29014 raft_consensus.cc:740] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:38.479213 29014 consensus_queue.cc:260] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:38.480502 29014 raft_consensus.cc:3060] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.485090 28942 raft_consensus.cc:2468] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:38.486500 29618 leader_election.cc:304] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:38.487313 29888 raft_consensus.cc:2804] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.487327 29014 raft_consensus.cc:2468] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:38.487916 29888 raft_consensus.cc:697] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:38.488868 29888 consensus_queue.cc:237] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:38.500063 28691 catalog_manager.cc:5697] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.548394 29882 raft_consensus.cc:993] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:38.548889 29791 raft_consensus.cc:993] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2: : Instructing follower 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:38.548933 29914 raft_consensus.cc:1081] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:38.549396 29921 raft_consensus.cc:1081] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Signalling peer 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:38.550808 28942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7"
dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:33668
I20260709 13:09:38.550774 29718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:09:38.551434 28942 raft_consensus.cc:493] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.551488 29718 raft_consensus.cc:493] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.551928 28942 raft_consensus.cc:3060] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.552024 29718 raft_consensus.cc:3060] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.557616 29718 raft_consensus.cc:515] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:38.557619 28942 raft_consensus.cc:515] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:38.559950 28942 leader_election.cc:290] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:38.560431 29718 leader_election.cc:290] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:38.561316 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:38.561904 28869 raft_consensus.cc:3060] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.562191 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413a0a088424cd884473468aa41ad3b" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:38.562754 29014 raft_consensus.cc:3055] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:38.563042 29014 raft_consensus.cc:740] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:38.563254 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:38.563872 28865 raft_consensus.cc:3060] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.563973 29014 consensus_queue.cc:260] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:38.565512 29014 raft_consensus.cc:3060] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.568754 28869 raft_consensus.cc:2468] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 3.
I20260709 13:09:38.570214 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845ec131ab0c46b49160d56a240504b7" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:38.570843 29009 raft_consensus.cc:3055] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.571171 29009 raft_consensus.cc:740] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:38.571322 28865 raft_consensus.cc:2468] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:38.572307 29618 leader_election.cc:304] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:38.572363 29014 raft_consensus.cc:2468] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 3.
I20260709 13:09:38.573591 29873 raft_consensus.cc:2804] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:38.574069 29873 raft_consensus.cc:697] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 3 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:38.574903 29873 consensus_queue.cc:237] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:38.580864 28907 leader_election.cc:304] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:38.581686 29865 raft_consensus.cc:2804] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.582198 29865 raft_consensus.cc:697] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:38.583005 29865 consensus_queue.cc:237] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:38.588027 29009 consensus_queue.cc:260] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:38.589387 29009 raft_consensus.cc:3060] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.598637 29009 raft_consensus.cc:2468] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:38.609119 28691 catalog_manager.cc:5697] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 1 to 2, leader changed from f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4) to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.620404 28693 catalog_manager.cc:5697] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 2 to 3, leader changed from f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 3 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.695614 29914 raft_consensus.cc:993] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:38.696283 29882 raft_consensus.cc:1081] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:38.698374 29718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9547f10aff2e45b8b40cd1b4bddf42d5"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:09:38.698931 29718 raft_consensus.cc:493] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.699514 29718 raft_consensus.cc:3060] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.706462 29718 raft_consensus.cc:515] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:38.707983 29718 leader_election.cc:290] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:38.708818 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547f10aff2e45b8b40cd1b4bddf42d5" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:38.709066 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9547f10aff2e45b8b40cd1b4bddf42d5" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:38.709755 29009 raft_consensus.cc:3055] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.710057 29009 raft_consensus.cc:740] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:38.710270 28941 raft_consensus.cc:3060] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.711030 29009 consensus_queue.cc:260] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:38.712332 29009 raft_consensus.cc:3060] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.718654 28941 raft_consensus.cc:2468] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:38.719868 29618 leader_election.cc:304] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:38.720638 29873 raft_consensus.cc:2804] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.721134 29873 raft_consensus.cc:697] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:38.722025 29009 raft_consensus.cc:2468] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:38.721957 29873 consensus_queue.cc:237] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:38.731809 28693 catalog_manager.cc:5697] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.883095 29778 raft_consensus.cc:993] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757: : Instructing follower 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:38.883553 29897 raft_consensus.cc:1081] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Signalling peer 7640ddad6f82422c8a0377a187b4e290 to start an election
I20260709 13:09:38.885106 28941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e0029999088407b9d71307a13c1599b"
dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
 from {username='slave'} at 127.0.0.1:33652
I20260709 13:09:38.885658 28941 raft_consensus.cc:493] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.885969 28941 raft_consensus.cc:3060] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.891180 28941 raft_consensus.cc:515] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:38.893014 28941 leader_election.cc:290] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Requested vote from peers 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:38.893764 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e0029999088407b9d71307a13c1599b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:38.894465 28869 raft_consensus.cc:3055] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.894508 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e0029999088407b9d71307a13c1599b" candidate_uuid: "7640ddad6f82422c8a0377a187b4e290" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:38.894761 28869 raft_consensus.cc:740] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89867186bb4546988c8fcd2b9fea8757, State: Running, Role: LEADER
I20260709 13:09:38.895212 29009 raft_consensus.cc:3060] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.895685 28869 consensus_queue.cc:260] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:38.897046 28869 raft_consensus.cc:3060] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.901465 29009 raft_consensus.cc:2468] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:38.902225 28869 raft_consensus.cc:2468] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7640ddad6f82422c8a0377a187b4e290 in term 2.
I20260709 13:09:38.902688 28908 leader_election.cc:304] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:38.903434 29865 raft_consensus.cc:2804] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.903867 29865 raft_consensus.cc:697] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Becoming Leader. State: Replica: 7640ddad6f82422c8a0377a187b4e290, State: Running, Role: LEADER
I20260709 13:09:38.904700 29865 consensus_queue.cc:237] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } }
I20260709 13:09:38.910487 28941 raft_consensus.cc:1275] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.911733 29873 consensus_queue.cc:1048] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.915604 28693 catalog_manager.cc:5697] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 reported cstate change: term changed from 1 to 2, leader changed from 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2) to 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "7640ddad6f82422c8a0377a187b4e290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.925769 29009 raft_consensus.cc:1275] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.927049 29888 consensus_queue.cc:1048] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.961517 28869 raft_consensus.cc:1275] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.963001 29888 consensus_queue.cc:1048] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:38.988185 29014 raft_consensus.cc:1275] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.990511 29888 consensus_queue.cc:1048] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.166486 29009 raft_consensus.cc:1275] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.167740 29863 consensus_queue.cc:1048] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.176365 28869 raft_consensus.cc:1275] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.178790 29863 consensus_queue.cc:1048] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.267917 28942 raft_consensus.cc:1275] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.269060 29888 consensus_queue.cc:1048] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.275867 29009 raft_consensus.cc:1275] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.277951 29888 consensus_queue.cc:1048] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.375661 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.414858 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.455363 29009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14e2f6598cef41e581c126c2788da507"
dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:45054
I20260709 13:09:39.455884 29009 raft_consensus.cc:606] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:39.458277 29009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88d9475e96d74d868e148f76bccfb047"
dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:45054
I20260709 13:09:39.458751 29009 raft_consensus.cc:606] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:39.460821 29009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17"
dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:45054
I20260709 13:09:39.461273 29009 raft_consensus.cc:606] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:39.463404 29009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a77eab9e557b46d8acc7483af6e6ad0d"
dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
mode: GRACEFUL
new_leader_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:45054
I20260709 13:09:39.463852 29009 raft_consensus.cc:606] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Received request to transfer leadership to TS 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:39.464766 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:39.465880 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:39.468899 28869 raft_consensus.cc:1275] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.470177 29865 consensus_queue.cc:1048] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.484784 29009 raft_consensus.cc:1275] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7640ddad6f82422c8a0377a187b4e290: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.485998 29865 consensus_queue.cc:1048] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.491204 29791 raft_consensus.cc:993] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:39.491632 29791 raft_consensus.cc:1081] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:39.493580 29718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14e2f6598cef41e581c126c2788da507"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:09:39.494165 29718 raft_consensus.cc:493] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.494539 29718 raft_consensus.cc:3060] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.502007 29718 raft_consensus.cc:515] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:39.504719 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e2f6598cef41e581c126c2788da507" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:39.504858 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e2f6598cef41e581c126c2788da507" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:39.505353 28942 raft_consensus.cc:3060] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.505676 29718 leader_election.cc:290] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:39.505492 29009 raft_consensus.cc:3055] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.507296 29009 raft_consensus.cc:740] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:39.508111 29009 consensus_queue.cc:260] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:39.509377 29009 raft_consensus.cc:3060] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.512840 28942 raft_consensus.cc:2468] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:39.514127 29618 leader_election.cc:304] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:39.516106 29009 raft_consensus.cc:2468] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:39.519976 29938 raft_consensus.cc:2804] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.520692 29938 raft_consensus.cc:697] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:39.522212 29914 raft_consensus.cc:993] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:39.521888 29938 consensus_queue.cc:237] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:39.522758 29914 raft_consensus.cc:1081] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:39.524652 29718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:09:39.525128 29718 raft_consensus.cc:493] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.525499 29718 raft_consensus.cc:3060] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.533093 29718 raft_consensus.cc:515] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:39.536691 28693 catalog_manager.cc:5697] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.538105 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:39.538820 29009 raft_consensus.cc:3055] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.539196 29009 raft_consensus.cc:740] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:39.540062 29009 consensus_queue.cc:260] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:39.541290 29009 raft_consensus.cc:3060] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.542424 29882 raft_consensus.cc:993] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:39.542925 29882 raft_consensus.cc:1081] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:39.545791 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5fb10557dd4995ab650a239d1cde17" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:39.546512 28865 raft_consensus.cc:3060] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.548969 29009 raft_consensus.cc:2468] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:39.552114 29619 leader_election.cc:304] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, f3d3a97b01f64816a2a769d159dd64d2; no voters: 
I20260709 13:09:39.552982 29853 raft_consensus.cc:2804] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.553498 29853 raft_consensus.cc:697] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:39.553814 29721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88d9475e96d74d868e148f76bccfb047"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:09:39.554581 29721 raft_consensus.cc:493] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.554409 29853 consensus_queue.cc:237] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:39.555023 29721 raft_consensus.cc:3060] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.540500 29718 leader_election.cc:290] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:39.559661 28865 raft_consensus.cc:2468] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:39.566763 29721 raft_consensus.cc:515] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:39.569618 29721 leader_election.cc:290] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467)
I20260709 13:09:39.569496 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d9475e96d74d868e148f76bccfb047" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7640ddad6f82422c8a0377a187b4e290"
I20260709 13:09:39.569780 29009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d9475e96d74d868e148f76bccfb047" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:39.570271 28941 raft_consensus.cc:3060] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.570411 29009 raft_consensus.cc:3055] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.570833 29009 raft_consensus.cc:740] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:39.571563 29009 consensus_queue.cc:260] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:39.572750 29009 raft_consensus.cc:3060] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.577481 28941 raft_consensus.cc:2468] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:39.578631 29618 leader_election.cc:304] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70; no voters: 
I20260709 13:09:39.579623 29853 raft_consensus.cc:2804] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.580133 29853 raft_consensus.cc:697] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:39.580999 29853 consensus_queue.cc:237] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:39.580965 28693 catalog_manager.cc:5697] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.582893 29009 raft_consensus.cc:2468] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:39.601018 28693 catalog_manager.cc:5697] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.885519 29914 raft_consensus.cc:993] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2: : Instructing follower 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:39.885953 29791 raft_consensus.cc:1081] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Signalling peer 7f68815192fc48a58a67ddf2da3bac70 to start an election
I20260709 13:09:39.887449 29718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a77eab9e557b46d8acc7483af6e6ad0d"
dest_uuid: "7f68815192fc48a58a67ddf2da3bac70"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:09:39.888036 29718 raft_consensus.cc:493] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.888393 29718 raft_consensus.cc:3060] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.894286 29718 raft_consensus.cc:515] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:39.896396 29718 leader_election.cc:290] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Requested vote from peers f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4:46467), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:39.896719 29014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77eab9e557b46d8acc7483af6e6ad0d" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d3a97b01f64816a2a769d159dd64d2"
I20260709 13:09:39.897073 28865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77eab9e557b46d8acc7483af6e6ad0d" candidate_uuid: "7f68815192fc48a58a67ddf2da3bac70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89867186bb4546988c8fcd2b9fea8757"
I20260709 13:09:39.897426 29014 raft_consensus.cc:3055] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.897760 29014 raft_consensus.cc:740] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d3a97b01f64816a2a769d159dd64d2, State: Running, Role: LEADER
I20260709 13:09:39.898028 28865 raft_consensus.cc:3060] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.898569 29014 consensus_queue.cc:260] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:39.899892 29014 raft_consensus.cc:3060] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.905158 28865 raft_consensus.cc:2468] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:39.906553 29618 leader_election.cc:304] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757; no voters: 
I20260709 13:09:39.906819 29014 raft_consensus.cc:2468] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f68815192fc48a58a67ddf2da3bac70 in term 2.
I20260709 13:09:39.907583 29853 raft_consensus.cc:2804] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.908764 29853 raft_consensus.cc:697] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Becoming Leader. State: Replica: 7f68815192fc48a58a67ddf2da3bac70, State: Running, Role: LEADER
I20260709 13:09:39.910038 29853 consensus_queue.cc:237] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:39.919610 28693 catalog_manager.cc:5697] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 reported cstate change: term changed from 1 to 2, leader changed from f3d3a97b01f64816a2a769d159dd64d2 (127.20.208.4) to 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "7f68815192fc48a58a67ddf2da3bac70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.001263 28941 raft_consensus.cc:1275] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.002763 29938 consensus_queue.cc:1048] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.006675 28940 raft_consensus.cc:1275] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.008592 29938 consensus_queue.cc:1048] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.022497 29009 raft_consensus.cc:1275] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.028767 29853 consensus_queue.cc:1048] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.046051 29014 raft_consensus.cc:1275] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.047793 29888 consensus_queue.cc:1048] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.105126 28869 raft_consensus.cc:1275] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.106268 29938 consensus_queue.cc:1048] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.127538 29011 raft_consensus.cc:1275] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.130400 29888 consensus_queue.cc:1048] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.384624 28869 raft_consensus.cc:1275] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.385842 29853 consensus_queue.cc:1048] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.401526 29014 raft_consensus.cc:1275] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Refusing update from remote peer 7f68815192fc48a58a67ddf2da3bac70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.403019 29873 consensus_queue.cc:1048] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.466781 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:40.509250 21312 tablet_server.cc:179] TabletServer@127.20.208.1:41969 shutting down...
W20260709 13:09:40.518497 28984 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 262 similar messages]
W20260709 13:09:40.522012 28984 consensus_peers.cc:597] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.526554 28984 consensus_peers.cc:597] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.541887 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:40.543023 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.543936 21312 raft_consensus.cc:2243] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.544433 21312 raft_consensus.cc:2272] T 0358f1bde5044224a2fb9711b1f990b6 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.547171 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.548010 21312 raft_consensus.cc:2243] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.548870 21312 raft_consensus.cc:2272] T b029f39d79fe45a2914c451500924304 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.551162 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.551874 21312 raft_consensus.cc:2243] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.552716 21312 raft_consensus.cc:2272] T 6c946f5606ec4af895c04195b74db3e1 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.554811 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.555397 21312 raft_consensus.cc:2243] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.556178 21312 raft_consensus.cc:2272] T 8a5fb10557dd4995ab650a239d1cde17 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.559340 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.560145 21312 raft_consensus.cc:2243] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.560752 21312 raft_consensus.cc:2272] T 45159667ba6f4b919ff80fa9d04e360e P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.562860 28984 consensus_peers.cc:597] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.563899 21312 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:40.563862 28836 consensus_peers.cc:597] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.564977 21312 raft_consensus.cc:2243] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.565438 21312 raft_consensus.cc:2272] T 37f7afbd6bd14202b784bc4c24b71bd1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.568245 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.569209 21312 raft_consensus.cc:2243] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.569691 21312 raft_consensus.cc:2272] T f34810d0af154f329fec45e857a80d99 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.571302 28910 consensus_peers.cc:597] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.572098 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.572844 21312 raft_consensus.cc:2243] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.573256 21312 raft_consensus.cc:2272] T 63e0aebb326f4409a072848dd5227247 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.575755 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.576435 21312 raft_consensus.cc:2243] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.576923 21312 raft_consensus.cc:2272] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.579867 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.580842 21312 raft_consensus.cc:2243] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.581832 21312 raft_consensus.cc:2272] T 14e2f6598cef41e581c126c2788da507 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.585042 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.585920 21312 raft_consensus.cc:2243] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.586470 21312 raft_consensus.cc:2272] T f4dc4bce7caf4a349b3ce695b2658707 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.589601 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.590469 21312 raft_consensus.cc:2243] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.591034 21312 raft_consensus.cc:2272] T fbf928a86b924440b6bfc966df8860b8 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.592588 28836 consensus_peers.cc:597] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.593945 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.594924 21312 raft_consensus.cc:2243] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.595482 21312 raft_consensus.cc:2272] T 92c712a67162406ba7f28ef7f9b396b9 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.597250 28910 consensus_peers.cc:597] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.598531 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.599720 21312 raft_consensus.cc:2243] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.600162 21312 raft_consensus.cc:2272] T 3792b36a88e84708afea67ae52341ad1 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.601862 28984 consensus_peers.cc:597] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.603022 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.603938 21312 raft_consensus.cc:2243] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.604519 21312 raft_consensus.cc:2272] T ffdf6272d9e4462c8bd8e31403360a5b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.607168 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.607769 21312 raft_consensus.cc:2243] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.608145 21312 raft_consensus.cc:2272] T e014e29eece34924b34eaf88458e5ab4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.610536 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.611182 21312 raft_consensus.cc:2243] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.612047 21312 raft_consensus.cc:2272] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.614499 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.615425 21312 raft_consensus.cc:2243] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.616197 21312 raft_consensus.cc:2272] T c413a0a088424cd884473468aa41ad3b P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.618252 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.618940 21312 raft_consensus.cc:2243] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.619494 21312 raft_consensus.cc:2272] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.622416 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.622985 21312 raft_consensus.cc:2243] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.623389 21312 raft_consensus.cc:2272] T 505c7b69cc824534a36d0f305227ccfe P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.625797 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.626608 21312 raft_consensus.cc:2243] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.627102 21312 raft_consensus.cc:2272] T b3841cb2f1364534b341ed93ebd0f73f P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.629701 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.630498 21312 raft_consensus.cc:2243] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:09:40.631294 28984 consensus_peers.cc:597] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.631429 21312 raft_consensus.cc:2272] T d1293cb1f6ed468da880ff1ee758b3b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.633790 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.634433 21312 raft_consensus.cc:2243] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.635197 21312 raft_consensus.cc:2272] T ca66f80367c145af96bd99c7df4ccbd0 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.637279 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.637969 21312 raft_consensus.cc:2243] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.638443 21312 raft_consensus.cc:2272] T d40c62440e604ddfb2e59ee713fbbb34 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.641158 21312 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:40.641721 28836 consensus_peers.cc:597] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.642058 21312 raft_consensus.cc:2243] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.642681 21312 raft_consensus.cc:2272] T e897b01fbc7d44a2b2a24b592d256a55 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.645303 28836 consensus_peers.cc:597] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.645455 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.646349 21312 raft_consensus.cc:2243] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.647318 21312 raft_consensus.cc:2272] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.649539 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.650106 21312 raft_consensus.cc:2243] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.650815 21312 raft_consensus.cc:2272] T 9427717c9f3e4422b4864beddbf36d0c P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.653149 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.653801 21312 raft_consensus.cc:2243] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.654356 21312 raft_consensus.cc:2272] T 060ea2b150b444aab3e1430624fe2a3d P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.657091 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.657655 21312 raft_consensus.cc:2243] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.658125 21312 raft_consensus.cc:2272] T a0f5b8a34d8d42c7958b3e1a2423802c P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.660753 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.661520 21312 raft_consensus.cc:2243] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.662496 21312 raft_consensus.cc:2272] T 2fbc309858774a56b5464235e918e3d5 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.665045 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.665706 21312 raft_consensus.cc:2243] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.666115 21312 raft_consensus.cc:2272] T b6c27c89959045278c3f55d885d5391f P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.668291 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.668998 21312 raft_consensus.cc:2243] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.669486 21312 raft_consensus.cc:2272] T 72bfbcadacb1480fbedbd436808ea85b P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.672191 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.673038 21312 raft_consensus.cc:2243] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.673521 21312 raft_consensus.cc:2272] T e6d945783c31437981498fa3ba0887ff P 7f68815192fc48a58a67ddf2da3bac70 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.675666 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.676237 21312 raft_consensus.cc:2243] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.676683 21312 raft_consensus.cc:2272] T f3ae58f02e904d698a5cfb5b598b91be P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.678553 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.679080 21312 raft_consensus.cc:2243] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.679474 21312 raft_consensus.cc:2272] T da3ea20eff10460186a8e96381d02883 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.681460 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.681970 21312 raft_consensus.cc:2243] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.682397 21312 raft_consensus.cc:2272] T bde8f4a342f345cf90f76ba21b614c2b P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.684276 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.684834 21312 raft_consensus.cc:2243] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.685609 21312 raft_consensus.cc:2272] T a77eab9e557b46d8acc7483af6e6ad0d P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.688120 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.688758 21312 raft_consensus.cc:2243] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.689255 21312 raft_consensus.cc:2272] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.691196 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.691713 21312 raft_consensus.cc:2243] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.692101 21312 raft_consensus.cc:2272] T d918ac438d8147cb8488b64ab616301e P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.694321 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.694840 21312 raft_consensus.cc:2243] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.695673 21312 raft_consensus.cc:2272] T 88d9475e96d74d868e148f76bccfb047 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.697963 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.698485 21312 raft_consensus.cc:2243] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.699244 21312 raft_consensus.cc:2272] T c18d000a8ebe429caa1c1c23e30e8c46 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.701542 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.702040 21312 raft_consensus.cc:2243] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.702463 21312 raft_consensus.cc:2272] T 3bd25378f6794f9ab52ee328577124e3 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.703049 28984 consensus_peers.cc:597] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.704448 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.705090 21312 raft_consensus.cc:2243] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.706074 21312 raft_consensus.cc:2272] T c9df6dbe75ce424697576f62262f2c02 P 7f68815192fc48a58a67ddf2da3bac70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.709177 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.709779 21312 raft_consensus.cc:2243] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.710239 21312 raft_consensus.cc:2272] T 4fd628bc39b04e3eb0cad27972841737 P 7f68815192fc48a58a67ddf2da3bac70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.712296 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:40.712838 21312 raft_consensus.cc:2243] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.713227 21312 raft_consensus.cc:2272] T 8125abb8d87d437cb630354900d6e5b4 P 7f68815192fc48a58a67ddf2da3bac70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.730388 28984 consensus_peers.cc:597] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.745831 28984 consensus_peers.cc:597] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.761168 28910 consensus_peers.cc:597] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.783775 21312 tablet_server.cc:196] TabletServer@127.20.208.1:41969 shutdown complete.
W20260709 13:09:40.786453 28836 consensus_peers.cc:597] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.801803 28836 consensus_peers.cc:597] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.807185 28984 consensus_peers.cc:597] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.820163 28984 consensus_peers.cc:597] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.832226 28984 consensus_peers.cc:597] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.834129 28836 consensus_peers.cc:597] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.876698 21312 tablet_server.cc:179] TabletServer@127.20.208.2:0 shutting down...
W20260709 13:09:40.893432 28907 consensus_peers.cc:597] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.899379 28984 consensus_peers.cc:597] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.899863 28981 consensus_peers.cc:597] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.911736 28984 consensus_peers.cc:597] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.919993 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:40.921025 21312 tablet_replica.cc:333] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.922000 21312 raft_consensus.cc:2243] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.922602 21312 raft_consensus.cc:2272] T 37f7afbd6bd14202b784bc4c24b71bd1 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.925488 21312 tablet_replica.cc:333] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.926365 21312 raft_consensus.cc:2243] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.927387 21312 raft_consensus.cc:2272] T f34810d0af154f329fec45e857a80d99 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.930297 21312 tablet_replica.cc:333] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.931056 21312 raft_consensus.cc:2243] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.931727 21312 raft_consensus.cc:2272] T f4dc4bce7caf4a349b3ce695b2658707 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.934288 28836 consensus_peers.cc:597] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.934628 21312 tablet_replica.cc:333] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.935550 21312 raft_consensus.cc:2243] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.936671 21312 raft_consensus.cc:2272] T b0d50209455e43a6b08ae3f9f45fc6fe P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.939379 21312 tablet_replica.cc:333] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.940101 21312 raft_consensus.cc:2243] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.940559 21312 raft_consensus.cc:2272] T 2e0029999088407b9d71307a13c1599b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.942375 21312 tablet_replica.cc:333] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.943037 21312 raft_consensus.cc:2243] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.943552 21312 raft_consensus.cc:2272] T 0358f1bde5044224a2fb9711b1f990b6 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.945689 21312 tablet_replica.cc:333] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.946450 21312 raft_consensus.cc:2243] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.947363 21312 raft_consensus.cc:2272] T 8125abb8d87d437cb630354900d6e5b4 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.947384 28836 consensus_peers.cc:597] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.949738 21312 tablet_replica.cc:333] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.950337 21312 raft_consensus.cc:2243] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.950773 21312 raft_consensus.cc:2272] T 41fcfba163a74ac1b6aa94f2022c252e P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.952827 21312 tablet_replica.cc:333] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.953375 21312 raft_consensus.cc:2243] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.953744 21312 raft_consensus.cc:2272] T 9427717c9f3e4422b4864beddbf36d0c P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.955695 21312 tablet_replica.cc:333] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.956459 21312 raft_consensus.cc:2243] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.956915 21312 raft_consensus.cc:2272] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.958985 21312 tablet_replica.cc:333] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.959538 21312 raft_consensus.cc:2243] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.959945 21312 raft_consensus.cc:2272] T 8a5fb10557dd4995ab650a239d1cde17 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.962247 21312 tablet_replica.cc:333] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.962895 21312 raft_consensus.cc:2243] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.963332 21312 raft_consensus.cc:2272] T 37be0dd46a214f7d9eef969ee4d69966 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.965176 21312 tablet_replica.cc:333] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.965751 21312 raft_consensus.cc:2243] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.966493 21312 raft_consensus.cc:2272] T da3ea20eff10460186a8e96381d02883 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.968547 21312 tablet_replica.cc:333] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.969355 21312 raft_consensus.cc:2243] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.970485 21312 raft_consensus.cc:2272] T bde8f4a342f345cf90f76ba21b614c2b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.973255 21312 tablet_replica.cc:333] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.974043 21312 raft_consensus.cc:2243] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.974583 21312 raft_consensus.cc:2272] T d1293cb1f6ed468da880ff1ee758b3b4 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.977309 21312 tablet_replica.cc:333] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.978070 21312 raft_consensus.cc:2243] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.978583 21312 raft_consensus.cc:2272] T ca66f80367c145af96bd99c7df4ccbd0 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.978384 28981 consensus_peers.cc:597] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.981364 21312 tablet_replica.cc:333] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.982204 21312 raft_consensus.cc:2243] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.982745 21312 raft_consensus.cc:2272] T da7fd30052d142679c225954b5b5724b P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.985374 21312 tablet_replica.cc:333] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.986208 21312 raft_consensus.cc:2243] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:40.986464 28981 consensus_peers.cc:597] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.987382 21312 raft_consensus.cc:2272] T 68bbc69d44e948e7b6f3a85ea80aec7e P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.990351 21312 tablet_replica.cc:333] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:40.991214 21312 raft_consensus.cc:2243] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.992305 21312 raft_consensus.cc:2272] T 6714d660646441d58bea7a912cba0ec8 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.993567 28984 consensus_peers.cc:597] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.994470 28981 consensus_peers.cc:597] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.995769 21312 tablet_replica.cc:333] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
W20260709 13:09:40.996466 28907 consensus_peers.cc:597] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.996595 21312 raft_consensus.cc:2243] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.997376 21312 raft_consensus.cc:2272] T c413a0a088424cd884473468aa41ad3b P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.999805 21312 tablet_replica.cc:333] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.000661 21312 raft_consensus.cc:2243] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.001272 21312 raft_consensus.cc:2272] T 397ea1e4725643da8ae65abeabbabcd7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.003139 28984 consensus_peers.cc:597] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.009693 28907 consensus_peers.cc:597] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.015456 21312 tablet_replica.cc:333] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.016577 21312 raft_consensus.cc:2243] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.017496 21312 raft_consensus.cc:2272] T 3792b36a88e84708afea67ae52341ad1 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.018867 28907 consensus_peers.cc:597] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.019713 28910 consensus_peers.cc:597] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.020515 21312 tablet_replica.cc:333] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.021230 21312 raft_consensus.cc:2243] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.021692 21312 raft_consensus.cc:2272] T 128ca54c3ca34865935113dc7a9f0d21 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.024152 21312 tablet_replica.cc:333] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.024937 21312 raft_consensus.cc:2243] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.025523 21312 raft_consensus.cc:2272] T a77eab9e557b46d8acc7483af6e6ad0d P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.028312 21312 tablet_replica.cc:333] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.028975 21312 raft_consensus.cc:2243] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.029819 21312 raft_consensus.cc:2272] T fbf928a86b924440b6bfc966df8860b8 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.034960 21312 tablet_replica.cc:333] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.035775 21312 raft_consensus.cc:2243] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.037341 21312 raft_consensus.cc:2272] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.039580 21312 tablet_replica.cc:333] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.040146 21312 raft_consensus.cc:2243] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.040756 21312 raft_consensus.cc:2272] T 1918784f405b46fe85f940384b1e4520 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.043744 21312 tablet_replica.cc:333] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.044543 21312 raft_consensus.cc:2243] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.045104 21312 raft_consensus.cc:2272] T a0f5b8a34d8d42c7958b3e1a2423802c P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.049899 21312 tablet_replica.cc:333] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.050705 21312 raft_consensus.cc:2243] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.052222 21312 raft_consensus.cc:2272] T b6c27c89959045278c3f55d885d5391f P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.054272 28836 consensus_peers.cc:597] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 -> Peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Couldn't send request to peer 7f68815192fc48a58a67ddf2da3bac70. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.056373 21312 tablet_replica.cc:333] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.057206 21312 raft_consensus.cc:2243] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.057786 21312 raft_consensus.cc:2272] T 2fbc309858774a56b5464235e918e3d5 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.060814 21312 tablet_replica.cc:333] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.063131 21312 raft_consensus.cc:2243] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.064327 21312 raft_consensus.cc:2272] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.067481 21312 tablet_replica.cc:333] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.068280 21312 raft_consensus.cc:2243] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.069550 21312 raft_consensus.cc:2272] T 8e6aa359b7334b7ab7b98c3a741e7402 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.072386 21312 tablet_replica.cc:333] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.073180 21312 raft_consensus.cc:2243] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.073756 21312 raft_consensus.cc:2272] T 845ec131ab0c46b49160d56a240504b7 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.076350 21312 tablet_replica.cc:333] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.077129 21312 raft_consensus.cc:2243] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.077677 21312 raft_consensus.cc:2272] T 72bfbcadacb1480fbedbd436808ea85b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.080308 21312 tablet_replica.cc:333] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.081079 21312 raft_consensus.cc:2243] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.082129 21312 raft_consensus.cc:2272] T f3ae58f02e904d698a5cfb5b598b91be P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.085016 21312 tablet_replica.cc:333] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.085739 21312 raft_consensus.cc:2243] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.086262 21312 raft_consensus.cc:2272] T c9df6dbe75ce424697576f62262f2c02 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.089038 21312 tablet_replica.cc:333] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.089740 21312 raft_consensus.cc:2243] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.090416 21312 raft_consensus.cc:2272] T 62a577314507499e84f3ce9f1f878ddd P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.093145 21312 tablet_replica.cc:333] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
W20260709 13:09:41.093091 28907 consensus_peers.cc:597] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.094125 21312 raft_consensus.cc:2243] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.094687 21312 raft_consensus.cc:2272] T c18d000a8ebe429caa1c1c23e30e8c46 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.097458 21312 tablet_replica.cc:333] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.098260 21312 raft_consensus.cc:2243] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.098807 21312 raft_consensus.cc:2272] T 92c712a67162406ba7f28ef7f9b396b9 P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.102000 21312 tablet_replica.cc:333] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.102855 21312 raft_consensus.cc:2243] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.103418 21312 raft_consensus.cc:2272] T b029f39d79fe45a2914c451500924304 P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.106216 21312 tablet_replica.cc:333] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.106832 21312 raft_consensus.cc:2243] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.107590 21312 raft_consensus.cc:2272] T 4fd628bc39b04e3eb0cad27972841737 P 89867186bb4546988c8fcd2b9fea8757 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.109949 21312 tablet_replica.cc:333] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.110488 21312 raft_consensus.cc:2243] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.110934 21312 raft_consensus.cc:2272] T ffdf6272d9e4462c8bd8e31403360a5b P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.113665 21312 tablet_replica.cc:333] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.114179 21312 raft_consensus.cc:2243] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.114701 21312 raft_consensus.cc:2272] T b3841cb2f1364534b341ed93ebd0f73f P 89867186bb4546988c8fcd2b9fea8757 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.115411 28907 consensus_peers.cc:597] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.117050 21312 tablet_replica.cc:333] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757: stopping tablet replica
I20260709 13:09:41.117604 21312 raft_consensus.cc:2243] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.118360 21312 raft_consensus.cc:2272] T 505c7b69cc824534a36d0f305227ccfe P 89867186bb4546988c8fcd2b9fea8757 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.133562 28907 consensus_peers.cc:597] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.137961 28907 consensus_peers.cc:597] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.184451 21312 tablet_server.cc:196] TabletServer@127.20.208.2:0 shutdown complete.
W20260709 13:09:41.212173 28981 consensus_peers.cc:597] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:41345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.213246 28981 consensus_peers.cc:597] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:41345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.217541 28907 consensus_peers.cc:597] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:41345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.257483 21312 tablet_server.cc:179] TabletServer@127.20.208.3:0 shutting down...
W20260709 13:09:41.263638 28907 consensus_peers.cc:597] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:41345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.285562 28907 consensus_peers.cc:597] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:41345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.297677 28907 consensus_peers.cc:597] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:41345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.316653 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:41.317662 21312 tablet_replica.cc:333] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.318645 21312 raft_consensus.cc:2243] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.319499 21312 raft_consensus.cc:2272] T 37be0dd46a214f7d9eef969ee4d69966 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.321929 21312 tablet_replica.cc:333] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.322860 21312 raft_consensus.cc:2243] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.323423 21312 raft_consensus.cc:2272] T da3ea20eff10460186a8e96381d02883 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.325451 21312 tablet_replica.cc:333] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.326053 21312 raft_consensus.cc:2243] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.326865 21312 raft_consensus.cc:2272] T 2e0029999088407b9d71307a13c1599b P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.328855 21312 tablet_replica.cc:333] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.329447 21312 raft_consensus.cc:2243] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.329869 21312 raft_consensus.cc:2272] T 8125abb8d87d437cb630354900d6e5b4 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.331856 21312 tablet_replica.cc:333] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.332424 21312 raft_consensus.cc:2243] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.333227 21312 raft_consensus.cc:2272] T 41fcfba163a74ac1b6aa94f2022c252e P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.335099 21312 tablet_replica.cc:333] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.335680 21312 raft_consensus.cc:2243] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.336130 21312 raft_consensus.cc:2272] T 060ea2b150b444aab3e1430624fe2a3d P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.337999 21312 tablet_replica.cc:333] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.338533 21312 raft_consensus.cc:2243] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.338963 21312 raft_consensus.cc:2272] T 9547f10aff2e45b8b40cd1b4bddf42d5 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.340793 21312 tablet_replica.cc:333] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.341284 21312 raft_consensus.cc:2243] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.341666 21312 raft_consensus.cc:2272] T 9427717c9f3e4422b4864beddbf36d0c P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.343509 21312 tablet_replica.cc:333] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.344043 21312 raft_consensus.cc:2243] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.344439 21312 raft_consensus.cc:2272] T 6ba5ec54e7c44d24bc7d08fb0e839618 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.346750 21312 tablet_replica.cc:333] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.347337 21312 raft_consensus.cc:2243] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.348202 21312 raft_consensus.cc:2272] T da7fd30052d142679c225954b5b5724b P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.348567 28981 consensus_peers.cc:597] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.350401 21312 tablet_replica.cc:333] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.351181 21312 raft_consensus.cc:2243] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.351668 21312 raft_consensus.cc:2272] T e014e29eece34924b34eaf88458e5ab4 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.354251 21312 tablet_replica.cc:333] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.354820 21312 raft_consensus.cc:2243] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.355230 21312 raft_consensus.cc:2272] T 68bbc69d44e948e7b6f3a85ea80aec7e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.357180 21312 tablet_replica.cc:333] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.357717 21312 raft_consensus.cc:2243] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.358098 21312 raft_consensus.cc:2272] T 6c946f5606ec4af895c04195b74db3e1 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.360004 21312 tablet_replica.cc:333] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.360555 21312 raft_consensus.cc:2243] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.360994 21312 raft_consensus.cc:2272] T d1293cb1f6ed468da880ff1ee758b3b4 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.363409 21312 tablet_replica.cc:333] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.363989 21312 raft_consensus.cc:2243] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.364506 21312 raft_consensus.cc:2272] T ca66f80367c145af96bd99c7df4ccbd0 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.366879 21312 tablet_replica.cc:333] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.367592 21312 raft_consensus.cc:2243] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.368165 21312 raft_consensus.cc:2272] T 88d9475e96d74d868e148f76bccfb047 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.369109 28981 consensus_peers.cc:597] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Couldn't send request to peer 89867186bb4546988c8fcd2b9fea8757. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:41345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.370280 21312 tablet_replica.cc:333] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.370932 21312 raft_consensus.cc:2243] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.371690 21312 raft_consensus.cc:2272] T 2c3b31ed6f204a71a8ac57ddbc19e662 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.373720 21312 tablet_replica.cc:333] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.374296 21312 raft_consensus.cc:2243] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.374733 21312 raft_consensus.cc:2272] T 6714d660646441d58bea7a912cba0ec8 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.376808 21312 tablet_replica.cc:333] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.377357 21312 raft_consensus.cc:2243] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.377797 21312 raft_consensus.cc:2272] T d40c62440e604ddfb2e59ee713fbbb34 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.379799 21312 tablet_replica.cc:333] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.380344 21312 raft_consensus.cc:2243] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.381145 21312 raft_consensus.cc:2272] T 397ea1e4725643da8ae65abeabbabcd7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.383088 21312 tablet_replica.cc:333] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.383642 21312 raft_consensus.cc:2243] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.384047 21312 raft_consensus.cc:2272] T c9df6dbe75ce424697576f62262f2c02 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.385869 21312 tablet_replica.cc:333] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.386386 21312 raft_consensus.cc:2243] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.387188 21312 raft_consensus.cc:2272] T 62a577314507499e84f3ce9f1f878ddd P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.389657 21312 tablet_replica.cc:333] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.390384 21312 raft_consensus.cc:2243] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.390852 21312 raft_consensus.cc:2272] T 3bd25378f6794f9ab52ee328577124e3 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.393343 21312 tablet_replica.cc:333] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.393970 21312 raft_consensus.cc:2243] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.394770 21312 raft_consensus.cc:2272] T 3792b36a88e84708afea67ae52341ad1 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.397197 21312 tablet_replica.cc:333] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.397946 21312 raft_consensus.cc:2243] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.398444 21312 raft_consensus.cc:2272] T d918ac438d8147cb8488b64ab616301e P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.400159 28981 consensus_peers.cc:597] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.400893 21312 tablet_replica.cc:333] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.401525 21312 raft_consensus.cc:2243] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.402278 21312 raft_consensus.cc:2272] T 1918784f405b46fe85f940384b1e4520 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.404277 21312 tablet_replica.cc:333] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.404863 21312 raft_consensus.cc:2243] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.405294 21312 raft_consensus.cc:2272] T 505c7b69cc824534a36d0f305227ccfe P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.407286 21312 tablet_replica.cc:333] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.407871 21312 raft_consensus.cc:2243] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.408715 21312 raft_consensus.cc:2272] T 8996feb2bbcd43b4b8cef11d3cea4e91 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.411068 21312 tablet_replica.cc:333] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.411765 21312 raft_consensus.cc:2243] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.412317 21312 raft_consensus.cc:2272] T 2fbc309858774a56b5464235e918e3d5 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.414978 21312 tablet_replica.cc:333] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.415692 21312 raft_consensus.cc:2243] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.416204 21312 raft_consensus.cc:2272] T b6c27c89959045278c3f55d885d5391f P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.418983 21312 tablet_replica.cc:333] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.419668 21312 raft_consensus.cc:2243] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.420272 21312 raft_consensus.cc:2272] T e6d945783c31437981498fa3ba0887ff P 7640ddad6f82422c8a0377a187b4e290 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.423094 21312 tablet_replica.cc:333] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.423804 21312 raft_consensus.cc:2243] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.424329 21312 raft_consensus.cc:2272] T f3ae58f02e904d698a5cfb5b598b91be P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.426448 21312 tablet_replica.cc:333] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.426990 21312 raft_consensus.cc:2243] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.427424 21312 raft_consensus.cc:2272] T 45159667ba6f4b919ff80fa9d04e360e P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.429545 21312 tablet_replica.cc:333] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.430078 21312 raft_consensus.cc:2243] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.430490 21312 raft_consensus.cc:2272] T 7caa5ccce9344e3993cdd74c21d6d2d7 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.432405 21312 tablet_replica.cc:333] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.432960 21312 raft_consensus.cc:2243] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.433348 21312 raft_consensus.cc:2272] T 14e2f6598cef41e581c126c2788da507 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.435653 21312 tablet_replica.cc:333] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.436410 21312 raft_consensus.cc:2243] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.437254 21312 raft_consensus.cc:2272] T 845ec131ab0c46b49160d56a240504b7 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.439522 21312 tablet_replica.cc:333] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.440040 21312 raft_consensus.cc:2243] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.440434 21312 raft_consensus.cc:2272] T 8e6aa359b7334b7ab7b98c3a741e7402 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.442598 21312 tablet_replica.cc:333] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.443138 21312 raft_consensus.cc:2243] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.443918 21312 raft_consensus.cc:2272] T ffdf6272d9e4462c8bd8e31403360a5b P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.446007 21312 tablet_replica.cc:333] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.446584 21312 raft_consensus.cc:2243] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.447000 21312 raft_consensus.cc:2272] T b0d50209455e43a6b08ae3f9f45fc6fe P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.449033 21312 tablet_replica.cc:333] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.449600 21312 raft_consensus.cc:2243] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.450421 21312 raft_consensus.cc:2272] T 63e0aebb326f4409a072848dd5227247 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.452045 28981 consensus_peers.cc:597] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.452649 21312 tablet_replica.cc:333] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.453258 21312 raft_consensus.cc:2243] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.453661 21312 raft_consensus.cc:2272] T e897b01fbc7d44a2b2a24b592d256a55 P 7640ddad6f82422c8a0377a187b4e290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.455547 21312 tablet_replica.cc:333] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.456025 21312 raft_consensus.cc:2243] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.456873 21312 raft_consensus.cc:2272] T 128ca54c3ca34865935113dc7a9f0d21 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.458828 21312 tablet_replica.cc:333] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.459290 21312 raft_consensus.cc:2243] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.459653 21312 raft_consensus.cc:2272] T b029f39d79fe45a2914c451500924304 P 7640ddad6f82422c8a0377a187b4e290 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.462028 21312 tablet_replica.cc:333] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290: stopping tablet replica
I20260709 13:09:41.462512 21312 raft_consensus.cc:2243] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.462939 21312 raft_consensus.cc:2272] T 4fd628bc39b04e3eb0cad27972841737 P 7640ddad6f82422c8a0377a187b4e290 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.561714 21312 tablet_server.cc:196] TabletServer@127.20.208.3:0 shutdown complete.
W20260709 13:09:41.597901 28981 consensus_peers.cc:597] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40509: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.630400 28981 consensus_peers.cc:597] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40509: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.632825 21312 tablet_server.cc:179] TabletServer@127.20.208.4:0 shutting down...
I20260709 13:09:41.634903 29791 raft_consensus.cc:493] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:41.635444 29791 raft_consensus.cc:515] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:41.637012 29791 leader_election.cc:290] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
W20260709 13:09:41.642848 28981 leader_election.cc:336] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Network error: Client connection negotiation failed: client connection to 127.20.208.2:41345: connect: Connection refused (error 111)
W20260709 13:09:41.649884 28984 leader_election.cc:336] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:41.650238 28984 leader_election.cc:304] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:41.650835 29791 raft_consensus.cc:2749] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:41.655697 29969 raft_consensus.cc:493] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:41.656231 29969 raft_consensus.cc:515] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:41.660620 29969 leader_election.cc:290] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:41.668020 28984 leader_election.cc:336] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
W20260709 13:09:41.669865 28981 leader_election.cc:336] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40509: connect: Connection refused (error 111)
I20260709 13:09:41.670239 28981 leader_election.cc:304] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:41.670807 29791 raft_consensus.cc:2749] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:41.672367 28981 consensus_peers.cc:597] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40509: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.680292 29969 raft_consensus.cc:493] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:41.681097 29969 raft_consensus.cc:515] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7640ddad6f82422c8a0377a187b4e290" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 40509 } } peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } }
I20260709 13:09:41.683353 29969 leader_election.cc:290] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509), 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969)
W20260709 13:09:41.690598 28984 leader_election.cc:336] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
W20260709 13:09:41.693842 28981 leader_election.cc:336] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Network error: Client connection negotiation failed: client connection to 127.20.208.3:40509: connect: Connection refused (error 111)
I20260709 13:09:41.694516 28981 leader_election.cc:304] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7640ddad6f82422c8a0377a187b4e290, 7f68815192fc48a58a67ddf2da3bac70
I20260709 13:09:41.695628 29975 raft_consensus.cc:2749] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:41.700392 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:41.701469 21312 tablet_replica.cc:333] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.702160 21312 raft_consensus.cc:2243] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.703250 21312 raft_consensus.cc:2272] T 37f7afbd6bd14202b784bc4c24b71bd1 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.705734 21312 tablet_replica.cc:333] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.706316 21312 raft_consensus.cc:2243] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.706843 21312 raft_consensus.cc:2272] T f34810d0af154f329fec45e857a80d99 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.708918 21312 tablet_replica.cc:333] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.709496 21312 raft_consensus.cc:2243] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.710266 21312 raft_consensus.cc:2272] T 060ea2b150b444aab3e1430624fe2a3d P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.712193 21312 tablet_replica.cc:333] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.712775 21312 raft_consensus.cc:2243] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.713181 21312 raft_consensus.cc:2272] T 9547f10aff2e45b8b40cd1b4bddf42d5 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.715087 21312 tablet_replica.cc:333] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.715628 21312 raft_consensus.cc:2243] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.716361 21312 raft_consensus.cc:2272] T f4dc4bce7caf4a349b3ce695b2658707 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.718346 21312 tablet_replica.cc:333] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.718976 21312 raft_consensus.cc:2243] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.719386 21312 raft_consensus.cc:2272] T 2e0029999088407b9d71307a13c1599b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.721313 21312 tablet_replica.cc:333] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.721864 21312 raft_consensus.cc:2243] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.722575 21312 raft_consensus.cc:2272] T 0358f1bde5044224a2fb9711b1f990b6 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.724567 21312 tablet_replica.cc:333] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.725099 21312 raft_consensus.cc:2243] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.725514 21312 raft_consensus.cc:2272] T 41fcfba163a74ac1b6aa94f2022c252e P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.727313 21312 tablet_replica.cc:333] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.727845 21312 raft_consensus.cc:2243] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.728235 21312 raft_consensus.cc:2272] T 6ba5ec54e7c44d24bc7d08fb0e839618 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.730093 21312 tablet_replica.cc:333] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.730657 21312 raft_consensus.cc:2243] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.731416 21312 raft_consensus.cc:2272] T e014e29eece34924b34eaf88458e5ab4 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.733366 21312 tablet_replica.cc:333] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.733876 21312 raft_consensus.cc:2243] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.734253 21312 raft_consensus.cc:2272] T da7fd30052d142679c225954b5b5724b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.736037 21312 tablet_replica.cc:333] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.736613 21312 raft_consensus.cc:2243] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.737030 21312 raft_consensus.cc:2272] T 68bbc69d44e948e7b6f3a85ea80aec7e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.738768 21312 tablet_replica.cc:333] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.739301 21312 raft_consensus.cc:2243] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.739704 21312 raft_consensus.cc:2272] T 2c3b31ed6f204a71a8ac57ddbc19e662 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.741525 21312 tablet_replica.cc:333] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.742076 21312 raft_consensus.cc:2243] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.742466 21312 raft_consensus.cc:2272] T 88d9475e96d74d868e148f76bccfb047 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.744277 21312 tablet_replica.cc:333] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.744835 21312 raft_consensus.cc:2243] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.745219 21312 raft_consensus.cc:2272] T 37be0dd46a214f7d9eef969ee4d69966 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.746938 21312 tablet_replica.cc:333] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.747447 21312 raft_consensus.cc:2243] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.747844 21312 raft_consensus.cc:2272] T bde8f4a342f345cf90f76ba21b614c2b P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.749775 21312 tablet_replica.cc:333] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.750283 21312 raft_consensus.cc:2243] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.750676 21312 raft_consensus.cc:2272] T 6c946f5606ec4af895c04195b74db3e1 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.752436 21312 tablet_replica.cc:333] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.753024 21312 raft_consensus.cc:2243] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.753434 21312 raft_consensus.cc:2272] T 62a577314507499e84f3ce9f1f878ddd P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.755367 21312 tablet_replica.cc:333] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.755885 21312 raft_consensus.cc:2243] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.756667 21312 raft_consensus.cc:2272] T 3bd25378f6794f9ab52ee328577124e3 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.758443 21312 tablet_replica.cc:333] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.758963 21312 raft_consensus.cc:2243] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.759364 21312 raft_consensus.cc:2272] T 8a5fb10557dd4995ab650a239d1cde17 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.761163 21312 tablet_replica.cc:333] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.761672 21312 raft_consensus.cc:2243] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.762065 21312 raft_consensus.cc:2272] T 6714d660646441d58bea7a912cba0ec8 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.763855 21312 tablet_replica.cc:333] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.764361 21312 raft_consensus.cc:2243] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.765125 21312 raft_consensus.cc:2272] T d40c62440e604ddfb2e59ee713fbbb34 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.766955 21312 tablet_replica.cc:333] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.767459 21312 raft_consensus.cc:2243] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.767872 21312 raft_consensus.cc:2272] T 128ca54c3ca34865935113dc7a9f0d21 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.769783 21312 tablet_replica.cc:333] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.770285 21312 raft_consensus.cc:2243] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.770768 21312 raft_consensus.cc:2272] T a77eab9e557b46d8acc7483af6e6ad0d P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.773228 21312 tablet_replica.cc:333] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.773918 21312 raft_consensus.cc:2243] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.774380 21312 raft_consensus.cc:2272] T c413a0a088424cd884473468aa41ad3b P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.775187 28981 consensus_peers.cc:597] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 -> Peer 7640ddad6f82422c8a0377a187b4e290 (127.20.208.3:40509): Couldn't send request to peer 7640ddad6f82422c8a0377a187b4e290. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.3:40509: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.776372 21312 tablet_replica.cc:333] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.777045 21312 raft_consensus.cc:2243] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.777482 21312 raft_consensus.cc:2272] T 397ea1e4725643da8ae65abeabbabcd7 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.779383 21312 tablet_replica.cc:333] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.779906 21312 raft_consensus.cc:2243] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.780296 21312 raft_consensus.cc:2272] T fbf928a86b924440b6bfc966df8860b8 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.782222 21312 tablet_replica.cc:333] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.782709 21312 raft_consensus.cc:2243] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.783439 21312 raft_consensus.cc:2272] T d918ac438d8147cb8488b64ab616301e P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.785377 21312 tablet_replica.cc:333] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.785929 21312 raft_consensus.cc:2243] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.786371 21312 raft_consensus.cc:2272] T 1cb6c055b4c440bbb4cbecf2a32bf6e2 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.788396 21312 tablet_replica.cc:333] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.788971 21312 raft_consensus.cc:2243] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.789361 21312 raft_consensus.cc:2272] T 1918784f405b46fe85f940384b1e4520 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.791260 21312 tablet_replica.cc:333] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.791790 21312 raft_consensus.cc:2243] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.792562 21312 raft_consensus.cc:2272] T a0f5b8a34d8d42c7958b3e1a2423802c P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.794510 21312 tablet_replica.cc:333] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.795207 21312 raft_consensus.cc:2243] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.796059 21312 raft_consensus.cc:2272] T 45159667ba6f4b919ff80fa9d04e360e P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.798607 21312 tablet_replica.cc:333] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.799332 21312 raft_consensus.cc:2243] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.799875 21312 raft_consensus.cc:2272] T 8e6aa359b7334b7ab7b98c3a741e7402 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.801894 21312 tablet_replica.cc:333] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.802445 21312 raft_consensus.cc:2243] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.802850 21312 raft_consensus.cc:2272] T 845ec131ab0c46b49160d56a240504b7 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.804819 21312 tablet_replica.cc:333] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.805335 21312 raft_consensus.cc:2243] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.805740 21312 raft_consensus.cc:2272] T 14e2f6598cef41e581c126c2788da507 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.807793 21312 tablet_replica.cc:333] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.808344 21312 raft_consensus.cc:2243] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.808848 21312 raft_consensus.cc:2272] T 8996feb2bbcd43b4b8cef11d3cea4e91 P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.810917 21312 tablet_replica.cc:333] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.811467 21312 raft_consensus.cc:2243] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.811905 21312 raft_consensus.cc:2272] T b0d50209455e43a6b08ae3f9f45fc6fe P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.813841 21312 tablet_replica.cc:333] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.814344 21312 raft_consensus.cc:2243] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.814728 21312 raft_consensus.cc:2272] T 63e0aebb326f4409a072848dd5227247 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.816810 21312 tablet_replica.cc:333] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.817286 21312 raft_consensus.cc:2243] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.818008 21312 raft_consensus.cc:2272] T e897b01fbc7d44a2b2a24b592d256a55 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.819976 21312 tablet_replica.cc:333] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.820446 21312 raft_consensus.cc:2243] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.821267 21312 raft_consensus.cc:2272] T 72bfbcadacb1480fbedbd436808ea85b P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.822366 29975 raft_consensus.cc:493] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7f68815192fc48a58a67ddf2da3bac70)
I20260709 13:09:41.822836 29975 raft_consensus.cc:515] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d3a97b01f64816a2a769d159dd64d2" member_type: VOTER last_known_addr { host: "127.20.208.4" port: 46467 } } peers { permanent_uuid: "7f68815192fc48a58a67ddf2da3bac70" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 41969 } } peers { permanent_uuid: "89867186bb4546988c8fcd2b9fea8757" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 41345 } }
I20260709 13:09:41.823489 21312 tablet_replica.cc:333] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.824256 21312 raft_consensus.cc:2243] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.825045 29975 leader_election.cc:290] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969), 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345)
I20260709 13:09:41.825279 21312 raft_consensus.cc:2272] T e6d945783c31437981498fa3ba0887ff P f3d3a97b01f64816a2a769d159dd64d2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.828106 21312 tablet_replica.cc:333] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.828866 21312 raft_consensus.cc:2243] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.829869 21312 raft_consensus.cc:2272] T b3841cb2f1364534b341ed93ebd0f73f P f3d3a97b01f64816a2a769d159dd64d2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.830559 28981 leader_election.cc:336] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 89867186bb4546988c8fcd2b9fea8757 (127.20.208.2:41345): Network error: Client connection negotiation failed: client connection to 127.20.208.2:41345: connect: Connection refused (error 111)
W20260709 13:09:41.831097 28984 leader_election.cc:336] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7f68815192fc48a58a67ddf2da3bac70 (127.20.208.1:41969): Network error: Client connection negotiation failed: client connection to 127.20.208.1:41969: connect: Connection refused (error 111)
I20260709 13:09:41.831526 28984 leader_election.cc:304] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d3a97b01f64816a2a769d159dd64d2; no voters: 7f68815192fc48a58a67ddf2da3bac70, 89867186bb4546988c8fcd2b9fea8757
I20260709 13:09:41.832204 29975 raft_consensus.cc:2749] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:41.832417 21312 tablet_replica.cc:333] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.833105 21312 raft_consensus.cc:2243] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.833549 21312 raft_consensus.cc:2272] T c18d000a8ebe429caa1c1c23e30e8c46 P f3d3a97b01f64816a2a769d159dd64d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.835376 21312 tablet_replica.cc:333] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2: stopping tablet replica
I20260709 13:09:41.835837 21312 raft_consensus.cc:2243] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.836647 21312 raft_consensus.cc:2272] T 92c712a67162406ba7f28ef7f9b396b9 P f3d3a97b01f64816a2a769d159dd64d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.900988 21312 tablet_server.cc:196] TabletServer@127.20.208.4:0 shutdown complete.
I20260709 13:09:41.982290 21312 master.cc:562] Master@127.20.208.62:34427 shutting down...
I20260709 13:09:42.008973 21312 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.009593 21312 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.009958 21312 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3eefbda506844b11b82db1277d67c8e7: stopping tablet replica
I20260709 13:09:42.031277 21312 master.cc:584] Master@127.20.208.62:34427 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32989 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:09:42.111009 21312 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.208.62:34371
I20260709 13:09:42.112193 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:42.117995 29978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:42.117931 29977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:42.119058 29980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:42.119818 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:42.121099 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:42.121304 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:42.121448 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602582121433 us; error 0 us; skew 500 ppm
I20260709 13:09:42.122006 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:42.124506 21312 webserver.cc:533] Webserver started at http://127.20.208.62:33307/ using document root <none> and password file <none>
I20260709 13:09:42.125105 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:42.125296 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:42.125564 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:42.126703 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/master-0-root/instance:
uuid: "2d6475598b4f4ba6b1e669150718017f"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-6j4g"
I20260709 13:09:42.131316 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:09:42.134912 29985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.135787 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:09:42.136075 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/master-0-root
uuid: "2d6475598b4f4ba6b1e669150718017f"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-6j4g"
I20260709 13:09:42.136332 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:42.157419 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:42.158622 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:42.196015 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.62:34371
I20260709 13:09:42.196105 30036 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.62:34371 every 8 connection(s)
I20260709 13:09:42.200093 30037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.210873 30037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f: Bootstrap starting.
I20260709 13:09:42.215734 30037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.220132 30037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f: No bootstrap required, opened a new log
I20260709 13:09:42.222503 30037 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d6475598b4f4ba6b1e669150718017f" member_type: VOTER }
I20260709 13:09:42.222915 30037 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.223140 30037 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6475598b4f4ba6b1e669150718017f, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.223781 30037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d6475598b4f4ba6b1e669150718017f" member_type: VOTER }
I20260709 13:09:42.224229 30037 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:42.224440 30037 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:42.224720 30037 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.229363 30037 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d6475598b4f4ba6b1e669150718017f" member_type: VOTER }
I20260709 13:09:42.229904 30037 leader_election.cc:304] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d6475598b4f4ba6b1e669150718017f; no voters: 
I20260709 13:09:42.231045 30037 leader_election.cc:290] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:42.231448 30040 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.232795 30040 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 1 LEADER]: Becoming Leader. State: Replica: 2d6475598b4f4ba6b1e669150718017f, State: Running, Role: LEADER
I20260709 13:09:42.233479 30040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d6475598b4f4ba6b1e669150718017f" member_type: VOTER }
I20260709 13:09:42.233906 30037 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:42.238098 30042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d6475598b4f4ba6b1e669150718017f. Latest consensus state: current_term: 1 leader_uuid: "2d6475598b4f4ba6b1e669150718017f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d6475598b4f4ba6b1e669150718017f" member_type: VOTER } }
I20260709 13:09:42.238241 30041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d6475598b4f4ba6b1e669150718017f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d6475598b4f4ba6b1e669150718017f" member_type: VOTER } }
I20260709 13:09:42.238893 30042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:42.238981 30041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:42.243589 30047 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:42.248317 30047 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:42.250360 21312 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:42.257433 30047 catalog_manager.cc:1383] Generated new cluster ID: b43a4bac92cb4387ae3c7f42cba80ba4
I20260709 13:09:42.257757 30047 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:42.283850 30047 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:42.285234 30047 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:42.298105 30047 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f: Generated new TSK 0
I20260709 13:09:42.298779 30047 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:42.317162 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:42.323096 30058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:42.324410 30059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:42.326637 30061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:42.326670 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:42.327876 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:42.328065 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:42.328233 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602582328214 us; error 0 us; skew 500 ppm
I20260709 13:09:42.328855 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:42.331248 21312 webserver.cc:533] Webserver started at http://127.20.208.1:38393/ using document root <none> and password file <none>
I20260709 13:09:42.331768 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:42.331943 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:42.332223 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:42.333360 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-0-root/instance:
uuid: "3e952e3bfafb4f179ec3213c00d9f736"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-6j4g"
I20260709 13:09:42.338135 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:09:42.342005 30066 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.342779 21312 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:09:42.343079 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-0-root
uuid: "3e952e3bfafb4f179ec3213c00d9f736"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-6j4g"
I20260709 13:09:42.343364 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:42.354338 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:42.355584 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:42.357100 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:42.359408 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:42.359611 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.359849 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:42.360018 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.399838 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.1:36063
I20260709 13:09:42.399943 30128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.1:36063 every 8 connection(s)
I20260709 13:09:42.404834 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:42.412240 30133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:42.414014 30134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:42.415723 30137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:42.416463 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:42.417689 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:42.417892 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:42.418066 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602582418048 us; error 0 us; skew 500 ppm
I20260709 13:09:42.418242 30129 heartbeater.cc:344] Connected to a master server at 127.20.208.62:34371
I20260709 13:09:42.418624 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:42.418648 30129 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:42.419627 30129 heartbeater.cc:507] Master 127.20.208.62:34371 requested a full tablet report, sending...
I20260709 13:09:42.421458 21312 webserver.cc:533] Webserver started at http://127.20.208.2:36051/ using document root <none> and password file <none>
I20260709 13:09:42.421630 30002 ts_manager.cc:194] Registered new tserver with Master: 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063)
I20260709 13:09:42.422065 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:42.422343 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:42.422605 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:42.423575 30002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44680
I20260709 13:09:42.423657 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-1-root/instance:
uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-6j4g"
I20260709 13:09:42.428100 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:42.431346 30141 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.432050 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:42.432340 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-1-root
uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-6j4g"
I20260709 13:09:42.432629 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:42.453087 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:42.454298 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:42.455770 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:42.458045 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:42.458225 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.458472 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:42.458616 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.497555 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.2:42737
I20260709 13:09:42.497648 30203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.2:42737 every 8 connection(s)
I20260709 13:09:42.502339 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:42.509532 30207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:42.509972 30208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:42.512724 21312 server_base.cc:1061] running on GCE node
W20260709 13:09:42.512837 30210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:42.514128 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:42.514406 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:42.514581 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602582514565 us; error 0 us; skew 500 ppm
I20260709 13:09:42.515095 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:42.515439 30204 heartbeater.cc:344] Connected to a master server at 127.20.208.62:34371
I20260709 13:09:42.515857 30204 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:42.516644 30204 heartbeater.cc:507] Master 127.20.208.62:34371 requested a full tablet report, sending...
I20260709 13:09:42.517884 21312 webserver.cc:533] Webserver started at http://127.20.208.3:39325/ using document root <none> and password file <none>
I20260709 13:09:42.518465 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:42.518633 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:42.518558 30002 ts_manager.cc:194] Registered new tserver with Master: 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:42.519083 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:42.520112 30002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44694
I20260709 13:09:42.520217 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-2-root/instance:
uuid: "d675d04b3c92496ca7f778728bc4b85a"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-6j4g"
I20260709 13:09:42.524852 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:09:42.528205 30215 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.528993 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:42.529579 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-2-root
uuid: "d675d04b3c92496ca7f778728bc4b85a"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-6j4g"
I20260709 13:09:42.529996 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:42.559867 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:42.561131 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:42.562575 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:42.564852 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:42.565056 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.565286 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:42.565438 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.605114 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.3:34759
I20260709 13:09:42.605238 30277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.3:34759 every 8 connection(s)
I20260709 13:09:42.620272 30278 heartbeater.cc:344] Connected to a master server at 127.20.208.62:34371
I20260709 13:09:42.620756 30278 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:42.621493 30278 heartbeater.cc:507] Master 127.20.208.62:34371 requested a full tablet report, sending...
I20260709 13:09:42.623541 30002 ts_manager.cc:194] Registered new tserver with Master: d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:42.624220 21312 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015960975s
I20260709 13:09:42.624975 30002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44700
I20260709 13:09:42.650118 30002 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44704:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:42.653026 30002 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:42.723973 30169 tablet_service.cc:1511] Processing CreateTablet for tablet df00809a619241208b85bf7cb206ef0f (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:42.725567 30169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df00809a619241208b85bf7cb206ef0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.725625 30243 tablet_service.cc:1511] Processing CreateTablet for tablet df00809a619241208b85bf7cb206ef0f (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:42.727185 30243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df00809a619241208b85bf7cb206ef0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.727284 30168 tablet_service.cc:1511] Processing CreateTablet for tablet 3df95d7fddc24f3bb31f5ccaa560ee17 (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:42.728751 30168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df95d7fddc24f3bb31f5ccaa560ee17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.732368 30242 tablet_service.cc:1511] Processing CreateTablet for tablet 3df95d7fddc24f3bb31f5ccaa560ee17 (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:42.733892 30242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df95d7fddc24f3bb31f5ccaa560ee17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.738049 30167 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0ef3f56c17410c979f8cb00e6b801f (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:42.739543 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0ef3f56c17410c979f8cb00e6b801f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.742149 30241 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0ef3f56c17410c979f8cb00e6b801f (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:42.743647 30241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0ef3f56c17410c979f8cb00e6b801f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.746184 30166 tablet_service.cc:1511] Processing CreateTablet for tablet de48d8999657458bb81a7ab04f5c271d (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:42.747663 30166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de48d8999657458bb81a7ab04f5c271d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.748200 30240 tablet_service.cc:1511] Processing CreateTablet for tablet de48d8999657458bb81a7ab04f5c271d (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:42.749873 30240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de48d8999657458bb81a7ab04f5c271d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.754653 30239 tablet_service.cc:1511] Processing CreateTablet for tablet 81a962f1eec84814884e1fcbf4887fdc (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:42.756449 30239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a962f1eec84814884e1fcbf4887fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.769026 30165 tablet_service.cc:1511] Processing CreateTablet for tablet 7e671ab9b63344f1b72f6c57ac2bea6c (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:42.770663 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e671ab9b63344f1b72f6c57ac2bea6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.793504 30167 tablet_service.cc:1511] Processing CreateTablet for tablet 81a962f1eec84814884e1fcbf4887fdc (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:42.795230 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a962f1eec84814884e1fcbf4887fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.797621 30293 tablet_bootstrap.cc:492] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf: Bootstrap starting.
I20260709 13:09:42.798777 30238 tablet_service.cc:1511] Processing CreateTablet for tablet 7e671ab9b63344f1b72f6c57ac2bea6c (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:42.799465 30089 tablet_service.cc:1511] Processing CreateTablet for tablet 7e671ab9b63344f1b72f6c57ac2bea6c (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:42.799595 30094 tablet_service.cc:1511] Processing CreateTablet for tablet df00809a619241208b85bf7cb206ef0f (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:42.799093 30090 tablet_service.cc:1511] Processing CreateTablet for tablet 81a962f1eec84814884e1fcbf4887fdc (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:42.800750 30089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e671ab9b63344f1b72f6c57ac2bea6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.801367 30238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e671ab9b63344f1b72f6c57ac2bea6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.803964 30092 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0ef3f56c17410c979f8cb00e6b801f (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:42.804873 30090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a962f1eec84814884e1fcbf4887fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.805588 30092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0ef3f56c17410c979f8cb00e6b801f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.806166 30091 tablet_service.cc:1511] Processing CreateTablet for tablet de48d8999657458bb81a7ab04f5c271d (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:42.807536 30091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de48d8999657458bb81a7ab04f5c271d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.809535 30093 tablet_service.cc:1511] Processing CreateTablet for tablet 3df95d7fddc24f3bb31f5ccaa560ee17 (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:42.811033 30093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df95d7fddc24f3bb31f5ccaa560ee17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.813048 30094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df00809a619241208b85bf7cb206ef0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.821188 30088 tablet_service.cc:1511] Processing CreateTablet for tablet a0046502fb2d447cb56e0a090a87f3ba (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:42.822714 30088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0046502fb2d447cb56e0a090a87f3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.863704 30237 tablet_service.cc:1511] Processing CreateTablet for tablet a0046502fb2d447cb56e0a090a87f3ba (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:42.865489 30237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0046502fb2d447cb56e0a090a87f3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.877204 30165 tablet_service.cc:1511] Processing CreateTablet for tablet a0046502fb2d447cb56e0a090a87f3ba (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:42.878749 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0046502fb2d447cb56e0a090a87f3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.880640 30087 tablet_service.cc:1511] Processing CreateTablet for tablet 201a29d1ac264ecd816977549d0040b7 (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:42.883004 30166 tablet_service.cc:1511] Processing CreateTablet for tablet 201a29d1ac264ecd816977549d0040b7 (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:42.885402 30087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 201a29d1ac264ecd816977549d0040b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.883813 30293 tablet_bootstrap.cc:654] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.902117 30166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 201a29d1ac264ecd816977549d0040b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.911356 30295 tablet_bootstrap.cc:492] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:42.921617 30294 tablet_bootstrap.cc:492] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a: Bootstrap starting.
I20260709 13:09:42.926792 30294 tablet_bootstrap.cc:654] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.934571 30295 tablet_bootstrap.cc:654] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.940784 30239 tablet_service.cc:1511] Processing CreateTablet for tablet 201a29d1ac264ecd816977549d0040b7 (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:42.942407 30239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 201a29d1ac264ecd816977549d0040b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.957485 30087 tablet_service.cc:1511] Processing CreateTablet for tablet 289995462eb44ec2b6580123b389ed3c (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:42.958930 30087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289995462eb44ec2b6580123b389ed3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.965405 30167 tablet_service.cc:1511] Processing CreateTablet for tablet 289995462eb44ec2b6580123b389ed3c (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:42.967068 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289995462eb44ec2b6580123b389ed3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.967598 30238 tablet_service.cc:1511] Processing CreateTablet for tablet 289995462eb44ec2b6580123b389ed3c (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:42.969041 30238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289995462eb44ec2b6580123b389ed3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.970455 30089 tablet_service.cc:1511] Processing CreateTablet for tablet c89d407dd7214765b5cdb203b3ff2942 (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:42.971836 30089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d407dd7214765b5cdb203b3ff2942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.979595 30165 tablet_service.cc:1511] Processing CreateTablet for tablet c89d407dd7214765b5cdb203b3ff2942 (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:42.981189 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d407dd7214765b5cdb203b3ff2942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.982497 30294 tablet_bootstrap.cc:492] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a: No bootstrap required, opened a new log
I20260709 13:09:42.983091 30294 ts_tablet_manager.cc:1403] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a: Time spent bootstrapping tablet: real 0.062s	user 0.024s	sys 0.010s
I20260709 13:09:42.985590 30237 tablet_service.cc:1511] Processing CreateTablet for tablet c89d407dd7214765b5cdb203b3ff2942 (DEFAULT_TABLE table=test-workload [id=8b6be2b40a764f7eb706342a47bf3caf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:42.986688 30293 tablet_bootstrap.cc:492] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf: No bootstrap required, opened a new log
I20260709 13:09:42.987069 30237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d407dd7214765b5cdb203b3ff2942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.986279 30294 raft_consensus.cc:359] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:42.987543 30294 raft_consensus.cc:385] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.987876 30294 raft_consensus.cc:740] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.988818 30294 consensus_queue.cc:260] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:42.989491 30295 tablet_bootstrap.cc:492] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: No bootstrap required, opened a new log
I20260709 13:09:42.987277 30293 ts_tablet_manager.cc:1403] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent bootstrapping tablet: real 0.190s	user 0.023s	sys 0.010s
I20260709 13:09:42.990166 30295 ts_tablet_manager.cc:1403] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.022s
I20260709 13:09:42.993187 30293 raft_consensus.cc:359] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:42.994041 30293 raft_consensus.cc:385] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.994349 30293 raft_consensus.cc:740] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.995146 30293 consensus_queue.cc:260] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:42.995193 30295 raft_consensus.cc:359] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:42.998131 30295 raft_consensus.cc:385] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.998446 30295 raft_consensus.cc:740] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.999253 30295 consensus_queue.cc:260] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:43.001685 30204 heartbeater.cc:499] Master 127.20.208.62:34371 was elected leader, sending a full tablet report...
I20260709 13:09:43.002085 30293 ts_tablet_manager.cc:1434] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:09:43.003145 30293 tablet_bootstrap.cc:492] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf: Bootstrap starting.
W20260709 13:09:43.001971 30205 tablet.cc:2406] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:43.008690 30278 heartbeater.cc:499] Master 127.20.208.62:34371 was elected leader, sending a full tablet report...
I20260709 13:09:43.020324 30294 ts_tablet_manager.cc:1434] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.002s
I20260709 13:09:43.021665 30294 tablet_bootstrap.cc:492] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a: Bootstrap starting.
I20260709 13:09:43.031575 30129 heartbeater.cc:499] Master 127.20.208.62:34371 was elected leader, sending a full tablet report...
I20260709 13:09:43.032635 30293 tablet_bootstrap.cc:654] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.036948 30294 tablet_bootstrap.cc:654] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.041182 30295 ts_tablet_manager.cc:1434] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.012s
I20260709 13:09:43.042549 30295 tablet_bootstrap.cc:492] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:43.049525 30295 tablet_bootstrap.cc:654] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.059353 30295 tablet_bootstrap.cc:492] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: No bootstrap required, opened a new log
I20260709 13:09:43.060000 30295 ts_tablet_manager.cc:1403] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.008s
I20260709 13:09:43.059376 30293 tablet_bootstrap.cc:492] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf: No bootstrap required, opened a new log
I20260709 13:09:43.063175 30295 raft_consensus.cc:359] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.063621 30293 ts_tablet_manager.cc:1403] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.009s
I20260709 13:09:43.063958 30295 raft_consensus.cc:385] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.064289 30295 raft_consensus.cc:740] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.065243 30295 consensus_queue.cc:260] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.067139 30293 raft_consensus.cc:359] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.067691 30295 ts_tablet_manager.cc:1434] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:43.068110 30293 raft_consensus.cc:385] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.068516 30293 raft_consensus.cc:740] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.068928 30295 tablet_bootstrap.cc:492] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:43.069558 30293 consensus_queue.cc:260] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.072153 30293 ts_tablet_manager.cc:1434] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:43.073256 30293 tablet_bootstrap.cc:492] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf: Bootstrap starting.
I20260709 13:09:43.077972 30295 tablet_bootstrap.cc:654] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.080657 30293 tablet_bootstrap.cc:654] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.090641 30295 tablet_bootstrap.cc:492] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: No bootstrap required, opened a new log
I20260709 13:09:43.091284 30295 ts_tablet_manager.cc:1403] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260709 13:09:43.093520 30293 tablet_bootstrap.cc:492] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf: No bootstrap required, opened a new log
I20260709 13:09:43.093875 30295 raft_consensus.cc:359] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.094527 30295 raft_consensus.cc:385] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.094779 30295 raft_consensus.cc:740] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.095436 30295 consensus_queue.cc:260] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.096827 30294 tablet_bootstrap.cc:492] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a: No bootstrap required, opened a new log
I20260709 13:09:43.097280 30294 ts_tablet_manager.cc:1403] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.040s
I20260709 13:09:43.097390 30295 ts_tablet_manager.cc:1434] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:09:43.098394 30295 tablet_bootstrap.cc:492] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:43.094141 30293 ts_tablet_manager.cc:1403] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 13:09:43.099855 30294 raft_consensus.cc:359] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.100757 30294 raft_consensus.cc:385] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.101085 30294 raft_consensus.cc:740] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.101917 30294 consensus_queue.cc:260] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.103175 30293 raft_consensus.cc:359] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.103681 30294 ts_tablet_manager.cc:1434] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:43.103997 30293 raft_consensus.cc:385] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.104351 30293 raft_consensus.cc:740] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.104737 30294 tablet_bootstrap.cc:492] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a: Bootstrap starting.
I20260709 13:09:43.105147 30293 consensus_queue.cc:260] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.107380 30293 ts_tablet_manager.cc:1434] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:09:43.108436 30293 tablet_bootstrap.cc:492] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf: Bootstrap starting.
I20260709 13:09:43.108784 30299 raft_consensus.cc:493] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.109380 30299 raft_consensus.cc:515] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.111686 30294 tablet_bootstrap.cc:654] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.117259 30295 tablet_bootstrap.cc:654] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.118078 30300 raft_consensus.cc:493] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.118664 30300 raft_consensus.cc:515] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:43.121332 30293 tablet_bootstrap.cc:654] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.125662 30299 leader_election.cc:290] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:43.128328 30294 tablet_bootstrap.cc:492] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a: No bootstrap required, opened a new log
I20260709 13:09:43.129396 30293 tablet_bootstrap.cc:492] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf: No bootstrap required, opened a new log
I20260709 13:09:43.129457 30294 ts_tablet_manager.cc:1403] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.014s
I20260709 13:09:43.130095 30293 ts_tablet_manager.cc:1403] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.003s
I20260709 13:09:43.130295 30295 tablet_bootstrap.cc:492] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: No bootstrap required, opened a new log
I20260709 13:09:43.130857 30295 ts_tablet_manager.cc:1403] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 13:09:43.132992 30294 raft_consensus.cc:359] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.133266 30293 raft_consensus.cc:359] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.134011 30293 raft_consensus.cc:385] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.133841 30295 raft_consensus.cc:359] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.134449 30293 raft_consensus.cc:740] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.134939 30295 raft_consensus.cc:385] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.135259 30295 raft_consensus.cc:740] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.133848 30294 raft_consensus.cc:385] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.136042 30294 raft_consensus.cc:740] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.135542 30293 consensus_queue.cc:260] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.136860 30294 consensus_queue.cc:260] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.139395 30294 ts_tablet_manager.cc:1434] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:43.140396 30300 leader_election.cc:290] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759), 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063)
I20260709 13:09:43.159662 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" is_pre_election: true
I20260709 13:09:43.160552 30179 raft_consensus.cc:2468] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 0.
I20260709 13:09:43.162210 30219 leader_election.cc:304] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:43.162374 30294 tablet_bootstrap.cc:492] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a: Bootstrap starting.
I20260709 13:09:43.150058 30300 raft_consensus.cc:493] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.164585 30295 consensus_queue.cc:260] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.165338 30299 raft_consensus.cc:2804] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.167187 30300 raft_consensus.cc:515] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.171108 30293 ts_tablet_manager.cc:1434] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent starting tablet: real 0.041s	user 0.032s	sys 0.008s
I20260709 13:09:43.172380 30293 tablet_bootstrap.cc:492] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf: Bootstrap starting.
I20260709 13:09:43.173242 30295 ts_tablet_manager.cc:1434] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 13:09:43.174397 30295 tablet_bootstrap.cc:492] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:43.178920 30293 tablet_bootstrap.cc:654] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.179931 30294 tablet_bootstrap.cc:654] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.169178 30299 raft_consensus.cc:493] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.180685 30299 raft_consensus.cc:3060] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.187614 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736" is_pre_election: true
I20260709 13:09:43.189121 30295 tablet_bootstrap.cc:654] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.189265 30300 leader_election.cc:290] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.205557 30299 raft_consensus.cc:515] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.206553 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736" is_pre_election: true
I20260709 13:09:43.206866 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736" is_pre_election: true
I20260709 13:09:43.207329 30104 raft_consensus.cc:2468] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 0.
W20260709 13:09:43.208451 30145 leader_election.cc:343] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.209358 30145 leader_election.cc:304] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:43.210129 30293 tablet_bootstrap.cc:492] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf: No bootstrap required, opened a new log
I20260709 13:09:43.208787 30295 tablet_bootstrap.cc:492] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: No bootstrap required, opened a new log
I20260709 13:09:43.210815 30293 ts_tablet_manager.cc:1403] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.018s
I20260709 13:09:43.210964 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.211230 30300 raft_consensus.cc:2804] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.211686 30300 raft_consensus.cc:493] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.212095 30300 raft_consensus.cc:3060] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:43.212621 30144 leader_election.cc:343] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.210924 30295 ts_tablet_manager.cc:1403] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
W20260709 13:09:43.212561 30219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.2:42737, user_credentials={real_user=slave}} blocked reactor thread for 50594.8us
I20260709 13:09:43.214720 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
W20260709 13:09:43.215571 30219 leader_election.cc:343] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.210585 30253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.215003 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:43.216255 30295 raft_consensus.cc:359] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.216849 30253 raft_consensus.cc:2468] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 0.
I20260709 13:09:43.213337 30144 leader_election.cc:304] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:43.217146 30179 raft_consensus.cc:3060] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.217156 30295 raft_consensus.cc:385] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.218099 30312 raft_consensus.cc:2749] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:43.216912 30219 leader_election.cc:343] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.218994 30295 raft_consensus.cc:740] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.219823 30295 consensus_queue.cc:260] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.222344 30300 raft_consensus.cc:515] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:43.223359 30295 ts_tablet_manager.cc:1434] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:43.207899 30299 leader_election.cc:290] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:43.224612 30295 tablet_bootstrap.cc:492] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:43.225338 30179 raft_consensus.cc:2468] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 1.
I20260709 13:09:43.214994 30293 raft_consensus.cc:359] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.226944 30293 raft_consensus.cc:385] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.227032 30253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:43.227306 30293 raft_consensus.cc:740] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.227681 30253 raft_consensus.cc:3060] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.228219 30293 consensus_queue.cc:260] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.230618 30293 ts_tablet_manager.cc:1434] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:09:43.231632 30293 tablet_bootstrap.cc:492] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf: Bootstrap starting.
I20260709 13:09:43.231616 30219 leader_election.cc:304] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 3e952e3bfafb4f179ec3213c00d9f736
I20260709 13:09:43.235930 30295 tablet_bootstrap.cc:654] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.237051 30253 raft_consensus.cc:2468] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 1.
I20260709 13:09:43.238551 30144 leader_election.cc:304] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:43.238799 30293 tablet_bootstrap.cc:654] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.239408 30312 raft_consensus.cc:2804] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:43.246969 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:43.249171 30299 raft_consensus.cc:2804] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.249953 30299 raft_consensus.cc:697] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:43.251087 30299 consensus_queue.cc:237] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.252589 30312 raft_consensus.cc:697] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:43.253785 30312 consensus_queue.cc:237] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:43.259095 30294 tablet_bootstrap.cc:492] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a: No bootstrap required, opened a new log
I20260709 13:09:43.259752 30294 ts_tablet_manager.cc:1403] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a: Time spent bootstrapping tablet: real 0.108s	user 0.009s	sys 0.002s
I20260709 13:09:43.260012 30295 tablet_bootstrap.cc:492] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: No bootstrap required, opened a new log
I20260709 13:09:43.260571 30295 ts_tablet_manager.cc:1403] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.011s
I20260709 13:09:43.261319 30293 tablet_bootstrap.cc:492] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf: No bootstrap required, opened a new log
I20260709 13:09:43.261912 30293 ts_tablet_manager.cc:1403] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.014s
I20260709 13:09:43.262991 30295 raft_consensus.cc:359] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.263753 30295 raft_consensus.cc:385] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.263988 30295 raft_consensus.cc:740] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.264652 30295 consensus_queue.cc:260] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.264876 30293 raft_consensus.cc:359] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.265673 30293 raft_consensus.cc:385] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.265966 30293 raft_consensus.cc:740] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.266196 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:43.266798 30104 raft_consensus.cc:3060] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.266827 30293 consensus_queue.cc:260] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.266712 30295 ts_tablet_manager.cc:1434] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:09:43.269858 30293 ts_tablet_manager.cc:1434] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:43.270583 30295 tablet_bootstrap.cc:492] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:43.270998 30293 tablet_bootstrap.cc:492] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf: Bootstrap starting.
I20260709 13:09:43.278015 30104 raft_consensus.cc:2468] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 1.
I20260709 13:09:43.278285 30293 tablet_bootstrap.cc:654] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.279121 30295 tablet_bootstrap.cc:654] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.279696 30300 leader_election.cc:290] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Requested vote from peers d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759), 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063)
I20260709 13:09:43.284435 30295 tablet_bootstrap.cc:492] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: No bootstrap required, opened a new log
I20260709 13:09:43.285233 30295 ts_tablet_manager.cc:1403] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 13:09:43.262961 30294 raft_consensus.cc:359] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.288582 30294 raft_consensus.cc:385] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.289319 30294 raft_consensus.cc:740] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.288604 30295 raft_consensus.cc:359] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.288291 30000 catalog_manager.cc:5697] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 1 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.289837 30295 raft_consensus.cc:385] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.290302 30295 raft_consensus.cc:740] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.290439 30293 tablet_bootstrap.cc:492] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf: No bootstrap required, opened a new log
I20260709 13:09:43.290369 30294 consensus_queue.cc:260] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.291170 30293 ts_tablet_manager.cc:1403] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.006s
I20260709 13:09:43.291226 30295 consensus_queue.cc:260] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.292261 30301 raft_consensus.cc:493] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.292830 30301 raft_consensus.cc:515] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.293242 30294 ts_tablet_manager.cc:1434] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 13:09:43.294407 30294 tablet_bootstrap.cc:492] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a: Bootstrap starting.
I20260709 13:09:43.294440 30293 raft_consensus.cc:359] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.295251 30293 raft_consensus.cc:385] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.295543 30293 raft_consensus.cc:740] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.296389 30293 consensus_queue.cc:260] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.300688 30295 ts_tablet_manager.cc:1434] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:09:43.300712 30293 ts_tablet_manager.cc:1434] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:09:43.302158 30293 tablet_bootstrap.cc:492] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf: Bootstrap starting.
I20260709 13:09:43.304814 30295 tablet_bootstrap.cc:492] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:43.305500 30294 tablet_bootstrap.cc:654] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.306510 30301 leader_election.cc:290] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.308847 30293 tablet_bootstrap.cc:654] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.313270 30295 tablet_bootstrap.cc:654] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.319787 30315 raft_consensus.cc:493] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.320546 30315 raft_consensus.cc:515] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.325764 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" is_pre_election: true
I20260709 13:09:43.326691 30179 raft_consensus.cc:2468] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 0.
I20260709 13:09:43.328368 30219 leader_election.cc:304] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:43.329910 30315 leader_election.cc:290] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:43.330677 30315 raft_consensus.cc:2804] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.331113 30315 raft_consensus.cc:493] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.331595 30315 raft_consensus.cc:3060] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.354846 30315 raft_consensus.cc:515] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.357432 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736" is_pre_election: true
I20260709 13:09:43.358408 30104 raft_consensus.cc:2468] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 0.
I20260709 13:09:43.363703 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:43.364495 30104 raft_consensus.cc:3060] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.366422 30294 tablet_bootstrap.cc:492] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a: No bootstrap required, opened a new log
I20260709 13:09:43.367208 30294 ts_tablet_manager.cc:1403] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.007s
I20260709 13:09:43.370656 30294 raft_consensus.cc:359] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.371620 30294 raft_consensus.cc:385] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.389562 30253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.373703 30312 raft_consensus.cc:493] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.390705 30253 raft_consensus.cc:2393] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e952e3bfafb4f179ec3213c00d9f736 in current term 1: Already voted for candidate d675d04b3c92496ca7f778728bc4b85a in this term.
I20260709 13:09:43.376407 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:43.380272 30315 leader_election.cc:290] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:43.391039 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" is_pre_election: true
I20260709 13:09:43.391412 30179 raft_consensus.cc:3060] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.390622 30295 tablet_bootstrap.cc:492] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: No bootstrap required, opened a new log
I20260709 13:09:43.392992 30295 ts_tablet_manager.cc:1403] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.017s
I20260709 13:09:43.383286 30000 catalog_manager.cc:5697] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 0 to 1, leader changed from <none> to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 1 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.389864 30294 raft_consensus.cc:740] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.382707 30293 tablet_bootstrap.cc:492] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf: No bootstrap required, opened a new log
I20260709 13:09:43.394392 30293 ts_tablet_manager.cc:1403] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent bootstrapping tablet: real 0.092s	user 0.036s	sys 0.042s
I20260709 13:09:43.390991 30312 raft_consensus.cc:515] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.396628 30295 raft_consensus.cc:359] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.397644 30295 raft_consensus.cc:385] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.398010 30295 raft_consensus.cc:740] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.398267 30293 raft_consensus.cc:359] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.399606 30294 consensus_queue.cc:260] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.400293 30293 raft_consensus.cc:385] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.400507 30300 raft_consensus.cc:493] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.399062 30295 consensus_queue.cc:260] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.373564 30104 raft_consensus.cc:2468] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 1.
I20260709 13:09:43.401417 30312 leader_election.cc:290] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.403251 30069 leader_election.cc:304] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736; no voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:43.403286 30253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e671ab9b63344f1b72f6c57ac2bea6c" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.401727 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e671ab9b63344f1b72f6c57ac2bea6c" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736" is_pre_election: true
I20260709 13:09:43.419082 30253 raft_consensus.cc:2468] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 0.
I20260709 13:09:43.419245 30103 raft_consensus.cc:2468] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 0.
I20260709 13:09:43.420728 30145 leader_election.cc:304] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:43.417559 30300 raft_consensus.cc:515] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.421973 30301 raft_consensus.cc:2749] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.422277 30312 raft_consensus.cc:2804] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.423261 30312 raft_consensus.cc:493] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.423846 30312 raft_consensus.cc:3060] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.400863 30293 raft_consensus.cc:740] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.411177 30179 raft_consensus.cc:2468] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 1.
I20260709 13:09:43.425505 30300 leader_election.cc:290] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.425968 30293 consensus_queue.cc:260] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.421586 30295 ts_tablet_manager.cc:1434] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:09:43.429548 30295 tablet_bootstrap.cc:492] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:43.430377 30294 ts_tablet_manager.cc:1434] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a: Time spent starting tablet: real 0.063s	user 0.013s	sys 0.000s
I20260709 13:09:43.425263 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736" is_pre_election: true
I20260709 13:09:43.432066 30253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.432677 30103 raft_consensus.cc:2468] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 0.
W20260709 13:09:43.435182 30144 leader_election.cc:343] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.435496 30293 ts_tablet_manager.cc:1434] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:09:43.436628 30219 leader_election.cc:304] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:43.440864 30315 raft_consensus.cc:2804] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.437556 30295 tablet_bootstrap.cc:654] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.441390 30315 raft_consensus.cc:697] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:43.442286 30301 raft_consensus.cc:493] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.442221 30315 consensus_queue.cc:237] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.442813 30301 raft_consensus.cc:515] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.443975 30293 tablet_bootstrap.cc:492] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf: Bootstrap starting.
I20260709 13:09:43.451627 30301 leader_election.cc:290] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.453744 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" is_pre_election: true
I20260709 13:09:43.454718 30179 raft_consensus.cc:2393] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e952e3bfafb4f179ec3213c00d9f736 in current term 1: Already voted for candidate d675d04b3c92496ca7f778728bc4b85a in this term.
I20260709 13:09:43.454501 30145 leader_election.cc:304] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:43.432006 30294 tablet_bootstrap.cc:492] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a: Bootstrap starting.
I20260709 13:09:43.456648 30300 raft_consensus.cc:2804] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.457067 30300 raft_consensus.cc:493] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.457427 30300 raft_consensus.cc:3060] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.460626 30253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.462450 30069 leader_election.cc:304] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736; no voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:43.463807 30301 raft_consensus.cc:3060] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.465102 30294 tablet_bootstrap.cc:654] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.457434 30293 tablet_bootstrap.cc:654] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.466337 30002 catalog_manager.cc:5697] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 0 to 1, leader changed from <none> to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 1 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.460610 30295 tablet_bootstrap.cc:492] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: No bootstrap required, opened a new log
I20260709 13:09:43.468933 30295 ts_tablet_manager.cc:1403] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.006s
I20260709 13:09:43.471879 30295 raft_consensus.cc:359] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.472620 30295 raft_consensus.cc:385] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.472915 30295 raft_consensus.cc:740] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.472769 30301 raft_consensus.cc:2749] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.473856 30295 consensus_queue.cc:260] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.476061 30295 ts_tablet_manager.cc:1434] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:09:43.438829 30312 raft_consensus.cc:515] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.478917 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e671ab9b63344f1b72f6c57ac2bea6c" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:43.479211 30301 raft_consensus.cc:493] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.479564 30295 tablet_bootstrap.cc:492] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:43.479812 30301 raft_consensus.cc:515] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.480816 30253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e671ab9b63344f1b72f6c57ac2bea6c" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:43.481472 30253 raft_consensus.cc:3060] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.483750 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
W20260709 13:09:43.485349 30069 leader_election.cc:343] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.487105 30301 leader_election.cc:290] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.487619 30293 tablet_bootstrap.cc:492] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf: No bootstrap required, opened a new log
I20260709 13:09:43.479563 30103 raft_consensus.cc:3060] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.489814 30295 tablet_bootstrap.cc:654] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.491988 30300 raft_consensus.cc:515] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.493832 30293 ts_tablet_manager.cc:1403] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.006s
I20260709 13:09:43.494663 30300 leader_election.cc:290] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.495615 30301 raft_consensus.cc:493] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.495687 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" is_pre_election: true
I20260709 13:09:43.496529 30301 raft_consensus.cc:515] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.496770 30179 raft_consensus.cc:2468] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e952e3bfafb4f179ec3213c00d9f736 in term 0.
I20260709 13:09:43.498502 30103 raft_consensus.cc:2468] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 1.
I20260709 13:09:43.499027 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:43.495615 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:43.499841 30253 raft_consensus.cc:2468] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 1.
I20260709 13:09:43.500087 30104 raft_consensus.cc:3060] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.499977 30251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.500903 30251 raft_consensus.cc:2468] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e952e3bfafb4f179ec3213c00d9f736 in term 0.
I20260709 13:09:43.500365 30312 leader_election.cc:290] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.502198 30070 leader_election.cc:304] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:43.502763 30069 leader_election.cc:304] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:43.504077 30312 raft_consensus.cc:493] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.504626 30312 raft_consensus.cc:515] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.505585 30294 tablet_bootstrap.cc:492] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a: No bootstrap required, opened a new log
I20260709 13:09:43.506197 30294 ts_tablet_manager.cc:1403] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.001s
I20260709 13:09:43.506887 30312 leader_election.cc:290] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.500571 30145 leader_election.cc:304] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:43.508867 30104 raft_consensus.cc:2468] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 1.
I20260709 13:09:43.509420 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736" is_pre_election: true
I20260709 13:09:43.510150 30103 raft_consensus.cc:2468] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 0.
I20260709 13:09:43.510730 30295 tablet_bootstrap.cc:492] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: No bootstrap required, opened a new log
I20260709 13:09:43.511193 30295 ts_tablet_manager.cc:1403] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.004s
I20260709 13:09:43.511329 30145 leader_election.cc:304] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:43.511703 30312 raft_consensus.cc:2804] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.503816 30326 raft_consensus.cc:2804] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.512339 30300 raft_consensus.cc:2804] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.512879 30326 raft_consensus.cc:493] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.512295 30312 raft_consensus.cc:697] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:43.513180 30300 raft_consensus.cc:697] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:43.514400 30300 consensus_queue.cc:237] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.513336 30326 raft_consensus.cc:3060] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:43.515097 30144 leader_election.cc:343] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.502238 30301 leader_election.cc:290] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.516872 30301 raft_consensus.cc:2804] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.517277 30301 raft_consensus.cc:493] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.517666 30301 raft_consensus.cc:3060] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.518654 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" is_pre_election: true
I20260709 13:09:43.518788 30145 leader_election.cc:304] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:43.519397 30179 raft_consensus.cc:2468] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e952e3bfafb4f179ec3213c00d9f736 in term 0.
I20260709 13:09:43.515969 30295 raft_consensus.cc:359] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.515028 30251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.520113 30295 raft_consensus.cc:385] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.520081 30320 raft_consensus.cc:2804] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.521270 30320 raft_consensus.cc:493] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.521073 30295 raft_consensus.cc:740] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.503736 30293 raft_consensus.cc:359] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.521623 30320 raft_consensus.cc:3060] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.528796 30293 raft_consensus.cc:385] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.529219 30293 raft_consensus.cc:740] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.530189 30293 consensus_queue.cc:260] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.534027 30326 raft_consensus.cc:515] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.534770 30293 ts_tablet_manager.cc:1434] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.004s
I20260709 13:09:43.536042 30293 tablet_bootstrap.cc:492] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf: Bootstrap starting.
I20260709 13:09:43.521935 30294 raft_consensus.cc:359] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.520834 30251 raft_consensus.cc:2468] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 0.
I20260709 13:09:43.537200 30294 raft_consensus.cc:385] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.537439 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:43.522579 30295 consensus_queue.cc:260] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.537912 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:43.526979 30301 raft_consensus.cc:515] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.539767 30295 ts_tablet_manager.cc:1434] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:09:43.540212 30179 raft_consensus.cc:3060] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:43.540597 30069 leader_election.cc:343] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.541119 30301 leader_election.cc:290] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 election: Requested vote from peers 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.542865 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:43.543576 30252 raft_consensus.cc:3060] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.545845 30293 tablet_bootstrap.cc:654] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.538565 30294 raft_consensus.cc:740] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.547333 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:43.548213 30294 consensus_queue.cc:260] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.550710 30294 ts_tablet_manager.cc:1434] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:09:43.524080 30312 consensus_queue.cc:237] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.551987 30301 raft_consensus.cc:493] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.552544 30301 raft_consensus.cc:515] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.552927 30252 raft_consensus.cc:2468] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e952e3bfafb4f179ec3213c00d9f736 in term 1.
I20260709 13:09:43.554302 30069 leader_election.cc:304] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:43.555238 30341 raft_consensus.cc:2804] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.555456 30301 leader_election.cc:290] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.537628 30326 leader_election.cc:290] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 election: Requested vote from peers 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.546850 30320 raft_consensus.cc:515] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.555954 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" is_pre_election: true
I20260709 13:09:43.556877 30178 raft_consensus.cc:2393] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e952e3bfafb4f179ec3213c00d9f736 in current term 1: Already voted for candidate 9062c84d046e46e6b5711bdc9a33fbbf in this term.
I20260709 13:09:43.558462 30251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.554809 30294 tablet_bootstrap.cc:492] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a: Bootstrap starting.
W20260709 13:09:43.562189 30070 leader_election.cc:343] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:43.564205 30069 leader_election.cc:343] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.566107 30179 raft_consensus.cc:2468] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e952e3bfafb4f179ec3213c00d9f736 in term 1.
I20260709 13:09:43.566403 30069 leader_election.cc:304] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736; no voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:43.567620 30070 leader_election.cc:304] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:43.568881 30320 leader_election.cc:290] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.569479 30326 raft_consensus.cc:2749] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.571982 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:43.573513 30252 raft_consensus.cc:2393] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9062c84d046e46e6b5711bdc9a33fbbf in current term 1: Already voted for candidate 3e952e3bfafb4f179ec3213c00d9f736 in this term.
I20260709 13:09:43.574935 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:43.584273 30294 tablet_bootstrap.cc:654] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.587488 30293 tablet_bootstrap.cc:492] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf: No bootstrap required, opened a new log
I20260709 13:09:43.592088 30293 ts_tablet_manager.cc:1403] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.014s
I20260709 13:09:43.573645 30301 raft_consensus.cc:2804] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.593080 30301 raft_consensus.cc:697] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 LEADER]: Becoming Leader. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Running, Role: LEADER
I20260709 13:09:43.584693 30341 raft_consensus.cc:697] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 LEADER]: Becoming Leader. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Running, Role: LEADER
I20260709 13:09:43.594187 30301 consensus_queue.cc:237] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.594087 30002 catalog_manager.cc:5697] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 1 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.595250 30293 raft_consensus.cc:359] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.597421 30293 raft_consensus.cc:385] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.595290 30341 consensus_queue.cc:237] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.605230 30293 raft_consensus.cc:740] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.606421 30293 consensus_queue.cc:260] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.608706 30293 ts_tablet_manager.cc:1434] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:09:43.609252 30294 tablet_bootstrap.cc:492] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a: No bootstrap required, opened a new log
I20260709 13:09:43.609859 30294 ts_tablet_manager.cc:1403] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.018s
I20260709 13:09:43.616271 30145 leader_election.cc:304] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:43.616807 30002 catalog_manager.cc:5697] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 1 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.619882 30312 raft_consensus.cc:2749] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.620751 30294 raft_consensus.cc:359] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.620204 30341 raft_consensus.cc:493] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.621359 30294 raft_consensus.cc:385] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.621948 30294 raft_consensus.cc:740] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.621793 30341 raft_consensus.cc:515] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.622948 30294 consensus_queue.cc:260] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.623040 30000 catalog_manager.cc:5697] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "3e952e3bfafb4f179ec3213c00d9f736" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.625142 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a962f1eec84814884e1fcbf4887fdc" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" is_pre_election: true
I20260709 13:09:43.625459 30294 ts_tablet_manager.cc:1434] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:09:43.625892 30179 raft_consensus.cc:2468] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e952e3bfafb4f179ec3213c00d9f736 in term 0.
I20260709 13:09:43.626619 30294 tablet_bootstrap.cc:492] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a: Bootstrap starting.
I20260709 13:09:43.627498 30070 leader_election.cc:304] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:43.628680 30301 raft_consensus.cc:2804] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.629068 30301 raft_consensus.cc:493] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.629379 30301 raft_consensus.cc:3060] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.629433 30341 leader_election.cc:290] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.631966 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a962f1eec84814884e1fcbf4887fdc" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.632755 30252 raft_consensus.cc:2468] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e952e3bfafb4f179ec3213c00d9f736 in term 0.
I20260709 13:09:43.634070 30294 tablet_bootstrap.cc:654] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.637694 30301 raft_consensus.cc:515] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.639904 30301 leader_election.cc:290] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 election: Requested vote from peers 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.641552 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a962f1eec84814884e1fcbf4887fdc" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:43.642345 30179 raft_consensus.cc:3060] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.645949 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a962f1eec84814884e1fcbf4887fdc" candidate_uuid: "3e952e3bfafb4f179ec3213c00d9f736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:43.646762 30252 raft_consensus.cc:3060] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.657249 30312 raft_consensus.cc:493] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.657895 30312 raft_consensus.cc:515] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.666360 30252 raft_consensus.cc:2468] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e952e3bfafb4f179ec3213c00d9f736 in term 1.
I20260709 13:09:43.667815 30069 leader_election.cc:304] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:43.668526 30179 raft_consensus.cc:2468] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e952e3bfafb4f179ec3213c00d9f736 in term 1.
I20260709 13:09:43.668727 30301 raft_consensus.cc:2804] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.669374 30301 raft_consensus.cc:697] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 LEADER]: Becoming Leader. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Running, Role: LEADER
I20260709 13:09:43.670677 30301 consensus_queue.cc:237] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.671295 30312 leader_election.cc:290] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.670547 29998 catalog_manager.cc:5697] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "3e952e3bfafb4f179ec3213c00d9f736" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.673933 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736" is_pre_election: true
I20260709 13:09:43.674665 30104 raft_consensus.cc:2468] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 0.
I20260709 13:09:43.677034 30294 tablet_bootstrap.cc:492] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a: No bootstrap required, opened a new log
I20260709 13:09:43.677587 30294 ts_tablet_manager.cc:1403] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.018s
I20260709 13:09:43.677732 30145 leader_election.cc:304] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:43.677582 30312 consensus_queue.cc:1048] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.678817 30320 raft_consensus.cc:2804] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.679224 30320 raft_consensus.cc:493] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.679570 30320 raft_consensus.cc:3060] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.680624 30294 raft_consensus.cc:359] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.681356 30294 raft_consensus.cc:385] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.681608 30294 raft_consensus.cc:740] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.682298 30294 consensus_queue.cc:260] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.684185 30294 ts_tablet_manager.cc:1434] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:09:43.688922 30294 tablet_bootstrap.cc:492] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a: Bootstrap starting.
I20260709 13:09:43.690384 30320 raft_consensus.cc:515] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.693485 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:43.694136 30103 raft_consensus.cc:3060] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.695447 30294 tablet_bootstrap.cc:654] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.699569 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:43.700341 30252 raft_consensus.cc:2468] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 0.
I20260709 13:09:43.703809 30103 raft_consensus.cc:2468] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 1.
I20260709 13:09:43.705287 30145 leader_election.cc:304] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:43.706354 30312 raft_consensus.cc:2804] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.706858 30312 raft_consensus.cc:697] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:43.707711 30312 consensus_queue.cc:237] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.708375 30320 leader_election.cc:290] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 1 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:43.708921 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:43.709749 30252 raft_consensus.cc:3060] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.718474 30252 raft_consensus.cc:2468] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 1.
I20260709 13:09:43.724687 29998 catalog_manager.cc:5697] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "3e952e3bfafb4f179ec3213c00d9f736" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.727185 30001 catalog_manager.cc:5697] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 1 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.740428 30312 consensus_queue.cc:1048] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.742507 30294 tablet_bootstrap.cc:492] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a: No bootstrap required, opened a new log
I20260709 13:09:43.743113 30294 ts_tablet_manager.cc:1403] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.021s
I20260709 13:09:43.750954 30294 raft_consensus.cc:359] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.753950 30294 raft_consensus.cc:385] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.754245 30294 raft_consensus.cc:740] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.754925 30294 consensus_queue.cc:260] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.756729 30294 ts_tablet_manager.cc:1434] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:09:43.757692 30294 tablet_bootstrap.cc:492] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a: Bootstrap starting.
I20260709 13:09:43.762032 30294 tablet_bootstrap.cc:654] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.765965 30294 tablet_bootstrap.cc:492] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a: No bootstrap required, opened a new log
I20260709 13:09:43.766376 30294 ts_tablet_manager.cc:1403] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a: Time spent bootstrapping tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:09:43.768874 30294 raft_consensus.cc:359] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.769335 30294 raft_consensus.cc:385] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.769497 30294 raft_consensus.cc:740] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.769938 30294 consensus_queue.cc:260] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.771265 30294 ts_tablet_manager.cc:1434] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:43.778853 30315 consensus_queue.cc:1048] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.790019 30299 consensus_queue.cc:1048] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.818385 30299 raft_consensus.cc:493] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.818853 30299 raft_consensus.cc:515] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.820734 30299 leader_election.cc:290] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:43.821470 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736" is_pre_election: true
I20260709 13:09:43.821796 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" is_pre_election: true
I20260709 13:09:43.822124 30104 raft_consensus.cc:2468] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 0.
I20260709 13:09:43.822414 30179 raft_consensus.cc:2468] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 0.
I20260709 13:09:43.823221 30219 leader_election.cc:304] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:43.823896 30299 raft_consensus.cc:2804] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.824213 30299 raft_consensus.cc:493] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.824461 30299 raft_consensus.cc:3060] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.829744 30299 raft_consensus.cc:515] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.831343 30299 leader_election.cc:290] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:43.832250 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:43.832618 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:43.832957 30104 raft_consensus.cc:3060] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.833220 30179 raft_consensus.cc:3060] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.840325 30179 raft_consensus.cc:2468] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 1.
I20260709 13:09:43.840329 30104 raft_consensus.cc:2468] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 1.
I20260709 13:09:43.841686 30219 leader_election.cc:304] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:43.842540 30299 raft_consensus.cc:2804] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.842999 30299 raft_consensus.cc:697] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:43.843526 30315 consensus_queue.cc:1048] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.843835 30299 consensus_queue.cc:237] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.853040 29998 catalog_manager.cc:5697] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 0 to 1, leader changed from <none> to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 1 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.856175 30333 consensus_queue.cc:1048] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.878628 21312 ts_manager.cc:295] Set tserver state for 3e952e3bfafb4f179ec3213c00d9f736 to MAINTENANCE_MODE
I20260709 13:09:43.879323 21312 tablet_server.cc:179] TabletServer@127.20.208.1:0 shutting down...
I20260709 13:09:43.899549 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:43.900377 21312 tablet_replica.cc:333] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: stopping tablet replica
I20260709 13:09:43.901114 21312 raft_consensus.cc:2243] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.901507 21312 raft_consensus.cc:2272] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.903528 21312 tablet_replica.cc:333] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: stopping tablet replica
I20260709 13:09:43.904080 21312 raft_consensus.cc:2243] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.904439 21312 raft_consensus.cc:2272] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.906199 21312 tablet_replica.cc:333] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: stopping tablet replica
I20260709 13:09:43.906701 21312 raft_consensus.cc:2243] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.907090 21312 raft_consensus.cc:2272] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.909425 21312 tablet_replica.cc:333] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: stopping tablet replica
I20260709 13:09:43.909973 21312 raft_consensus.cc:2243] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.910319 21312 raft_consensus.cc:2272] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.912039 21312 tablet_replica.cc:333] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: stopping tablet replica
I20260709 13:09:43.912575 21312 raft_consensus.cc:2243] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.913149 21312 pending_rounds.cc:70] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Trying to abort 1 pending ops.
I20260709 13:09:43.913313 21312 pending_rounds.cc:77] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636182725529600 op_type: NO_OP noop_request { }
I20260709 13:09:43.913556 21312 raft_consensus.cc:2889] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:43.913790 21312 raft_consensus.cc:2272] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.915967 21312 tablet_replica.cc:333] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: stopping tablet replica
I20260709 13:09:43.916539 21312 raft_consensus.cc:2243] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.917117 21312 pending_rounds.cc:70] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Trying to abort 1 pending ops.
I20260709 13:09:43.917266 21312 pending_rounds.cc:77] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636182415314944 op_type: NO_OP noop_request { }
I20260709 13:09:43.917479 21312 raft_consensus.cc:2889] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:43.917695 21312 raft_consensus.cc:2272] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.920017 21312 tablet_replica.cc:333] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: stopping tablet replica
I20260709 13:09:43.920658 21312 raft_consensus.cc:2243] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.921272 21312 pending_rounds.cc:70] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Trying to abort 1 pending ops.
I20260709 13:09:43.921427 21312 pending_rounds.cc:77] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636182423736320 op_type: NO_OP noop_request { }
I20260709 13:09:43.921653 21312 raft_consensus.cc:2889] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:43.921880 21312 raft_consensus.cc:2272] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.924011 21312 tablet_replica.cc:333] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: stopping tablet replica
I20260709 13:09:43.924538 21312 raft_consensus.cc:2243] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.924894 21312 raft_consensus.cc:2272] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.926843 21312 tablet_replica.cc:333] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: stopping tablet replica
I20260709 13:09:43.927346 21312 raft_consensus.cc:2243] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.927723 21312 raft_consensus.cc:2272] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.930049 21312 tablet_replica.cc:333] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: stopping tablet replica
I20260709 13:09:43.930543 21312 raft_consensus.cc:2243] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.930965 21312 raft_consensus.cc:2272] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.957710 30333 raft_consensus.cc:493] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.958511 30333 raft_consensus.cc:515] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:43.960433 21312 tablet_server.cc:196] TabletServer@127.20.208.1:0 shutdown complete.
I20260709 13:09:43.961019 30333 leader_election.cc:290] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:43.962997 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" is_pre_election: true
I20260709 13:09:43.963920 30179 raft_consensus.cc:2393] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d675d04b3c92496ca7f778728bc4b85a in current term 1: Already voted for candidate 3e952e3bfafb4f179ec3213c00d9f736 in this term.
W20260709 13:09:43.966492 30219 leader_election.cc:336] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111)
I20260709 13:09:43.966867 30219 leader_election.cc:304] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d675d04b3c92496ca7f778728bc4b85a; no voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf
I20260709 13:09:43.967481 30333 raft_consensus.cc:3060] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.974740 30333 raft_consensus.cc:2749] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:43.977101 30145 consensus_peers.cc:597] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.981304 30300 consensus_queue.cc:1048] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:43.994781 30145 consensus_peers.cc:597] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:44.059073 30252 raft_consensus.cc:3060] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.065665 30320 consensus_queue.cc:1048] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.110785 30312 consensus_queue.cc:1048] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:44.124877 30145 consensus_peers.cc:597] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:44.159853 30145 consensus_peers.cc:597] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:44.196053 30219 consensus_peers.cc:597] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:44.259362 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:44.268813 30333 consensus_queue.cc:1048] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:44.293126 30219 consensus_peers.cc:597] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:44.368425 30219 consensus_peers.cc:597] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.145887 30320 raft_consensus.cc:493] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.146485 30320 raft_consensus.cc:515] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:45.148339 30320 leader_election.cc:290] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:45.149593 30251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:45.150375 30251 raft_consensus.cc:2468] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 1.
I20260709 13:09:45.151613 30144 leader_election.cc:304] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 
W20260709 13:09:45.152254 30145 leader_election.cc:336] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111)
I20260709 13:09:45.152307 30320 raft_consensus.cc:2804] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:45.152748 30320 raft_consensus.cc:493] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.153016 30320 raft_consensus.cc:3060] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.161638 30320 raft_consensus.cc:515] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:45.164412 30320 leader_election.cc:290] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:45.165838 30251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:45.166711 30251 raft_consensus.cc:3060] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:45.169756 30145 leader_election.cc:336] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111)
I20260709 13:09:45.175390 30251 raft_consensus.cc:2468] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 2.
I20260709 13:09:45.177073 30144 leader_election.cc:304] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 3e952e3bfafb4f179ec3213c00d9f736
I20260709 13:09:45.178143 30320 raft_consensus.cc:2804] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:45.178733 30320 raft_consensus.cc:697] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:45.179870 30320 consensus_queue.cc:237] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:45.189983 29998 catalog_manager.cc:5697] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 1 to 2, leader changed from 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1) to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 2 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:45.260999 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:45.278574 30320 raft_consensus.cc:493] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.279220 30320 raft_consensus.cc:515] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:45.281178 30320 leader_election.cc:290] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:45.282389 30251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:45.283255 30251 raft_consensus.cc:2468] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 1.
I20260709 13:09:45.284283 30144 leader_election.cc:304] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:45.284982 30320 raft_consensus.cc:2804] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:45.285209 30145 leader_election.cc:336] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111)
I20260709 13:09:45.285362 30320 raft_consensus.cc:493] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.285818 30320 raft_consensus.cc:3060] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.292570 30320 raft_consensus.cc:515] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:45.294359 30320 leader_election.cc:290] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:45.295442 30251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:45.295974 30251 raft_consensus.cc:3060] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:45.297737 30145 leader_election.cc:336] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111)
I20260709 13:09:45.301342 30251 raft_consensus.cc:2468] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 2.
I20260709 13:09:45.302366 30144 leader_election.cc:304] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 3e952e3bfafb4f179ec3213c00d9f736
I20260709 13:09:45.303020 30320 raft_consensus.cc:2804] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:45.303481 30320 raft_consensus.cc:697] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:45.304625 30320 consensus_queue.cc:237] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:45.312704 29998 catalog_manager.cc:5697] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 1 to 2, leader changed from 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1) to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 2 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:45.563105 30145 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111) [suppressed 119 similar messages]
W20260709 13:09:45.565496 30145 consensus_peers.cc:597] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.568321 30320 raft_consensus.cc:493] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.568845 30320 raft_consensus.cc:515] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:45.570708 30320 leader_election.cc:290] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:45.571861 30251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a962f1eec84814884e1fcbf4887fdc" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a" is_pre_election: true
I20260709 13:09:45.572675 30251 raft_consensus.cc:2468] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 1.
I20260709 13:09:45.573907 30144 leader_election.cc:304] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 
W20260709 13:09:45.574440 30145 leader_election.cc:336] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111)
I20260709 13:09:45.574605 30320 raft_consensus.cc:2804] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:45.575054 30320 raft_consensus.cc:493] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.575337 30320 raft_consensus.cc:3060] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.581828 30320 raft_consensus.cc:515] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:45.583451 30320 leader_election.cc:290] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:45.584592 30251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a962f1eec84814884e1fcbf4887fdc" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:45.585177 30251 raft_consensus.cc:3060] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:45.587097 30145 leader_election.cc:336] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111)
I20260709 13:09:45.590554 30251 raft_consensus.cc:2468] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 2.
I20260709 13:09:45.591688 30144 leader_election.cc:304] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 3e952e3bfafb4f179ec3213c00d9f736
I20260709 13:09:45.592445 30320 raft_consensus.cc:2804] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:45.592922 30320 raft_consensus.cc:697] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:45.593917 30320 consensus_queue.cc:237] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:45.597442 30251 raft_consensus.cc:1275] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:45.598941 30320 consensus_queue.cc:1048] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.602664 29998 catalog_manager.cc:5697] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 1 to 2, leader changed from 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1) to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 2 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.743258 30251 raft_consensus.cc:1275] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:45.744618 30312 consensus_queue.cc:1048] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:45.759157 30145 consensus_peers.cc:597] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.060626 30145 consensus_peers.cc:597] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.173632 30251 raft_consensus.cc:1275] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:46.174926 30312 consensus_queue.cc:1048] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:46.262020 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:46.536056 30145 consensus_peers.cc:597] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:46.581897 30145 consensus_peers.cc:597] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:46.638060 30219 consensus_peers.cc:597] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:46.659549 30145 consensus_peers.cc:597] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:46.665897 30145 consensus_peers.cc:597] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:46.670451 30219 consensus_peers.cc:597] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:46.821897 30219 consensus_peers.cc:597] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.262998 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:47.860915 30145 consensus_peers.cc:597] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.150579 30145 consensus_peers.cc:597] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.263957 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:48.407032 30145 consensus_peers.cc:597] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.965099 30145 consensus_peers.cc:597] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:48.984117 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:48.992208 30390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:48.992240 30391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:48.994604 30393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:48.995296 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:48.996412 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:48.996690 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:48.996856 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602588996843 us; error 0 us; skew 500 ppm
I20260709 13:09:48.997457 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:49.000237 21312 webserver.cc:533] Webserver started at http://127.20.208.1:38393/ using document root <none> and password file <none>
I20260709 13:09:49.000808 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:49.000973 21312 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:49.005081 21312 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:09:49.009407 30398 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:49.010308 21312 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:09:49.010655 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-0-root
uuid: "3e952e3bfafb4f179ec3213c00d9f736"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-6j4g"
I20260709 13:09:49.011034 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326409895-21312-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:49.023152 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:49.024564 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:49.026135 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:49.030036 30405 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:09:49.052614 30145 consensus_peers.cc:597] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:49.087325 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:09:49.087762 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:09:49.088069 21312 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:09:49.094045 30405 tablet_bootstrap.cc:492] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:49.109261 30405 tablet_bootstrap.cc:492] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.110169 30405 tablet_bootstrap.cc:492] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap complete.
I20260709 13:09:49.110910 30405 ts_tablet_manager.cc:1403] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:09:49.113919 30405 raft_consensus.cc:359] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.114733 30405 raft_consensus.cc:740] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.115556 30405 consensus_queue.cc:260] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.118742 30405 ts_tablet_manager.cc:1434] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:09:49.119649 30405 tablet_bootstrap.cc:492] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
W20260709 13:09:49.131747 30145 consensus_peers.cc:597] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:49.135092 30405 tablet_bootstrap.cc:492] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.136159 30405 tablet_bootstrap.cc:492] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap complete.
I20260709 13:09:49.136976 30405 ts_tablet_manager.cc:1403] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:09:49.139969 30405 raft_consensus.cc:359] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.140741 30405 raft_consensus.cc:740] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.141477 30405 consensus_queue.cc:260] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.143627 30405 ts_tablet_manager.cc:1434] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:09:49.144562 30405 tablet_bootstrap.cc:492] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
W20260709 13:09:49.149159 30219 consensus_peers.cc:597] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:49.152383 21312 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:09:49.152837 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.065s	user 0.062s	sys 0.003s
I20260709 13:09:49.161693 30405 tablet_bootstrap.cc:492] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:49.162848 30405 tablet_bootstrap.cc:492] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap complete.
I20260709 13:09:49.163645 30405 ts_tablet_manager.cc:1403] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.010s
I20260709 13:09:49.167464 30405 raft_consensus.cc:359] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.168526 30405 raft_consensus.cc:740] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.169451 30405 consensus_queue.cc:260] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.171835 30405 ts_tablet_manager.cc:1434] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:09:49.172966 30405 tablet_bootstrap.cc:492] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
W20260709 13:09:49.192358 30145 consensus_peers.cc:597] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:49.192441 30405 tablet_bootstrap.cc:492] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.194169 30405 tablet_bootstrap.cc:492] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap complete.
I20260709 13:09:49.194854 30405 ts_tablet_manager.cc:1403] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:09:49.197141 30405 raft_consensus.cc:359] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.197686 30405 raft_consensus.cc:740] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.198334 30405 consensus_queue.cc:260] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.199791 30405 ts_tablet_manager.cc:1434] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:49.200461 30405 tablet_bootstrap.cc:492] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:49.214002 30405 tablet_bootstrap.cc:492] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:49.214658 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.1:36063
I20260709 13:09:49.214783 30467 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.1:36063 every 8 connection(s)
I20260709 13:09:49.217113 30405 tablet_bootstrap.cc:492] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap complete.
I20260709 13:09:49.217998 30405 ts_tablet_manager.cc:1403] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:09:49.220927 30405 raft_consensus.cc:359] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.221884 30405 raft_consensus.cc:740] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.222666 30405 consensus_queue.cc:260] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.224673 30405 ts_tablet_manager.cc:1434] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:49.225683 30405 tablet_bootstrap.cc:492] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:49.227521 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.248977 30405 tablet_bootstrap.cc:492] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.251446 30405 tablet_bootstrap.cc:492] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap complete.
I20260709 13:09:49.252264 30405 ts_tablet_manager.cc:1403] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.004s
I20260709 13:09:49.254675 30405 raft_consensus.cc:359] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.255414 30405 raft_consensus.cc:740] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.256253 30405 consensus_queue.cc:260] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.259407 30405 ts_tablet_manager.cc:1434] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:49.259516 30442 raft_consensus.cc:3060] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.259298 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
mode: GRACEFUL
new_leader_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:35104
I20260709 13:09:49.260401 30179 raft_consensus.cc:606] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Received request to transfer leadership to TS d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:49.260584 30405 tablet_bootstrap.cc:492] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:49.263695 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
mode: GRACEFUL
new_leader_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:35104
I20260709 13:09:49.264397 30179 raft_consensus.cc:606] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Received request to transfer leadership to TS d675d04b3c92496ca7f778728bc4b85a
W20260709 13:09:49.264935 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:49.267388 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
mode: GRACEFUL
new_leader_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:35104
I20260709 13:09:49.268993 30468 heartbeater.cc:344] Connected to a master server at 127.20.208.62:34371
I20260709 13:09:49.269465 30179 raft_consensus.cc:606] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Received request to transfer leadership to TS d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:49.269534 30468 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:49.269650 30442 pending_rounds.cc:85] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Aborting all ops after (but not including) 0
I20260709 13:09:49.270268 30442 pending_rounds.cc:107] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:49.270625 30442 raft_consensus.cc:2889] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.270876 30468 heartbeater.cc:507] Master 127.20.208.62:34371 requested a full tablet report, sending...
I20260709 13:09:49.271174 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:49.271840 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:49.272719 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.280102 30405 tablet_bootstrap.cc:492] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.281713 30405 tablet_bootstrap.cc:492] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap complete.
I20260709 13:09:49.283104 30405 ts_tablet_manager.cc:1403] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:09:49.286500 30405 raft_consensus.cc:359] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.287427 30405 raft_consensus.cc:740] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.288419 30405 consensus_queue.cc:260] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.291098 30442 raft_consensus.cc:3060] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.291409 29998 ts_manager.cc:194] Re-registered known tserver with Master: 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063)
I20260709 13:09:49.291344 30405 ts_tablet_manager.cc:1434] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:09:49.293651 30405 tablet_bootstrap.cc:492] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:49.308382 30442 pending_rounds.cc:85] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Aborting all ops after (but not including) 0
I20260709 13:09:49.309072 30442 pending_rounds.cc:107] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:49.309554 30442 raft_consensus.cc:2889] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.309747 29998 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44720
I20260709 13:09:49.314596 30468 heartbeater.cc:499] Master 127.20.208.62:34371 was elected leader, sending a full tablet report...
I20260709 13:09:49.319464 30479 raft_consensus.cc:993] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf: : Instructing follower d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:49.320217 30479 raft_consensus.cc:1081] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Signalling peer d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:49.322381 30405 tablet_bootstrap.cc:492] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:49.322465 30252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:50888
I20260709 13:09:49.323331 30252 raft_consensus.cc:493] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.323643 30405 tablet_bootstrap.cc:492] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap complete.
I20260709 13:09:49.323715 30252 raft_consensus.cc:3060] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.324544 30405 ts_tablet_manager.cc:1403] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.031s	user 0.030s	sys 0.000s
I20260709 13:09:49.327394 30405 raft_consensus.cc:359] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.328222 30405 raft_consensus.cc:740] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.328989 30405 consensus_queue.cc:260] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.331203 30405 ts_tablet_manager.cc:1434] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:09:49.332336 30405 tablet_bootstrap.cc:492] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:49.335069 30252 raft_consensus.cc:515] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.339311 30440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:49.348119 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df95d7fddc24f3bb31f5ccaa560ee17" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:49.348845 30179 raft_consensus.cc:3055] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:49.349201 30179 raft_consensus.cc:740] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:49.350054 30179 consensus_queue.cc:260] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.351282 30179 raft_consensus.cc:3060] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.352545 30252 leader_election.cc:290] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 3 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:49.359163 30405 tablet_bootstrap.cc:492] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.360282 30405 tablet_bootstrap.cc:492] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap complete.
I20260709 13:09:49.361004 30405 ts_tablet_manager.cc:1403] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.003s
I20260709 13:09:49.361600 30179 raft_consensus.cc:2468] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 3.
I20260709 13:09:49.362927 30219 leader_election.cc:304] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 3e952e3bfafb4f179ec3213c00d9f736
I20260709 13:09:49.363428 30405 raft_consensus.cc:359] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:49.363925 30299 raft_consensus.cc:2804] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.364208 30405 raft_consensus.cc:740] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.365101 30405 consensus_queue.cc:260] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:49.367218 30299 raft_consensus.cc:697] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 3 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:49.367748 30405 ts_tablet_manager.cc:1434] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:49.368816 30405 tablet_bootstrap.cc:492] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap starting.
I20260709 13:09:49.368669 30299 consensus_queue.cc:237] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.377020 29998 catalog_manager.cc:5697] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 2 to 3, leader changed from 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2) to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 3 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.383016 30405 tablet_bootstrap.cc:492] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.383984 30405 tablet_bootstrap.cc:492] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: Bootstrap complete.
I20260709 13:09:49.384774 30405 ts_tablet_manager.cc:1403] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.003s
I20260709 13:09:49.387172 30405 raft_consensus.cc:359] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.387689 30405 raft_consensus.cc:740] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e952e3bfafb4f179ec3213c00d9f736, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.388314 30405 consensus_queue.cc:260] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.390184 30405 ts_tablet_manager.cc:1434] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:49.439787 30441 raft_consensus.cc:3060] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.446645 30441 pending_rounds.cc:85] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Aborting all ops after (but not including) 0
I20260709 13:09:49.446872 30441 pending_rounds.cc:107] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:49.447184 30441 raft_consensus.cc:2889] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.553455 30479 raft_consensus.cc:993] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf: : Instructing follower d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:49.553954 30389 raft_consensus.cc:1081] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Signalling peer d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:49.555445 30252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:50888
I20260709 13:09:49.555887 30252 raft_consensus.cc:493] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.556139 30252 raft_consensus.cc:3060] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.561934 30252 raft_consensus.cc:515] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.563515 30252 leader_election.cc:290] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 2 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:49.564349 30441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:49.564577 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:49.565012 30441 raft_consensus.cc:3060] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.565110 30179 raft_consensus.cc:3055] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.565492 30179 raft_consensus.cc:740] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:49.566145 30179 consensus_queue.cc:260] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.567104 30179 raft_consensus.cc:3060] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.570619 30441 raft_consensus.cc:2468] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 2.
I20260709 13:09:49.571720 30219 leader_election.cc:304] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:49.572448 30299 raft_consensus.cc:2804] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.572852 30179 raft_consensus.cc:2468] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 2.
I20260709 13:09:49.572974 30299 raft_consensus.cc:697] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:49.574155 30299 consensus_queue.cc:237] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.581064 29998 catalog_manager.cc:5697] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 1 to 2, leader changed from 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2) to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 2 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.652637 30479 raft_consensus.cc:993] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf: : Instructing follower d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:49.653083 30389 raft_consensus.cc:1081] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Signalling peer d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:49.654744 30252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:50888
I20260709 13:09:49.655347 30252 raft_consensus.cc:493] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.655771 30252 raft_consensus.cc:3060] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.662685 30252 raft_consensus.cc:515] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.664276 30252 leader_election.cc:290] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 2 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:49.664989 30442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:49.665336 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:49.665632 30442 raft_consensus.cc:3060] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.665890 30179 raft_consensus.cc:3055] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.666178 30179 raft_consensus.cc:740] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:49.666882 30179 consensus_queue.cc:260] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.667805 30179 raft_consensus.cc:3060] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.671087 30442 raft_consensus.cc:2468] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 2.
I20260709 13:09:49.672454 30219 leader_election.cc:304] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:49.673215 30299 raft_consensus.cc:2804] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.673225 30179 raft_consensus.cc:2468] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 2.
I20260709 13:09:49.673787 30299 raft_consensus.cc:697] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:49.674814 30299 consensus_queue.cc:237] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:49.681870 29998 catalog_manager.cc:5697] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 1 to 2, leader changed from 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2) to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 2 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.788689 30442 raft_consensus.cc:3060] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.794049 30442 raft_consensus.cc:1275] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:49.795562 30497 consensus_queue.cc:1048] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:49.804751 30179 raft_consensus.cc:1275] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:49.806203 30299 consensus_queue.cc:1048] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.086310 30442 raft_consensus.cc:1275] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.087569 30299 consensus_queue.cc:1048] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.095727 30179 raft_consensus.cc:1275] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.097796 30497 consensus_queue.cc:1048] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.164287 30179 raft_consensus.cc:1275] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.166329 30497 consensus_queue.cc:1048] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.179149 30441 raft_consensus.cc:1275] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.181494 30299 consensus_queue.cc:1048] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:50.265933 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:50.284308 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:50.301658 30252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
mode: GRACEFUL
new_leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:09:50.302220 30252 raft_consensus.cc:606] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Received request to transfer leadership to TS 9062c84d046e46e6b5711bdc9a33fbbf
I20260709 13:09:50.304661 30252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
mode: GRACEFUL
new_leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:09:50.305192 30252 raft_consensus.cc:606] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Received request to transfer leadership to TS 9062c84d046e46e6b5711bdc9a33fbbf
I20260709 13:09:50.306463 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:50.307209 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:50.307931 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:50.609699 30485 raft_consensus.cc:993] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a: : Instructing follower 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:50.610168 30299 raft_consensus.cc:1081] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Signalling peer 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:50.611619 30179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:35090
I20260709 13:09:50.612069 30179 raft_consensus.cc:493] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.612340 30179 raft_consensus.cc:3060] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.617093 30179 raft_consensus.cc:515] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:50.618636 30179 leader_election.cc:290] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:50.619576 30441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:50.619870 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:50.620265 30441 raft_consensus.cc:3060] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.620570 30252 raft_consensus.cc:3055] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:50.620946 30252 raft_consensus.cc:740] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:50.621886 30252 consensus_queue.cc:260] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:50.623085 30252 raft_consensus.cc:3060] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.625866 30441 raft_consensus.cc:2468] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 2.
I20260709 13:09:50.627053 30145 leader_election.cc:304] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:50.627812 30498 raft_consensus.cc:2804] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.628181 30498 raft_consensus.cc:697] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:50.628520 30252 raft_consensus.cc:2468] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 2.
I20260709 13:09:50.629081 30498 consensus_queue.cc:237] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:50.635965 30001 catalog_manager.cc:5697] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 1 to 2, leader changed from d675d04b3c92496ca7f778728bc4b85a (127.20.208.3) to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 2 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.749693 30485 raft_consensus.cc:993] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a: : Instructing follower 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:50.750172 30299 raft_consensus.cc:1081] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Signalling peer 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:50.751590 30179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:35090
I20260709 13:09:50.752069 30179 raft_consensus.cc:493] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.752349 30179 raft_consensus.cc:3060] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.758123 30179 raft_consensus.cc:515] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:50.759588 30179 leader_election.cc:290] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:50.760648 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:50.761168 30252 raft_consensus.cc:3055] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:50.761394 30252 raft_consensus.cc:740] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:50.762079 30252 consensus_queue.cc:260] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:50.762181 30441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:50.762748 30441 raft_consensus.cc:3060] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.763103 30252 raft_consensus.cc:3060] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.768633 30441 raft_consensus.cc:2468] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 2.
I20260709 13:09:50.768807 30252 raft_consensus.cc:2468] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 2.
I20260709 13:09:50.769891 30145 leader_election.cc:304] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:50.770572 30498 raft_consensus.cc:2804] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.770946 30498 raft_consensus.cc:697] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:50.771726 30498 consensus_queue.cc:237] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:50.778662 30001 catalog_manager.cc:5697] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 1 to 2, leader changed from d675d04b3c92496ca7f778728bc4b85a (127.20.208.3) to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 2 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.167589 30441 raft_consensus.cc:1275] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.168924 30498 consensus_queue.cc:1048] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.180294 30252 raft_consensus.cc:1275] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.185786 30389 consensus_queue.cc:1048] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:51.266963 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:51.316203 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:51.324522 30252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
mode: GRACEFUL
new_leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:09:51.325057 30252 raft_consensus.cc:606] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Received request to transfer leadership to TS 9062c84d046e46e6b5711bdc9a33fbbf
I20260709 13:09:51.327526 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81a962f1eec84814884e1fcbf4887fdc"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
mode: GRACEFUL
new_leader_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:35104
I20260709 13:09:51.328059 30179 raft_consensus.cc:606] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Received request to transfer leadership to TS d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:51.330499 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
mode: GRACEFUL
new_leader_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:35104
I20260709 13:09:51.330967 30179 raft_consensus.cc:606] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Received request to transfer leadership to TS d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:51.332049 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:51.332547 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:51.333108 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:51.347143 30498 raft_consensus.cc:993] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf: : Instructing follower d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:51.347898 30389 raft_consensus.cc:1081] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Signalling peer d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:51.348399 30252 raft_consensus.cc:1275] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.350407 30389 consensus_queue.cc:1048] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:51.350579 30252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:50888
I20260709 13:09:51.351388 30252 raft_consensus.cc:493] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.351804 30252 raft_consensus.cc:3060] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.360607 30252 raft_consensus.cc:515] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:51.362838 30441 raft_consensus.cc:1275] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.365377 30252 leader_election.cc:290] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 2 election: Requested vote from peers 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737), 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063)
I20260709 13:09:51.366297 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:51.366705 30389 consensus_queue.cc:1048] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:51.368584 30441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:51.372502 30179 raft_consensus.cc:3055] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:51.373698 30179 raft_consensus.cc:740] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:51.374994 30179 consensus_queue.cc:260] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:51.373745 30441 raft_consensus.cc:3060] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.376691 30179 raft_consensus.cc:3060] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.384902 30441 raft_consensus.cc:2468] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 2.
I20260709 13:09:51.386152 30179 raft_consensus.cc:2468] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 2.
I20260709 13:09:51.386164 30219 leader_election.cc:304] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:51.387126 30299 raft_consensus.cc:2804] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.388242 30299 raft_consensus.cc:697] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:51.389204 30299 consensus_queue.cc:237] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:51.395859 30001 catalog_manager.cc:5697] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 1 to 2, leader changed from 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2) to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 2 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.617398 30521 raft_consensus.cc:993] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a: : Instructing follower 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:51.617812 30299 raft_consensus.cc:1081] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Signalling peer 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:51.619210 30179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:35090
I20260709 13:09:51.619649 30179 raft_consensus.cc:493] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.619902 30179 raft_consensus.cc:3060] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.624586 30179 raft_consensus.cc:515] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:51.626210 30179 leader_election.cc:290] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:51.626984 30441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:51.627317 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0ef3f56c17410c979f8cb00e6b801f" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:51.627596 30441 raft_consensus.cc:3060] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.627868 30252 raft_consensus.cc:3055] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:51.628145 30252 raft_consensus.cc:740] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:51.628893 30252 consensus_queue.cc:260] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:51.629817 30252 raft_consensus.cc:3060] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.633059 30441 raft_consensus.cc:2468] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 2.
I20260709 13:09:51.634265 30145 leader_election.cc:304] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:51.634887 30252 raft_consensus.cc:2468] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 2.
I20260709 13:09:51.635044 30389 raft_consensus.cc:2804] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.635617 30389 raft_consensus.cc:697] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:51.636560 30389 consensus_queue.cc:237] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:51.644584 30001 catalog_manager.cc:5697] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 1 to 2, leader changed from d675d04b3c92496ca7f778728bc4b85a (127.20.208.3) to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 2 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.826798 30498 raft_consensus.cc:993] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf: : Instructing follower d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:51.827261 30389 raft_consensus.cc:1081] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Signalling peer d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:51.828850 30252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81a962f1eec84814884e1fcbf4887fdc"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:50888
I20260709 13:09:51.829352 30252 raft_consensus.cc:493] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.829632 30252 raft_consensus.cc:3060] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.834306 30252 raft_consensus.cc:515] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:51.835805 30252 leader_election.cc:290] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 3 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:51.836967 30441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a962f1eec84814884e1fcbf4887fdc" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:51.837085 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a962f1eec84814884e1fcbf4887fdc" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:51.837751 30441 raft_consensus.cc:3060] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.837845 30179 raft_consensus.cc:3055] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:51.838294 30179 raft_consensus.cc:740] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:51.838656 30442 raft_consensus.cc:1275] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.838910 30179 consensus_queue.cc:260] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:51.840011 30179 raft_consensus.cc:3060] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.840073 30299 consensus_queue.cc:1048] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.844884 30441 raft_consensus.cc:2468] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 3.
I20260709 13:09:51.846621 30179 raft_consensus.cc:2468] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 3.
I20260709 13:09:51.846567 30219 leader_election.cc:304] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:51.847841 30299 raft_consensus.cc:2804] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:51.848294 30299 raft_consensus.cc:697] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 3 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:51.849198 30299 consensus_queue.cc:237] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:51.858377 30001 catalog_manager.cc:5697] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 2 to 3, leader changed from 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2) to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 3 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.859186 30179 raft_consensus.cc:1275] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.860770 30529 consensus_queue.cc:1048] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.056957 30252 raft_consensus.cc:1275] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.058272 30389 consensus_queue.cc:1048] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.067605 30442 raft_consensus.cc:1275] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.069890 30498 consensus_queue.cc:1048] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:52.268090 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:52.340572 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.348086 30252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
mode: GRACEFUL
new_leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:09:52.348619 30252 raft_consensus.cc:606] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Received request to transfer leadership to TS 9062c84d046e46e6b5711bdc9a33fbbf
I20260709 13:09:52.351068 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
mode: GRACEFUL
new_leader_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:35104
I20260709 13:09:52.351503 30179 raft_consensus.cc:606] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Received request to transfer leadership to TS d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:52.354421 30252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
mode: GRACEFUL
new_leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:09:52.355090 30252 raft_consensus.cc:606] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Received request to transfer leadership to TS 9062c84d046e46e6b5711bdc9a33fbbf
I20260709 13:09:52.356490 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:52.357125 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:52.357841 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.368253 30179 raft_consensus.cc:1275] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:52.369529 30529 consensus_queue.cc:1048] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.382218 30442 raft_consensus.cc:1275] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:52.382481 30536 raft_consensus.cc:993] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a: : Instructing follower 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:52.383052 30536 raft_consensus.cc:1081] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Signalling peer 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:52.383955 30536 consensus_queue.cc:1048] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.384873 30178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:35090
I20260709 13:09:52.385452 30178 raft_consensus.cc:493] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.385803 30178 raft_consensus.cc:3060] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.394449 30178 raft_consensus.cc:515] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:52.397985 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:52.398622 30252 raft_consensus.cc:3055] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:52.398914 30252 raft_consensus.cc:740] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:52.397444 30178 leader_election.cc:290] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 3 election: Requested vote from peers d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759), 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063)
I20260709 13:09:52.399283 30442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df00809a619241208b85bf7cb206ef0f" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:52.399632 30252 consensus_queue.cc:260] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:52.400130 30442 raft_consensus.cc:3060] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.400974 30252 raft_consensus.cc:3060] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.406296 30442 raft_consensus.cc:2468] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 3.
I20260709 13:09:52.407104 30252 raft_consensus.cc:2468] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 3.
I20260709 13:09:52.407369 30145 leader_election.cc:304] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:52.408303 30498 raft_consensus.cc:2804] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.408752 30498 raft_consensus.cc:697] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:52.409530 30498 consensus_queue.cc:237] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } }
I20260709 13:09:52.409953 30537 raft_consensus.cc:993] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a: : Instructing follower 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:52.410429 30536 raft_consensus.cc:1081] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Signalling peer 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:52.411916 30178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:35090
I20260709 13:09:52.412505 30178 raft_consensus.cc:493] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.412901 30178 raft_consensus.cc:3060] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.416229 30001 catalog_manager.cc:5697] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 2 to 3, leader changed from d675d04b3c92496ca7f778728bc4b85a (127.20.208.3) to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 3 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.419781 30178 raft_consensus.cc:515] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:52.421619 30178 leader_election.cc:290] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 3 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:52.422701 30252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:52.422868 30442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201a29d1ac264ecd816977549d0040b7" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:52.423215 30252 raft_consensus.cc:3055] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:52.423529 30252 raft_consensus.cc:740] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:52.423574 30442 raft_consensus.cc:3060] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.424187 30252 consensus_queue.cc:260] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:52.425264 30252 raft_consensus.cc:3060] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.429414 30389 raft_consensus.cc:993] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf: : Instructing follower d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:52.430053 30498 raft_consensus.cc:1081] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Signalling peer d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:52.431865 30252 raft_consensus.cc:2468] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 3.
I20260709 13:09:52.432070 30251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:50888
I20260709 13:09:52.432750 30251 raft_consensus.cc:493] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.433122 30251 raft_consensus.cc:3060] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.433248 30144 leader_election.cc:304] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9062c84d046e46e6b5711bdc9a33fbbf, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:52.433560 30442 raft_consensus.cc:2468] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 3.
I20260709 13:09:52.435277 30498 raft_consensus.cc:2804] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.435750 30498 raft_consensus.cc:697] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:52.436491 30498 consensus_queue.cc:237] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:52.440394 30251 raft_consensus.cc:515] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:52.442807 30251 leader_election.cc:290] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 3 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:52.443470 30442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:52.444022 30442 raft_consensus.cc:3060] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.443751 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0046502fb2d447cb56e0a090a87f3ba" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:52.444950 30178 raft_consensus.cc:3055] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:52.445327 30178 raft_consensus.cc:740] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:52.445272 30001 catalog_manager.cc:5697] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 2 to 3, leader changed from d675d04b3c92496ca7f778728bc4b85a (127.20.208.3) to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 3 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.446321 30178 consensus_queue.cc:260] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:52.447576 30178 raft_consensus.cc:3060] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.450435 30442 raft_consensus.cc:2468] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 3.
I20260709 13:09:52.451540 30219 leader_election.cc:304] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:52.452282 30536 raft_consensus.cc:2804] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.452800 30536 raft_consensus.cc:697] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 3 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:52.453971 30178 raft_consensus.cc:2468] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 3.
I20260709 13:09:52.453675 30536 consensus_queue.cc:237] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:52.461488 30001 catalog_manager.cc:5697] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 2 to 3, leader changed from 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2) to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 3 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.846128 30178 raft_consensus.cc:1275] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:52.847380 30536 consensus_queue.cc:1048] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.847496 30442 raft_consensus.cc:1275] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.848851 30498 consensus_queue.cc:1048] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.859839 30251 raft_consensus.cc:1275] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.861544 30515 consensus_queue.cc:1048] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.862332 30441 raft_consensus.cc:1275] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:52.870031 30537 consensus_queue.cc:1048] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.904821 30441 raft_consensus.cc:1275] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.906101 30515 consensus_queue.cc:1048] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.915023 30251 raft_consensus.cc:1275] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.916640 30515 consensus_queue.cc:1048] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:53.269160 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:53.365033 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:53.372232 30251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
mode: GRACEFUL
new_leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:09:53.372829 30251 raft_consensus.cc:606] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Received request to transfer leadership to TS 9062c84d046e46e6b5711bdc9a33fbbf
I20260709 13:09:53.375589 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
mode: GRACEFUL
new_leader_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:35104
I20260709 13:09:53.376102 30179 raft_consensus.cc:606] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Received request to transfer leadership to TS d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:53.378523 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
mode: GRACEFUL
new_leader_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:35104
I20260709 13:09:53.378968 30179 raft_consensus.cc:606] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Received request to transfer leadership to TS d675d04b3c92496ca7f778728bc4b85a
I20260709 13:09:53.379922 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:53.380435 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:53.381213 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:53.573554 30551 raft_consensus.cc:993] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a: : Instructing follower 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:53.573983 30552 raft_consensus.cc:1081] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Signalling peer 9062c84d046e46e6b5711bdc9a33fbbf to start an election
I20260709 13:09:53.575713 30179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c"
dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
 from {username='slave'} at 127.0.0.1:35090
I20260709 13:09:53.576289 30179 raft_consensus.cc:493] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.576655 30179 raft_consensus.cc:3060] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.581676 30179 raft_consensus.cc:515] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:53.583150 30179 leader_election.cc:290] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 3 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), d675d04b3c92496ca7f778728bc4b85a (127.20.208.3:34759)
I20260709 13:09:53.583961 30442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:53.584177 30251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289995462eb44ec2b6580123b389ed3c" candidate_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
I20260709 13:09:53.584618 30442 raft_consensus.cc:3060] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.584791 30251 raft_consensus.cc:3055] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.585155 30251 raft_consensus.cc:740] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:53.585825 30251 consensus_queue.cc:260] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:53.586781 30251 raft_consensus.cc:3060] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.589967 30442 raft_consensus.cc:2468] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 3.
I20260709 13:09:53.591292 30145 leader_election.cc:304] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, 9062c84d046e46e6b5711bdc9a33fbbf; no voters: 
I20260709 13:09:53.592118 30389 raft_consensus.cc:2804] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.592299 30251 raft_consensus.cc:2468] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9062c84d046e46e6b5711bdc9a33fbbf in term 3.
I20260709 13:09:53.592612 30389 raft_consensus.cc:697] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 LEADER]: Becoming Leader. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:53.593433 30389 consensus_queue.cc:237] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:53.599808 30001 catalog_manager.cc:5697] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf reported cstate change: term changed from 2 to 3, leader changed from d675d04b3c92496ca7f778728bc4b85a (127.20.208.3) to 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2). New cstate: current_term: 3 leader_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.704262 30549 raft_consensus.cc:993] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf: : Instructing follower d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:53.704813 30389 raft_consensus.cc:1081] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Signalling peer d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:53.706518 30251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:50888
I20260709 13:09:53.707118 30251 raft_consensus.cc:493] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.707486 30251 raft_consensus.cc:3060] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.712766 30251 raft_consensus.cc:515] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:53.714867 30251 leader_election.cc:290] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 3 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:53.715826 30442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:53.715899 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d407dd7214765b5cdb203b3ff2942" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:53.716774 30179 raft_consensus.cc:3055] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.716699 30442 raft_consensus.cc:3060] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.717160 30179 raft_consensus.cc:740] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:53.717880 30179 consensus_queue.cc:260] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:53.718770 30179 raft_consensus.cc:3060] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.723649 30179 raft_consensus.cc:2468] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 3.
I20260709 13:09:53.723675 30442 raft_consensus.cc:2468] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 3.
I20260709 13:09:53.725026 30219 leader_election.cc:304] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:53.725713 30552 raft_consensus.cc:2804] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.726176 30552 raft_consensus.cc:697] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 3 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:53.726977 30552 consensus_queue.cc:237] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:53.734063 30001 catalog_manager.cc:5697] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 2 to 3, leader changed from 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2) to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 3 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.846208 30549 raft_consensus.cc:993] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf: : Instructing follower d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:53.846639 30515 raft_consensus.cc:1081] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Signalling peer d675d04b3c92496ca7f778728bc4b85a to start an election
I20260709 13:09:53.848104 30251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d"
dest_uuid: "d675d04b3c92496ca7f778728bc4b85a"
 from {username='slave'} at 127.0.0.1:50888
I20260709 13:09:53.848587 30251 raft_consensus.cc:493] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.848870 30251 raft_consensus.cc:3060] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.853595 30251 raft_consensus.cc:515] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:53.855152 30251 leader_election.cc:290] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 3 election: Requested vote from peers 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063), 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737)
I20260709 13:09:53.855989 30442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e952e3bfafb4f179ec3213c00d9f736"
I20260709 13:09:53.856312 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de48d8999657458bb81a7ab04f5c271d" candidate_uuid: "d675d04b3c92496ca7f778728bc4b85a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9062c84d046e46e6b5711bdc9a33fbbf"
I20260709 13:09:53.856714 30442 raft_consensus.cc:3060] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.856914 30179 raft_consensus.cc:3055] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.857275 30179 raft_consensus.cc:740] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9062c84d046e46e6b5711bdc9a33fbbf, State: Running, Role: LEADER
I20260709 13:09:53.857903 30179 consensus_queue.cc:260] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:53.858780 30179 raft_consensus.cc:3060] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.862958 30442 raft_consensus.cc:2468] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 3.
I20260709 13:09:53.863557 30179 raft_consensus.cc:2468] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d675d04b3c92496ca7f778728bc4b85a in term 3.
I20260709 13:09:53.864027 30219 leader_election.cc:304] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e952e3bfafb4f179ec3213c00d9f736, d675d04b3c92496ca7f778728bc4b85a; no voters: 
I20260709 13:09:53.864773 30552 raft_consensus.cc:2804] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.865150 30552 raft_consensus.cc:697] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 3 LEADER]: Becoming Leader. State: Replica: d675d04b3c92496ca7f778728bc4b85a, State: Running, Role: LEADER
I20260709 13:09:53.865892 30552 consensus_queue.cc:237] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } }
I20260709 13:09:53.872567 30001 catalog_manager.cc:5697] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a reported cstate change: term changed from 2 to 3, leader changed from 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2) to d675d04b3c92496ca7f778728bc4b85a (127.20.208.3). New cstate: current_term: 3 leader_uuid: "d675d04b3c92496ca7f778728bc4b85a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.003314 30442 raft_consensus.cc:1275] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:54.004624 30515 consensus_queue.cc:1048] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:54.014987 30251 raft_consensus.cc:1275] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Refusing update from remote peer 9062c84d046e46e6b5711bdc9a33fbbf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:54.016716 30515 consensus_queue.cc:1048] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d675d04b3c92496ca7f778728bc4b85a" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:54.149703 30179 raft_consensus.cc:1275] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:54.150872 30552 consensus_queue.cc:1048] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:54.159577 30442 raft_consensus.cc:1275] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:54.161104 30567 consensus_queue.cc:1048] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:54.270371 30050 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:54.387786 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:54.399019 30442 raft_consensus.cc:1275] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:54.401365 30567 consensus_queue.cc:1048] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e952e3bfafb4f179ec3213c00d9f736" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:54.411520 30179 raft_consensus.cc:1275] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Refusing update from remote peer d675d04b3c92496ca7f778728bc4b85a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:54.415596 30551 consensus_queue.cc:1048] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9062c84d046e46e6b5711bdc9a33fbbf" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:54.438241 21312 tablet_server.cc:179] TabletServer@127.20.208.1:36063 shutting down...
I20260709 13:09:54.466240 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:54.466969 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:54.467744 21312 raft_consensus.cc:2243] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.468289 21312 raft_consensus.cc:2272] T 7e671ab9b63344f1b72f6c57ac2bea6c P 3e952e3bfafb4f179ec3213c00d9f736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.470863 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:54.471470 21312 raft_consensus.cc:2243] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.472038 21312 raft_consensus.cc:2272] T 81a962f1eec84814884e1fcbf4887fdc P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.474677 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:54.475219 21312 raft_consensus.cc:2243] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.475749 21312 raft_consensus.cc:2272] T 3b0ef3f56c17410c979f8cb00e6b801f P 3e952e3bfafb4f179ec3213c00d9f736 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.478368 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:54.478917 21312 raft_consensus.cc:2243] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.479444 21312 raft_consensus.cc:2272] T 201a29d1ac264ecd816977549d0040b7 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.482141 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:54.482687 21312 raft_consensus.cc:2243] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.483146 21312 raft_consensus.cc:2272] T df00809a619241208b85bf7cb206ef0f P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.485790 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:54.486375 21312 raft_consensus.cc:2243] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.486927 21312 raft_consensus.cc:2272] T c89d407dd7214765b5cdb203b3ff2942 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.490370 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:54.490948 21312 raft_consensus.cc:2243] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.491397 21312 raft_consensus.cc:2272] T de48d8999657458bb81a7ab04f5c271d P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.494458 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:54.494966 21312 raft_consensus.cc:2243] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.495483 21312 raft_consensus.cc:2272] T a0046502fb2d447cb56e0a090a87f3ba P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.497967 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:54.498519 21312 raft_consensus.cc:2243] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.499029 21312 raft_consensus.cc:2272] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.501725 21312 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:54.502185 21312 raft_consensus.cc:2243] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.502897 21312 raft_consensus.cc:2272] T 289995462eb44ec2b6580123b389ed3c P 3e952e3bfafb4f179ec3213c00d9f736 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:54.532893 30145 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111) [suppressed 77 similar messages]
W20260709 13:09:54.536623 30145 consensus_peers.cc:597] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:54.539373 21312 tablet_server.cc:196] TabletServer@127.20.208.1:36063 shutdown complete.
I20260709 13:09:54.568087 21312 tablet_server.cc:179] TabletServer@127.20.208.2:0 shutting down...
I20260709 13:09:54.590183 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:54.590957 21312 tablet_replica.cc:333] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf: stopping tablet replica
I20260709 13:09:54.591706 21312 raft_consensus.cc:2243] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.592963 21312 raft_consensus.cc:2272] T 289995462eb44ec2b6580123b389ed3c P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.595961 21312 tablet_replica.cc:333] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf: stopping tablet replica
I20260709 13:09:54.596562 21312 raft_consensus.cc:2243] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.597465 21312 raft_consensus.cc:2272] T 201a29d1ac264ecd816977549d0040b7 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.600207 21312 tablet_replica.cc:333] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf: stopping tablet replica
I20260709 13:09:54.601083 21312 raft_consensus.cc:2243] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.601656 21312 raft_consensus.cc:2272] T a0046502fb2d447cb56e0a090a87f3ba P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.604677 21312 tablet_replica.cc:333] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf: stopping tablet replica
I20260709 13:09:54.605333 21312 raft_consensus.cc:2243] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.606030 21312 raft_consensus.cc:2272] T 3df95d7fddc24f3bb31f5ccaa560ee17 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.608855 21312 tablet_replica.cc:333] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf: stopping tablet replica
I20260709 13:09:54.609649 21312 raft_consensus.cc:2243] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.610309 21312 raft_consensus.cc:2272] T 81a962f1eec84814884e1fcbf4887fdc P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.613157 21312 tablet_replica.cc:333] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf: stopping tablet replica
I20260709 13:09:54.613831 21312 raft_consensus.cc:2243] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.615273 21312 raft_consensus.cc:2272] T 7e671ab9b63344f1b72f6c57ac2bea6c P 9062c84d046e46e6b5711bdc9a33fbbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.618362 21312 tablet_replica.cc:333] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf: stopping tablet replica
I20260709 13:09:54.619022 21312 raft_consensus.cc:2243] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.619681 21312 raft_consensus.cc:2272] T c89d407dd7214765b5cdb203b3ff2942 P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.623937 21312 tablet_replica.cc:333] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf: stopping tablet replica
I20260709 13:09:54.624809 21312 raft_consensus.cc:2243] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.626245 21312 raft_consensus.cc:2272] T df00809a619241208b85bf7cb206ef0f P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.629611 21312 tablet_replica.cc:333] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf: stopping tablet replica
I20260709 13:09:54.630285 21312 raft_consensus.cc:2243] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.630863 21312 raft_consensus.cc:2272] T de48d8999657458bb81a7ab04f5c271d P 9062c84d046e46e6b5711bdc9a33fbbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.634464 21312 tablet_replica.cc:333] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf: stopping tablet replica
I20260709 13:09:54.635078 21312 raft_consensus.cc:2243] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.636336 21312 raft_consensus.cc:2272] T 3b0ef3f56c17410c979f8cb00e6b801f P 9062c84d046e46e6b5711bdc9a33fbbf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:54.666553 30219 consensus_peers.cc:597] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a -> Peer 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737): Couldn't send request to peer 9062c84d046e46e6b5711bdc9a33fbbf. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:54.668500 30219 consensus_peers.cc:597] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a -> Peer 3e952e3bfafb4f179ec3213c00d9f736 (127.20.208.1:36063): Couldn't send request to peer 3e952e3bfafb4f179ec3213c00d9f736. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:54.671792 21312 tablet_server.cc:196] TabletServer@127.20.208.2:0 shutdown complete.
I20260709 13:09:54.698632 21312 tablet_server.cc:179] TabletServer@127.20.208.3:0 shutting down...
I20260709 13:09:54.721931 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:54.722700 21312 tablet_replica.cc:333] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a: stopping tablet replica
I20260709 13:09:54.723737 21312 raft_consensus.cc:2243] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.724534 21312 raft_consensus.cc:2272] T 201a29d1ac264ecd816977549d0040b7 P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.726967 21312 tablet_replica.cc:333] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a: stopping tablet replica
I20260709 13:09:54.727480 21312 raft_consensus.cc:2243] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.728021 21312 raft_consensus.cc:2272] T 289995462eb44ec2b6580123b389ed3c P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.731828 21312 tablet_replica.cc:333] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a: stopping tablet replica
I20260709 13:09:54.732702 21312 raft_consensus.cc:2243] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.733738 21312 raft_consensus.cc:2272] T 81a962f1eec84814884e1fcbf4887fdc P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.736127 21312 tablet_replica.cc:333] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a: stopping tablet replica
I20260709 13:09:54.736788 21312 raft_consensus.cc:2243] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.737324 21312 raft_consensus.cc:2272] T 7e671ab9b63344f1b72f6c57ac2bea6c P d675d04b3c92496ca7f778728bc4b85a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.739571 21312 tablet_replica.cc:333] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a: stopping tablet replica
I20260709 13:09:54.740164 21312 raft_consensus.cc:2243] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.741112 21312 raft_consensus.cc:2272] T a0046502fb2d447cb56e0a090a87f3ba P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.743462 21312 tablet_replica.cc:333] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a: stopping tablet replica
I20260709 13:09:54.744040 21312 raft_consensus.cc:2243] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.744995 21312 raft_consensus.cc:2272] T 3df95d7fddc24f3bb31f5ccaa560ee17 P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.747920 21312 tablet_replica.cc:333] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a: stopping tablet replica
I20260709 13:09:54.748696 21312 raft_consensus.cc:2243] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.749415 21312 raft_consensus.cc:2272] T 3b0ef3f56c17410c979f8cb00e6b801f P d675d04b3c92496ca7f778728bc4b85a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:54.750715 30219 consensus_peers.cc:597] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a -> Peer 9062c84d046e46e6b5711bdc9a33fbbf (127.20.208.2:42737): Couldn't send request to peer 9062c84d046e46e6b5711bdc9a33fbbf. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:42737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:54.752099 21312 tablet_replica.cc:333] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a: stopping tablet replica
I20260709 13:09:54.752790 21312 raft_consensus.cc:2243] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.753834 21312 raft_consensus.cc:2272] T c89d407dd7214765b5cdb203b3ff2942 P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.756911 21312 tablet_replica.cc:333] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a: stopping tablet replica
I20260709 13:09:54.757470 21312 raft_consensus.cc:2243] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.758369 21312 raft_consensus.cc:2272] T de48d8999657458bb81a7ab04f5c271d P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.761180 21312 tablet_replica.cc:333] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a: stopping tablet replica
I20260709 13:09:54.761694 21312 raft_consensus.cc:2243] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.762153 21312 raft_consensus.cc:2272] T df00809a619241208b85bf7cb206ef0f P d675d04b3c92496ca7f778728bc4b85a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.794831 21312 tablet_server.cc:196] TabletServer@127.20.208.3:0 shutdown complete.
I20260709 13:09:54.821789 21312 master.cc:562] Master@127.20.208.62:34371 shutting down...
I20260709 13:09:54.844496 21312 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.845122 21312 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.845432 21312 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2d6475598b4f4ba6b1e669150718017f: stopping tablet replica
I20260709 13:09:54.868691 21312 master.cc:584] Master@127.20.208.62:34371 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12809 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:09:54.920949 21312 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.208.62:36099
I20260709 13:09:54.922205 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:54.928709 30580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.928731 30579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.929581 30582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.932008 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:54.933234 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:54.933509 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:54.933703 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602594933687 us; error 0 us; skew 500 ppm
I20260709 13:09:54.934266 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:54.936791 21312 webserver.cc:533] Webserver started at http://127.20.208.62:32829/ using document root <none> and password file <none>
I20260709 13:09:54.937284 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:54.937446 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:54.937681 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:54.938907 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/master-0-root/instance:
uuid: "d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-6j4g"
I20260709 13:09:54.943648 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:09:54.947346 30587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.948102 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:54.948414 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/master-0-root
uuid: "d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-6j4g"
I20260709 13:09:54.948763 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:54.964285 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:54.965610 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:55.003840 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.62:36099
I20260709 13:09:55.003958 30638 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.62:36099 every 8 connection(s)
I20260709 13:09:55.008152 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.020951 30639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2: Bootstrap starting.
I20260709 13:09:55.026216 30639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.030758 30639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2: No bootstrap required, opened a new log
I20260709 13:09:55.033097 30639 raft_consensus.cc:359] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2" member_type: VOTER }
I20260709 13:09:55.033504 30639 raft_consensus.cc:385] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.033679 30639 raft_consensus.cc:740] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.034240 30639 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2" member_type: VOTER }
I20260709 13:09:55.034716 30639 raft_consensus.cc:399] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:55.034904 30639 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:55.035120 30639 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.039933 30639 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2" member_type: VOTER }
I20260709 13:09:55.040463 30639 leader_election.cc:304] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2; no voters: 
I20260709 13:09:55.044297 30639 leader_election.cc:290] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:55.044744 30642 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.047427 30642 raft_consensus.cc:697] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 1 LEADER]: Becoming Leader. State: Replica: d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2, State: Running, Role: LEADER
I20260709 13:09:55.047642 30639 sys_catalog.cc:565] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:55.048209 30642 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2" member_type: VOTER }
I20260709 13:09:55.052767 30643 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2" member_type: VOTER } }
I20260709 13:09:55.052870 30644 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2. Latest consensus state: current_term: 1 leader_uuid: "d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2" member_type: VOTER } }
I20260709 13:09:55.053450 30643 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:55.053483 30644 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:55.058919 30648 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:55.065078 30648 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:55.066179 21312 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:55.074656 30648 catalog_manager.cc:1383] Generated new cluster ID: 9c6f946c9c224294b4c847e14cd2f494
I20260709 13:09:55.074947 30648 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:55.101553 30648 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:55.102954 30648 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:55.117839 30648 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2: Generated new TSK 0
I20260709 13:09:55.118453 30648 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:55.133831 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:55.140285 30660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:55.140816 30661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:55.142450 30663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:55.143096 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:55.143987 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:55.144176 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:55.144358 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602595144337 us; error 0 us; skew 500 ppm
I20260709 13:09:55.144948 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:55.147397 21312 webserver.cc:533] Webserver started at http://127.20.208.1:40687/ using document root <none> and password file <none>
I20260709 13:09:55.147878 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:55.148056 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:55.148329 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:55.149549 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-0-root/instance:
uuid: "aff42ed0bf89412ea99a9cdf02bc3efd"
format_stamp: "Formatted at 2026-07-09 13:09:55 on dist-test-slave-6j4g"
I20260709 13:09:55.154552 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:55.158162 30668 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:55.158984 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:55.159302 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-0-root
uuid: "aff42ed0bf89412ea99a9cdf02bc3efd"
format_stamp: "Formatted at 2026-07-09 13:09:55 on dist-test-slave-6j4g"
I20260709 13:09:55.159586 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:55.174162 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:55.175400 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:55.176880 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:55.179276 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:55.179489 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:55.179719 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:55.179885 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:55.222257 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.1:46079
I20260709 13:09:55.222355 30730 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.1:46079 every 8 connection(s)
I20260709 13:09:55.227185 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:55.234786 30735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:55.236696 30736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:55.240268 21312 server_base.cc:1061] running on GCE node
W20260709 13:09:55.241514 30738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:55.242300 30731 heartbeater.cc:344] Connected to a master server at 127.20.208.62:36099
I20260709 13:09:55.242602 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:55.242697 30731 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:55.242884 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:55.243104 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602595243088 us; error 0 us; skew 500 ppm
I20260709 13:09:55.243582 30731 heartbeater.cc:507] Master 127.20.208.62:36099 requested a full tablet report, sending...
I20260709 13:09:55.243709 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:55.245859 30604 ts_manager.cc:194] Registered new tserver with Master: aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1:46079)
I20260709 13:09:55.246454 21312 webserver.cc:533] Webserver started at http://127.20.208.2:41577/ using document root <none> and password file <none>
I20260709 13:09:55.246985 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:55.247162 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:55.247401 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:55.247839 30604 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49430
I20260709 13:09:55.248685 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-1-root/instance:
uuid: "2af02d9b10f845aca683a4c2be53be5a"
format_stamp: "Formatted at 2026-07-09 13:09:55 on dist-test-slave-6j4g"
I20260709 13:09:55.253546 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:55.256897 30743 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:55.257656 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:55.257951 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-1-root
uuid: "2af02d9b10f845aca683a4c2be53be5a"
format_stamp: "Formatted at 2026-07-09 13:09:55 on dist-test-slave-6j4g"
I20260709 13:09:55.258224 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:55.280692 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:55.281896 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:55.283349 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:55.285655 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:55.285862 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:55.286099 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:55.286258 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:55.326184 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.2:46461
I20260709 13:09:55.326295 30805 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.2:46461 every 8 connection(s)
I20260709 13:09:55.331133 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:55.338972 30809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:55.339524 30810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:55.343077 21312 server_base.cc:1061] running on GCE node
W20260709 13:09:55.343539 30813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:55.344389 30806 heartbeater.cc:344] Connected to a master server at 127.20.208.62:36099
I20260709 13:09:55.344688 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:55.344851 30806 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:55.344995 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:55.345278 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602595345260 us; error 0 us; skew 500 ppm
I20260709 13:09:55.345796 30806 heartbeater.cc:507] Master 127.20.208.62:36099 requested a full tablet report, sending...
I20260709 13:09:55.345917 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:55.348102 30604 ts_manager.cc:194] Registered new tserver with Master: 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461)
I20260709 13:09:55.348835 21312 webserver.cc:533] Webserver started at http://127.20.208.3:33487/ using document root <none> and password file <none>
I20260709 13:09:55.349494 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:55.349695 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:55.349784 30604 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49432
I20260709 13:09:55.350008 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:55.351598 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-2-root/instance:
uuid: "4e22c98155a346ab866a931a3fb217e3"
format_stamp: "Formatted at 2026-07-09 13:09:55 on dist-test-slave-6j4g"
I20260709 13:09:55.356530 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:55.360113 30817 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:55.360991 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:55.361306 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-2-root
uuid: "4e22c98155a346ab866a931a3fb217e3"
format_stamp: "Formatted at 2026-07-09 13:09:55 on dist-test-slave-6j4g"
I20260709 13:09:55.361584 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326409895-21312-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:55.378228 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:55.379621 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:55.381193 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:55.383459 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:55.383666 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:55.383910 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:55.384060 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:55.424678 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.3:45187
I20260709 13:09:55.424757 30879 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.3:45187 every 8 connection(s)
I20260709 13:09:55.438439 30880 heartbeater.cc:344] Connected to a master server at 127.20.208.62:36099
I20260709 13:09:55.438858 30880 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:55.439584 30880 heartbeater.cc:507] Master 127.20.208.62:36099 requested a full tablet report, sending...
I20260709 13:09:55.441550 30604 ts_manager.cc:194] Registered new tserver with Master: 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3:45187)
I20260709 13:09:55.442582 21312 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014645995s
I20260709 13:09:55.442983 30604 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49434
I20260709 13:09:55.468783 30604 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49438:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:55.470992 30604 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:55.519904 30771 tablet_service.cc:1511] Processing CreateTablet for tablet f44439b785534a51bbd2c1251153d515 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=090d790b281149e386d736b5ae13128b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:55.521443 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44439b785534a51bbd2c1251153d515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.521596 30770 tablet_service.cc:1511] Processing CreateTablet for tablet 2e66ac9e3c944000bef17e1141170441 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=090d790b281149e386d736b5ae13128b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:55.523200 30770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e66ac9e3c944000bef17e1141170441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.530660 30696 tablet_service.cc:1511] Processing CreateTablet for tablet f44439b785534a51bbd2c1251153d515 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=090d790b281149e386d736b5ae13128b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:55.531198 30845 tablet_service.cc:1511] Processing CreateTablet for tablet f44439b785534a51bbd2c1251153d515 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=090d790b281149e386d736b5ae13128b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:55.532393 30696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44439b785534a51bbd2c1251153d515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.532665 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44439b785534a51bbd2c1251153d515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.530705 30695 tablet_service.cc:1511] Processing CreateTablet for tablet 2e66ac9e3c944000bef17e1141170441 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=090d790b281149e386d736b5ae13128b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:55.534548 30695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e66ac9e3c944000bef17e1141170441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.542666 30844 tablet_service.cc:1511] Processing CreateTablet for tablet 2e66ac9e3c944000bef17e1141170441 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=090d790b281149e386d736b5ae13128b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:55.544384 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e66ac9e3c944000bef17e1141170441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.547904 30895 tablet_bootstrap.cc:492] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a: Bootstrap starting.
I20260709 13:09:55.557794 30895 tablet_bootstrap.cc:654] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.567514 30895 tablet_bootstrap.cc:492] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a: No bootstrap required, opened a new log
I20260709 13:09:55.568208 30895 ts_tablet_manager.cc:1403] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:09:55.571800 30898 tablet_bootstrap.cc:492] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3: Bootstrap starting.
I20260709 13:09:55.572037 30896 tablet_bootstrap.cc:492] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd: Bootstrap starting.
I20260709 13:09:55.574947 30895 raft_consensus.cc:359] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:55.575790 30895 raft_consensus.cc:385] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.576117 30895 raft_consensus.cc:740] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af02d9b10f845aca683a4c2be53be5a, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.576979 30895 consensus_queue.cc:260] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:55.577943 30896 tablet_bootstrap.cc:654] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.580062 30898 tablet_bootstrap.cc:654] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.580564 30895 ts_tablet_manager.cc:1434] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 13:09:55.581439 30806 heartbeater.cc:499] Master 127.20.208.62:36099 was elected leader, sending a full tablet report...
I20260709 13:09:55.584846 30895 tablet_bootstrap.cc:492] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a: Bootstrap starting.
I20260709 13:09:55.586710 30898 tablet_bootstrap.cc:492] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3: No bootstrap required, opened a new log
I20260709 13:09:55.587240 30898 ts_tablet_manager.cc:1403] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:09:55.589020 30896 tablet_bootstrap.cc:492] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd: No bootstrap required, opened a new log
I20260709 13:09:55.589653 30896 ts_tablet_manager.cc:1403] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:09:55.590503 30898 raft_consensus.cc:359] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.591351 30898 raft_consensus.cc:385] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.591501 30895 tablet_bootstrap.cc:654] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.591717 30898 raft_consensus.cc:740] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e22c98155a346ab866a931a3fb217e3, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.592640 30898 consensus_queue.cc:260] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.592988 30896 raft_consensus.cc:359] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:55.593844 30896 raft_consensus.cc:385] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.594240 30896 raft_consensus.cc:740] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff42ed0bf89412ea99a9cdf02bc3efd, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.595317 30896 consensus_queue.cc:260] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:55.600809 30896 ts_tablet_manager.cc:1434] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.006s
I20260709 13:09:55.601686 30731 heartbeater.cc:499] Master 127.20.208.62:36099 was elected leader, sending a full tablet report...
I20260709 13:09:55.602710 30880 heartbeater.cc:499] Master 127.20.208.62:36099 was elected leader, sending a full tablet report...
I20260709 13:09:55.603798 30898 ts_tablet_manager.cc:1434] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:09:55.604967 30898 tablet_bootstrap.cc:492] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3: Bootstrap starting.
I20260709 13:09:55.605406 30895 tablet_bootstrap.cc:492] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a: No bootstrap required, opened a new log
I20260709 13:09:55.605960 30895 ts_tablet_manager.cc:1403] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.012s
I20260709 13:09:55.607533 30896 tablet_bootstrap.cc:492] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd: Bootstrap starting.
I20260709 13:09:55.611456 30898 tablet_bootstrap.cc:654] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.612241 30895 raft_consensus.cc:359] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.613128 30895 raft_consensus.cc:385] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.613464 30895 raft_consensus.cc:740] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af02d9b10f845aca683a4c2be53be5a, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.614334 30895 consensus_queue.cc:260] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.615361 30896 tablet_bootstrap.cc:654] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.619242 30895 ts_tablet_manager.cc:1434] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:55.626466 30896 tablet_bootstrap.cc:492] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd: No bootstrap required, opened a new log
I20260709 13:09:55.626941 30898 tablet_bootstrap.cc:492] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3: No bootstrap required, opened a new log
I20260709 13:09:55.627149 30896 ts_tablet_manager.cc:1403] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 13:09:55.627525 30898 ts_tablet_manager.cc:1403] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:09:55.630645 30896 raft_consensus.cc:359] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.630892 30898 raft_consensus.cc:359] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:55.631548 30896 raft_consensus.cc:385] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.631686 30898 raft_consensus.cc:385] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.631979 30896 raft_consensus.cc:740] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff42ed0bf89412ea99a9cdf02bc3efd, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.632082 30898 raft_consensus.cc:740] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e22c98155a346ab866a931a3fb217e3, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.633042 30898 consensus_queue.cc:260] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:55.632931 30896 consensus_queue.cc:260] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.635103 30898 ts_tablet_manager.cc:1434] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:55.637264 30896 ts_tablet_manager.cc:1434] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:09:55.703536 30902 raft_consensus.cc:493] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.704139 30902 raft_consensus.cc:515] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.706349 30902 leader_election.cc:290] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1:46079), 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461)
I20260709 13:09:55.715586 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e66ac9e3c944000bef17e1141170441" candidate_uuid: "4e22c98155a346ab866a931a3fb217e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" is_pre_election: true
I20260709 13:09:55.716328 30706 raft_consensus.cc:2468] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e22c98155a346ab866a931a3fb217e3 in term 0.
I20260709 13:09:55.716456 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e66ac9e3c944000bef17e1141170441" candidate_uuid: "4e22c98155a346ab866a931a3fb217e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af02d9b10f845aca683a4c2be53be5a" is_pre_election: true
I20260709 13:09:55.717222 30781 raft_consensus.cc:2468] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e22c98155a346ab866a931a3fb217e3 in term 0.
I20260709 13:09:55.717489 30821 leader_election.cc:304] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e22c98155a346ab866a931a3fb217e3, aff42ed0bf89412ea99a9cdf02bc3efd; no voters: 
I20260709 13:09:55.718319 30902 raft_consensus.cc:2804] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.718716 30902 raft_consensus.cc:493] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.719069 30902 raft_consensus.cc:3060] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.725852 30902 raft_consensus.cc:515] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.727955 30902 leader_election.cc:290] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [CANDIDATE]: Term 1 election: Requested vote from peers aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1:46079), 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461)
I20260709 13:09:55.728935 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e66ac9e3c944000bef17e1141170441" candidate_uuid: "4e22c98155a346ab866a931a3fb217e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd"
I20260709 13:09:55.729023 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e66ac9e3c944000bef17e1141170441" candidate_uuid: "4e22c98155a346ab866a931a3fb217e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af02d9b10f845aca683a4c2be53be5a"
I20260709 13:09:55.729696 30706 raft_consensus.cc:3060] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.729774 30781 raft_consensus.cc:3060] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.736078 30781 raft_consensus.cc:2468] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e22c98155a346ab866a931a3fb217e3 in term 1.
I20260709 13:09:55.736100 30706 raft_consensus.cc:2468] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e22c98155a346ab866a931a3fb217e3 in term 1.
I20260709 13:09:55.737329 30819 leader_election.cc:304] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af02d9b10f845aca683a4c2be53be5a, 4e22c98155a346ab866a931a3fb217e3; no voters: 
I20260709 13:09:55.738148 30902 raft_consensus.cc:2804] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.739005 30902 raft_consensus.cc:697] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 1 LEADER]: Becoming Leader. State: Replica: 4e22c98155a346ab866a931a3fb217e3, State: Running, Role: LEADER
I20260709 13:09:55.739722 30902 consensus_queue.cc:237] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.746954 30601 catalog_manager.cc:5697] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "4e22c98155a346ab866a931a3fb217e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.779176 30902 raft_consensus.cc:493] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.779800 30902 raft_consensus.cc:515] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:55.781574 30902 leader_election.cc:290] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461), aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1:46079)
I20260709 13:09:55.782528 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44439b785534a51bbd2c1251153d515" candidate_uuid: "4e22c98155a346ab866a931a3fb217e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af02d9b10f845aca683a4c2be53be5a" is_pre_election: true
I20260709 13:09:55.782557 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44439b785534a51bbd2c1251153d515" candidate_uuid: "4e22c98155a346ab866a931a3fb217e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" is_pre_election: true
I20260709 13:09:55.783211 30781 raft_consensus.cc:2468] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e22c98155a346ab866a931a3fb217e3 in term 0.
I20260709 13:09:55.783245 30706 raft_consensus.cc:2468] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e22c98155a346ab866a931a3fb217e3 in term 0.
I20260709 13:09:55.784281 30819 leader_election.cc:304] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af02d9b10f845aca683a4c2be53be5a, 4e22c98155a346ab866a931a3fb217e3; no voters: 
I20260709 13:09:55.784971 30902 raft_consensus.cc:2804] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.785261 30902 raft_consensus.cc:493] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.785531 30902 raft_consensus.cc:3060] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.790659 30902 raft_consensus.cc:515] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:55.792663 30902 leader_election.cc:290] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [CANDIDATE]: Term 1 election: Requested vote from peers 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461), aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1:46079)
I20260709 13:09:55.793489 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44439b785534a51bbd2c1251153d515" candidate_uuid: "4e22c98155a346ab866a931a3fb217e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af02d9b10f845aca683a4c2be53be5a"
I20260709 13:09:55.793641 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44439b785534a51bbd2c1251153d515" candidate_uuid: "4e22c98155a346ab866a931a3fb217e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd"
I20260709 13:09:55.794261 30781 raft_consensus.cc:3060] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.794317 30706 raft_consensus.cc:3060] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.801540 30706 raft_consensus.cc:2468] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e22c98155a346ab866a931a3fb217e3 in term 1.
I20260709 13:09:55.801540 30781 raft_consensus.cc:2468] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e22c98155a346ab866a931a3fb217e3 in term 1.
I20260709 13:09:55.802825 30819 leader_election.cc:304] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af02d9b10f845aca683a4c2be53be5a, 4e22c98155a346ab866a931a3fb217e3; no voters: 
I20260709 13:09:55.803476 30902 raft_consensus.cc:2804] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.803910 30902 raft_consensus.cc:697] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 1 LEADER]: Becoming Leader. State: Replica: 4e22c98155a346ab866a931a3fb217e3, State: Running, Role: LEADER
I20260709 13:09:55.804677 30902 consensus_queue.cc:237] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:55.811586 30601 catalog_manager.cc:5697] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "4e22c98155a346ab866a931a3fb217e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.886462 30601 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49446:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:55.888378 30601 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:55.911644 30696 tablet_service.cc:1511] Processing CreateTablet for tablet f2335a500d34470691df3b00834ee653 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7689049a934f4ae9bcc139a4c8a2e1e1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:55.913013 30696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2335a500d34470691df3b00834ee653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.912845 30771 tablet_service.cc:1511] Processing CreateTablet for tablet f2335a500d34470691df3b00834ee653 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7689049a934f4ae9bcc139a4c8a2e1e1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:55.914219 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2335a500d34470691df3b00834ee653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.914736 30844 tablet_service.cc:1511] Processing CreateTablet for tablet f2335a500d34470691df3b00834ee653 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7689049a934f4ae9bcc139a4c8a2e1e1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:55.916060 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2335a500d34470691df3b00834ee653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.918708 30695 tablet_service.cc:1511] Processing CreateTablet for tablet 8543a880f7dd4885bb15dbba1f1f2c51 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7689049a934f4ae9bcc139a4c8a2e1e1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:55.919780 30770 tablet_service.cc:1511] Processing CreateTablet for tablet 8543a880f7dd4885bb15dbba1f1f2c51 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7689049a934f4ae9bcc139a4c8a2e1e1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:55.921329 30770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8543a880f7dd4885bb15dbba1f1f2c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.922335 30845 tablet_service.cc:1511] Processing CreateTablet for tablet 8543a880f7dd4885bb15dbba1f1f2c51 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7689049a934f4ae9bcc139a4c8a2e1e1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:55.923928 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8543a880f7dd4885bb15dbba1f1f2c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.920187 30695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8543a880f7dd4885bb15dbba1f1f2c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.937947 30896 tablet_bootstrap.cc:492] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd: Bootstrap starting.
I20260709 13:09:55.942466 30895 tablet_bootstrap.cc:492] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a: Bootstrap starting.
I20260709 13:09:55.948613 30896 tablet_bootstrap.cc:654] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.949041 30895 tablet_bootstrap.cc:654] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.956233 30898 tablet_bootstrap.cc:492] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3: Bootstrap starting.
I20260709 13:09:55.958572 30896 tablet_bootstrap.cc:492] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd: No bootstrap required, opened a new log
I20260709 13:09:55.959198 30896 ts_tablet_manager.cc:1403] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.005s
I20260709 13:09:55.961530 30895 tablet_bootstrap.cc:492] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a: No bootstrap required, opened a new log
I20260709 13:09:55.962203 30895 ts_tablet_manager.cc:1403] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:09:55.962785 30896 raft_consensus.cc:359] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.963653 30896 raft_consensus.cc:385] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.964025 30896 raft_consensus.cc:740] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff42ed0bf89412ea99a9cdf02bc3efd, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.965004 30896 consensus_queue.cc:260] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.963716 30898 tablet_bootstrap.cc:654] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.965808 30895 raft_consensus.cc:359] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.966656 30895 raft_consensus.cc:385] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.967024 30895 raft_consensus.cc:740] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af02d9b10f845aca683a4c2be53be5a, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.967458 30896 ts_tablet_manager.cc:1434] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:55.967981 30895 consensus_queue.cc:260] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.968643 30896 tablet_bootstrap.cc:492] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd: Bootstrap starting.
I20260709 13:09:55.976009 30896 tablet_bootstrap.cc:654] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.977581 30895 ts_tablet_manager.cc:1434] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:55.983814 30895 tablet_bootstrap.cc:492] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a: Bootstrap starting.
I20260709 13:09:55.989780 30896 tablet_bootstrap.cc:492] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd: No bootstrap required, opened a new log
I20260709 13:09:55.990306 30896 ts_tablet_manager.cc:1403] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:09:55.991205 30898 tablet_bootstrap.cc:492] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3: No bootstrap required, opened a new log
I20260709 13:09:55.991434 30895 tablet_bootstrap.cc:654] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.991789 30898 ts_tablet_manager.cc:1403] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.012s
I20260709 13:09:55.993311 30896 raft_consensus.cc:359] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.994058 30896 raft_consensus.cc:385] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.994297 30896 raft_consensus.cc:740] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff42ed0bf89412ea99a9cdf02bc3efd, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.994946 30898 raft_consensus.cc:359] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.995132 30896 consensus_queue.cc:260] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.995568 30898 raft_consensus.cc:385] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.995978 30898 raft_consensus.cc:740] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e22c98155a346ab866a931a3fb217e3, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.997126 30895 tablet_bootstrap.cc:492] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a: No bootstrap required, opened a new log
I20260709 13:09:55.996934 30898 consensus_queue.cc:260] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:55.997490 30896 ts_tablet_manager.cc:1434] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:55.997687 30895 ts_tablet_manager.cc:1403] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:09:55.999267 30898 ts_tablet_manager.cc:1434] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:09:56.000376 30898 tablet_bootstrap.cc:492] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3: Bootstrap starting.
I20260709 13:09:56.000941 30895 raft_consensus.cc:359] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.001735 30895 raft_consensus.cc:385] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.002043 30895 raft_consensus.cc:740] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af02d9b10f845aca683a4c2be53be5a, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.003058 30895 consensus_queue.cc:260] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.005765 30895 ts_tablet_manager.cc:1434] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:09:56.008635 30898 tablet_bootstrap.cc:654] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.015767 30898 tablet_bootstrap.cc:492] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3: No bootstrap required, opened a new log
I20260709 13:09:56.016305 30898 ts_tablet_manager.cc:1403] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:09:56.018880 30898 raft_consensus.cc:359] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.019434 30898 raft_consensus.cc:385] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.019665 30898 raft_consensus.cc:740] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e22c98155a346ab866a931a3fb217e3, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.020262 30898 consensus_queue.cc:260] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.022279 30898 ts_tablet_manager.cc:1434] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:56.030355 30904 raft_consensus.cc:493] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.030857 30904 raft_consensus.cc:515] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.033108 30904 leader_election.cc:290] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461), 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3:45187)
I20260709 13:09:56.043048 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8543a880f7dd4885bb15dbba1f1f2c51" candidate_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af02d9b10f845aca683a4c2be53be5a" is_pre_election: true
I20260709 13:09:56.043757 30781 raft_consensus.cc:2468] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff42ed0bf89412ea99a9cdf02bc3efd in term 0.
I20260709 13:09:56.044373 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8543a880f7dd4885bb15dbba1f1f2c51" candidate_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e22c98155a346ab866a931a3fb217e3" is_pre_election: true
I20260709 13:09:56.044876 30670 leader_election.cc:304] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af02d9b10f845aca683a4c2be53be5a, aff42ed0bf89412ea99a9cdf02bc3efd; no voters: 
I20260709 13:09:56.044998 30855 raft_consensus.cc:2468] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff42ed0bf89412ea99a9cdf02bc3efd in term 0.
I20260709 13:09:56.045614 30904 raft_consensus.cc:2804] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:56.045992 30904 raft_consensus.cc:493] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.046321 30904 raft_consensus.cc:3060] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.054807 30904 raft_consensus.cc:515] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.057186 30904 leader_election.cc:290] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [CANDIDATE]: Term 1 election: Requested vote from peers 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461), 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3:45187)
I20260709 13:09:56.058396 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8543a880f7dd4885bb15dbba1f1f2c51" candidate_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af02d9b10f845aca683a4c2be53be5a"
I20260709 13:09:56.058620 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8543a880f7dd4885bb15dbba1f1f2c51" candidate_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e22c98155a346ab866a931a3fb217e3"
I20260709 13:09:56.059535 30781 raft_consensus.cc:3060] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.059630 30855 raft_consensus.cc:3060] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:56.061370 30652 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:56.063951 30904 raft_consensus.cc:493] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.064725 30904 raft_consensus.cc:515] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.067855 30904 leader_election.cc:290] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461), 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3:45187)
I20260709 13:09:56.069084 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2335a500d34470691df3b00834ee653" candidate_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af02d9b10f845aca683a4c2be53be5a" is_pre_election: true
I20260709 13:09:56.070135 30780 raft_consensus.cc:2468] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff42ed0bf89412ea99a9cdf02bc3efd in term 0.
I20260709 13:09:56.070525 30855 raft_consensus.cc:2468] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff42ed0bf89412ea99a9cdf02bc3efd in term 1.
I20260709 13:09:56.070573 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2335a500d34470691df3b00834ee653" candidate_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e22c98155a346ab866a931a3fb217e3" is_pre_election: true
I20260709 13:09:56.070523 30781 raft_consensus.cc:2468] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff42ed0bf89412ea99a9cdf02bc3efd in term 1.
I20260709 13:09:56.071619 30670 leader_election.cc:304] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af02d9b10f845aca683a4c2be53be5a, aff42ed0bf89412ea99a9cdf02bc3efd; no voters: 
I20260709 13:09:56.071704 30854 raft_consensus.cc:2468] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff42ed0bf89412ea99a9cdf02bc3efd in term 0.
I20260709 13:09:56.073437 30904 raft_consensus.cc:2804] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:56.073665 30670 leader_election.cc:304] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e22c98155a346ab866a931a3fb217e3, aff42ed0bf89412ea99a9cdf02bc3efd; no voters: 
I20260709 13:09:56.073958 30904 raft_consensus.cc:493] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.074456 30904 raft_consensus.cc:3060] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.075779 30924 raft_consensus.cc:2804] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:56.077404 30924 raft_consensus.cc:697] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 LEADER]: Becoming Leader. State: Replica: aff42ed0bf89412ea99a9cdf02bc3efd, State: Running, Role: LEADER
I20260709 13:09:56.078506 30924 consensus_queue.cc:237] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.085690 30904 raft_consensus.cc:515] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.088680 30904 leader_election.cc:290] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [CANDIDATE]: Term 1 election: Requested vote from peers 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461), 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3:45187)
I20260709 13:09:56.089527 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2335a500d34470691df3b00834ee653" candidate_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af02d9b10f845aca683a4c2be53be5a"
I20260709 13:09:56.090061 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2335a500d34470691df3b00834ee653" candidate_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e22c98155a346ab866a931a3fb217e3"
I20260709 13:09:56.090540 30781 raft_consensus.cc:3060] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.090950 30854 raft_consensus.cc:3060] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.093099 30601 catalog_manager.cc:5697] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd reported cstate change: term changed from 0 to 1, leader changed from <none> to aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1). New cstate: current_term: 1 leader_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.098371 30781 raft_consensus.cc:2468] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff42ed0bf89412ea99a9cdf02bc3efd in term 1.
I20260709 13:09:56.098865 30854 raft_consensus.cc:2468] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff42ed0bf89412ea99a9cdf02bc3efd in term 1.
I20260709 13:09:56.099707 30670 leader_election.cc:304] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af02d9b10f845aca683a4c2be53be5a, aff42ed0bf89412ea99a9cdf02bc3efd; no voters: 
I20260709 13:09:56.100425 30904 raft_consensus.cc:2804] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:56.100950 30904 raft_consensus.cc:697] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 LEADER]: Becoming Leader. State: Replica: aff42ed0bf89412ea99a9cdf02bc3efd, State: Running, Role: LEADER
I20260709 13:09:56.101596 30904 consensus_queue.cc:237] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.108682 30601 catalog_manager.cc:5697] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd reported cstate change: term changed from 0 to 1, leader changed from <none> to aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1). New cstate: current_term: 1 leader_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.137959 30854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f44439b785534a51bbd2c1251153d515"
dest_uuid: "4e22c98155a346ab866a931a3fb217e3"
mode: GRACEFUL
new_leader_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd"
 from {username='slave'} at 127.0.0.1:53684
I20260709 13:09:56.138573 30854 raft_consensus.cc:606] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 1 LEADER]: Received request to transfer leadership to TS aff42ed0bf89412ea99a9cdf02bc3efd
I20260709 13:09:56.144167 30854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e66ac9e3c944000bef17e1141170441"
dest_uuid: "4e22c98155a346ab866a931a3fb217e3"
mode: GRACEFUL
new_leader_uuid: "2af02d9b10f845aca683a4c2be53be5a"
 from {username='slave'} at 127.0.0.1:53684
I20260709 13:09:56.144757 30854 raft_consensus.cc:606] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 1 LEADER]: Received request to transfer leadership to TS 2af02d9b10f845aca683a4c2be53be5a
I20260709 13:09:56.178560 30902 consensus_queue.cc:1048] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.194669 30902 consensus_queue.cc:1048] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:56.196965 30902 consensus_queue.cc:1048] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.210960 30908 consensus_queue.cc:1048] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:56.226449 30931 raft_consensus.cc:993] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3: : Instructing follower 2af02d9b10f845aca683a4c2be53be5a to start an election
I20260709 13:09:56.226966 30908 raft_consensus.cc:1081] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 1 LEADER]: Signalling peer 2af02d9b10f845aca683a4c2be53be5a to start an election
I20260709 13:09:56.229640 30780 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e66ac9e3c944000bef17e1141170441"
dest_uuid: "2af02d9b10f845aca683a4c2be53be5a"
 from {username='slave'} at 127.0.0.1:44820
I20260709 13:09:56.232681 30780 raft_consensus.cc:493] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.233116 30780 raft_consensus.cc:3060] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.239226 30931 raft_consensus.cc:993] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3: : Instructing follower aff42ed0bf89412ea99a9cdf02bc3efd to start an election
I20260709 13:09:56.239732 30908 raft_consensus.cc:1081] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 1 LEADER]: Signalling peer aff42ed0bf89412ea99a9cdf02bc3efd to start an election
I20260709 13:09:56.241128 30780 raft_consensus.cc:515] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.241606 30706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f44439b785534a51bbd2c1251153d515"
dest_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd"
 from {username='slave'} at 127.0.0.1:47408
I20260709 13:09:56.242264 30706 raft_consensus.cc:493] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.242645 30706 raft_consensus.cc:3060] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.248957 30780 leader_election.cc:290] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [CANDIDATE]: Term 2 election: Requested vote from peers aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1:46079), 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3:45187)
I20260709 13:09:56.256211 30706 raft_consensus.cc:515] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:56.259083 30705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e66ac9e3c944000bef17e1141170441" candidate_uuid: "2af02d9b10f845aca683a4c2be53be5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd"
I20260709 13:09:56.259857 30705 raft_consensus.cc:3060] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.260239 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44439b785534a51bbd2c1251153d515" candidate_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2af02d9b10f845aca683a4c2be53be5a"
I20260709 13:09:56.260929 30780 raft_consensus.cc:3060] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.267690 30705 raft_consensus.cc:2468] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af02d9b10f845aca683a4c2be53be5a in term 2.
I20260709 13:09:56.267868 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44439b785534a51bbd2c1251153d515" candidate_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e22c98155a346ab866a931a3fb217e3"
I20260709 13:09:56.268649 30854 raft_consensus.cc:3055] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:56.268890 30780 raft_consensus.cc:2468] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff42ed0bf89412ea99a9cdf02bc3efd in term 2.
I20260709 13:09:56.269408 30854 raft_consensus.cc:740] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e22c98155a346ab866a931a3fb217e3, State: Running, Role: LEADER
I20260709 13:09:56.269551 30747 leader_election.cc:304] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af02d9b10f845aca683a4c2be53be5a, aff42ed0bf89412ea99a9cdf02bc3efd; no voters: 
I20260709 13:09:56.270237 30670 leader_election.cc:304] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af02d9b10f845aca683a4c2be53be5a, aff42ed0bf89412ea99a9cdf02bc3efd; no voters: 
I20260709 13:09:56.270597 30899 raft_consensus.cc:2804] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:56.270246 30854 consensus_queue.cc:260] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:56.271066 30904 raft_consensus.cc:2804] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:56.271485 30904 raft_consensus.cc:697] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 LEADER]: Becoming Leader. State: Replica: aff42ed0bf89412ea99a9cdf02bc3efd, State: Running, Role: LEADER
I20260709 13:09:56.271977 30854 raft_consensus.cc:3060] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.272233 30904 consensus_queue.cc:237] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } }
I20260709 13:09:56.272907 30899 raft_consensus.cc:697] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 2 LEADER]: Becoming Leader. State: Replica: 2af02d9b10f845aca683a4c2be53be5a, State: Running, Role: LEADER
I20260709 13:09:56.273864 30899 consensus_queue.cc:237] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.280314 30603 catalog_manager.cc:5697] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd reported cstate change: term changed from 1 to 2, leader changed from 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3) to aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1). New cstate: current_term: 2 leader_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.282369 30854 raft_consensus.cc:2468] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff42ed0bf89412ea99a9cdf02bc3efd in term 2.
I20260709 13:09:56.282933 30602 catalog_manager.cc:5697] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a reported cstate change: term changed from 1 to 2, leader changed from 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3) to 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2). New cstate: current_term: 2 leader_uuid: "2af02d9b10f845aca683a4c2be53be5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.286427 30706 leader_election.cc:290] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [CANDIDATE]: Term 2 election: Requested vote from peers 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461), 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3:45187)
I20260709 13:09:56.286674 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e66ac9e3c944000bef17e1141170441" candidate_uuid: "2af02d9b10f845aca683a4c2be53be5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e22c98155a346ab866a931a3fb217e3"
I20260709 13:09:56.287268 30855 raft_consensus.cc:3055] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:56.287619 30855 raft_consensus.cc:740] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e22c98155a346ab866a931a3fb217e3, State: Running, Role: LEADER
I20260709 13:09:56.288421 30855 consensus_queue.cc:260] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.289758 30855 raft_consensus.cc:3060] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.296665 30855 raft_consensus.cc:2468] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af02d9b10f845aca683a4c2be53be5a in term 2.
I20260709 13:09:56.339841 21312 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:09:56.341455 21312 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:09:56.341843 21312 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:09:56.353749 30706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8543a880f7dd4885bb15dbba1f1f2c51"
dest_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd"
mode: GRACEFUL
new_leader_uuid: "4e22c98155a346ab866a931a3fb217e3"
 from {username='slave'} at 127.0.0.1:47440
I20260709 13:09:56.354316 30706 raft_consensus.cc:606] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 LEADER]: Received request to transfer leadership to TS 4e22c98155a346ab866a931a3fb217e3
I20260709 13:09:56.355448 21312 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:09:56.473740 30904 consensus_queue.cc:1048] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.480466 30924 raft_consensus.cc:993] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd: : Instructing follower 4e22c98155a346ab866a931a3fb217e3 to start an election
I20260709 13:09:56.480983 30924 raft_consensus.cc:1081] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 LEADER]: Signalling peer 4e22c98155a346ab866a931a3fb217e3 to start an election
I20260709 13:09:56.484814 30854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8543a880f7dd4885bb15dbba1f1f2c51"
dest_uuid: "4e22c98155a346ab866a931a3fb217e3"
 from {username='slave'} at 127.0.0.1:53676
I20260709 13:09:56.485792 30854 raft_consensus.cc:493] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.486241 30854 raft_consensus.cc:3060] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.487043 30924 consensus_queue.cc:1048] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.496125 30854 raft_consensus.cc:515] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.499563 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8543a880f7dd4885bb15dbba1f1f2c51" candidate_uuid: "4e22c98155a346ab866a931a3fb217e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd"
I20260709 13:09:56.500187 30706 raft_consensus.cc:3055] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:56.500535 30706 raft_consensus.cc:740] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aff42ed0bf89412ea99a9cdf02bc3efd, State: Running, Role: LEADER
I20260709 13:09:56.500537 30854 leader_election.cc:290] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [CANDIDATE]: Term 2 election: Requested vote from peers aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1:46079), 2af02d9b10f845aca683a4c2be53be5a (127.20.208.2:46461)
I20260709 13:09:56.501398 30706 consensus_queue.cc:260] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.502633 30706 raft_consensus.cc:3060] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.504624 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8543a880f7dd4885bb15dbba1f1f2c51" candidate_uuid: "4e22c98155a346ab866a931a3fb217e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2af02d9b10f845aca683a4c2be53be5a"
I20260709 13:09:56.505262 30780 raft_consensus.cc:3060] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.507961 30706 raft_consensus.cc:2468] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e22c98155a346ab866a931a3fb217e3 in term 2.
I20260709 13:09:56.509251 30821 leader_election.cc:304] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e22c98155a346ab866a931a3fb217e3, aff42ed0bf89412ea99a9cdf02bc3efd; no voters: 
I20260709 13:09:56.509905 30908 raft_consensus.cc:2804] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:56.510284 30908 raft_consensus.cc:697] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 2 LEADER]: Becoming Leader. State: Replica: 4e22c98155a346ab866a931a3fb217e3, State: Running, Role: LEADER
I20260709 13:09:56.511013 30908 consensus_queue.cc:237] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } }
I20260709 13:09:56.511495 30780 raft_consensus.cc:2468] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e22c98155a346ab866a931a3fb217e3 in term 2.
I20260709 13:09:56.516757 30603 catalog_manager.cc:5697] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 reported cstate change: term changed from 1 to 2, leader changed from aff42ed0bf89412ea99a9cdf02bc3efd (127.20.208.1) to 4e22c98155a346ab866a931a3fb217e3 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "4e22c98155a346ab866a931a3fb217e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff42ed0bf89412ea99a9cdf02bc3efd" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2af02d9b10f845aca683a4c2be53be5a" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 46461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e22c98155a346ab866a931a3fb217e3" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 45187 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.571750 21312 tablet_server.cc:179] TabletServer@127.20.208.1:0 shutting down...
I20260709 13:09:56.590271 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:56.590850 21312 tablet_replica.cc:333] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd: stopping tablet replica
I20260709 13:09:56.591367 21312 raft_consensus.cc:2243] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.591769 21312 raft_consensus.cc:2272] T 8543a880f7dd4885bb15dbba1f1f2c51 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.593894 21312 tablet_replica.cc:333] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd: stopping tablet replica
I20260709 13:09:56.594416 21312 raft_consensus.cc:2243] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.594966 21312 pending_rounds.cc:70] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd: Trying to abort 1 pending ops.
I20260709 13:09:56.595124 21312 pending_rounds.cc:77] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636233640574976 op_type: NO_OP noop_request { }
I20260709 13:09:56.595377 21312 raft_consensus.cc:2889] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:56.595598 21312 raft_consensus.cc:2272] T f2335a500d34470691df3b00834ee653 P aff42ed0bf89412ea99a9cdf02bc3efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.597728 21312 tablet_replica.cc:333] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd: stopping tablet replica
I20260709 13:09:56.598227 21312 raft_consensus.cc:2243] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.598584 21312 raft_consensus.cc:2272] T 2e66ac9e3c944000bef17e1141170441 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.600764 21312 tablet_replica.cc:333] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd: stopping tablet replica
I20260709 13:09:56.601261 21312 raft_consensus.cc:2243] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.601853 21312 pending_rounds.cc:70] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd: Trying to abort 1 pending ops.
I20260709 13:09:56.602015 21312 pending_rounds.cc:77] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636234340458496 op_type: NO_OP noop_request { }
I20260709 13:09:56.602273 21312 raft_consensus.cc:2889] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:56.602523 21312 raft_consensus.cc:2272] T f44439b785534a51bbd2c1251153d515 P aff42ed0bf89412ea99a9cdf02bc3efd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.625204 21312 tablet_server.cc:196] TabletServer@127.20.208.1:0 shutdown complete.
I20260709 13:09:56.637668 21312 tablet_server.cc:179] TabletServer@127.20.208.2:0 shutting down...
I20260709 13:09:56.654227 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:56.654846 21312 tablet_replica.cc:333] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a: stopping tablet replica
I20260709 13:09:56.655395 21312 raft_consensus.cc:2243] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.655853 21312 raft_consensus.cc:2272] T 8543a880f7dd4885bb15dbba1f1f2c51 P 2af02d9b10f845aca683a4c2be53be5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.658507 21312 tablet_replica.cc:333] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a: stopping tablet replica
I20260709 13:09:56.659090 21312 raft_consensus.cc:2243] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.659530 21312 raft_consensus.cc:2272] T f2335a500d34470691df3b00834ee653 P 2af02d9b10f845aca683a4c2be53be5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.661739 21312 tablet_replica.cc:333] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a: stopping tablet replica
I20260709 13:09:56.662189 21312 raft_consensus.cc:2243] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.662776 21312 pending_rounds.cc:70] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a: Trying to abort 1 pending ops.
I20260709 13:09:56.662958 21312 pending_rounds.cc:77] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636234352025600 op_type: NO_OP noop_request { }
I20260709 13:09:56.663229 21312 raft_consensus.cc:2889] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:56.663511 21312 raft_consensus.cc:2272] T 2e66ac9e3c944000bef17e1141170441 P 2af02d9b10f845aca683a4c2be53be5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.665881 21312 tablet_replica.cc:333] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a: stopping tablet replica
I20260709 13:09:56.666348 21312 raft_consensus.cc:2243] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.666711 21312 raft_consensus.cc:2272] T f44439b785534a51bbd2c1251153d515 P 2af02d9b10f845aca683a4c2be53be5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.689241 21312 tablet_server.cc:196] TabletServer@127.20.208.2:0 shutdown complete.
I20260709 13:09:56.701037 21312 tablet_server.cc:179] TabletServer@127.20.208.3:0 shutting down...
I20260709 13:09:56.718993 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:56.719655 21312 tablet_replica.cc:333] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3: stopping tablet replica
I20260709 13:09:56.720238 21312 raft_consensus.cc:2243] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.720714 21312 raft_consensus.cc:2272] T f44439b785534a51bbd2c1251153d515 P 4e22c98155a346ab866a931a3fb217e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.723093 21312 tablet_replica.cc:333] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3: stopping tablet replica
I20260709 13:09:56.723600 21312 raft_consensus.cc:2243] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.723979 21312 raft_consensus.cc:2272] T f2335a500d34470691df3b00834ee653 P 4e22c98155a346ab866a931a3fb217e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.725925 21312 tablet_replica.cc:333] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3: stopping tablet replica
I20260709 13:09:56.726356 21312 raft_consensus.cc:2243] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.726912 21312 pending_rounds.cc:70] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3: Trying to abort 1 pending ops.
I20260709 13:09:56.727080 21312 pending_rounds.cc:77] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636235316391936 op_type: NO_OP noop_request { }
I20260709 13:09:56.727299 21312 raft_consensus.cc:2889] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:56.727509 21312 raft_consensus.cc:2272] T 8543a880f7dd4885bb15dbba1f1f2c51 P 4e22c98155a346ab866a931a3fb217e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.729926 21312 tablet_replica.cc:333] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3: stopping tablet replica
I20260709 13:09:56.730376 21312 raft_consensus.cc:2243] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.730746 21312 raft_consensus.cc:2272] T 2e66ac9e3c944000bef17e1141170441 P 4e22c98155a346ab866a931a3fb217e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.744822 21312 tablet_server.cc:196] TabletServer@127.20.208.3:0 shutdown complete.
I20260709 13:09:56.757161 21312 master.cc:562] Master@127.20.208.62:36099 shutting down...
I20260709 13:09:56.779577 21312 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.780249 21312 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.780637 21312 tablet_replica.cc:333] T 00000000000000000000000000000000 P d2ee6f2d1a6b4bd6a9a8e7912c5fa4a2: stopping tablet replica
I20260709 13:09:56.800695 21312 master.cc:584] Master@127.20.208.62:36099 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (1910 ms)
[----------] 6 tests from LeaderRebalancerTest (270258 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:09:56.831995 21312 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.208.62:35955
I20260709 13:09:56.833139 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:56.838009 30945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:56.838224 30946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:56.839978 30948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:56.840812 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:56.841629 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:56.841809 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:56.841960 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602596841943 us; error 0 us; skew 500 ppm
I20260709 13:09:56.842509 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:56.844892 21312 webserver.cc:533] Webserver started at http://127.20.208.62:34993/ using document root <none> and password file <none>
I20260709 13:09:56.845396 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:56.845572 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:56.845829 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:56.846876 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/master-0-root/instance:
uuid: "6e4aa2f2127b4332916b420a677aa85d"
format_stamp: "Formatted at 2026-07-09 13:09:56 on dist-test-slave-6j4g"
I20260709 13:09:56.851418 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:09:56.855194 30953 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:56.855979 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:56.856246 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/master-0-root
uuid: "6e4aa2f2127b4332916b420a677aa85d"
format_stamp: "Formatted at 2026-07-09 13:09:56 on dist-test-slave-6j4g"
I20260709 13:09:56.856614 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:56.869611 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:56.870621 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:56.905372 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.62:35955
I20260709 13:09:56.905464 31004 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.62:35955 every 8 connection(s)
I20260709 13:09:56.909101 31005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:56.920529 31005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d: Bootstrap starting.
I20260709 13:09:56.925040 31005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.929179 31005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d: No bootstrap required, opened a new log
I20260709 13:09:56.931280 31005 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e4aa2f2127b4332916b420a677aa85d" member_type: VOTER }
I20260709 13:09:56.931677 31005 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.931886 31005 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4aa2f2127b4332916b420a677aa85d, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.932447 31005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e4aa2f2127b4332916b420a677aa85d" member_type: VOTER }
I20260709 13:09:56.932919 31005 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:56.933106 31005 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:56.933314 31005 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.938038 31005 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e4aa2f2127b4332916b420a677aa85d" member_type: VOTER }
I20260709 13:09:56.938545 31005 leader_election.cc:304] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e4aa2f2127b4332916b420a677aa85d; no voters: 
I20260709 13:09:56.939627 31005 leader_election.cc:290] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:56.939968 31008 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:56.941296 31008 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 1 LEADER]: Becoming Leader. State: Replica: 6e4aa2f2127b4332916b420a677aa85d, State: Running, Role: LEADER
I20260709 13:09:56.942004 31008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e4aa2f2127b4332916b420a677aa85d" member_type: VOTER }
I20260709 13:09:56.942482 31005 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:56.944918 31009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e4aa2f2127b4332916b420a677aa85d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e4aa2f2127b4332916b420a677aa85d" member_type: VOTER } }
I20260709 13:09:56.945123 31010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e4aa2f2127b4332916b420a677aa85d. Latest consensus state: current_term: 1 leader_uuid: "6e4aa2f2127b4332916b420a677aa85d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e4aa2f2127b4332916b420a677aa85d" member_type: VOTER } }
I20260709 13:09:56.945618 31009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:56.945744 31010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:56.948719 31013 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:56.953718 31013 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:56.957793 21312 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:56.962873 31013 catalog_manager.cc:1383] Generated new cluster ID: 83b0e090e32445298a28dbad043f68ec
I20260709 13:09:56.963187 31013 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:56.980397 31013 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:56.981788 31013 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:56.995126 31013 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d: Generated new TSK 0
I20260709 13:09:56.995777 31013 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:57.024365 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:57.030233 31026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.030999 31027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.032684 31029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.033272 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:57.034080 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:57.034271 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:57.034390 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602597034379 us; error 0 us; skew 500 ppm
I20260709 13:09:57.034844 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:57.037000 21312 webserver.cc:533] Webserver started at http://127.20.208.1:38853/ using document root <none> and password file <none>
I20260709 13:09:57.037449 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:57.037598 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:57.037799 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:57.038831 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-0-root/instance:
uuid: "ce05d2e38f184bc19df1fc532f05fa23"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-6j4g"
I20260709 13:09:57.044199 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:57.049060 31034 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.050091 21312 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:09:57.050420 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-0-root
uuid: "ce05d2e38f184bc19df1fc532f05fa23"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-6j4g"
I20260709 13:09:57.050704 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:57.062553 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:57.063727 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:57.065181 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:57.067476 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:57.067662 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.067902 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:57.068041 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.112322 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.1:38027
I20260709 13:09:57.112447 31096 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.1:38027 every 8 connection(s)
I20260709 13:09:57.117388 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:57.123754 31101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.127377 31102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.128427 31104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.128707 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:57.129946 31097 heartbeater.cc:344] Connected to a master server at 127.20.208.62:35955
I20260709 13:09:57.130200 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:57.130342 31097 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:57.130491 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:57.130743 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602597130726 us; error 0 us; skew 500 ppm
I20260709 13:09:57.131240 31097 heartbeater.cc:507] Master 127.20.208.62:35955 requested a full tablet report, sending...
I20260709 13:09:57.131325 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:57.133522 30970 ts_manager.cc:194] Registered new tserver with Master: ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027)
I20260709 13:09:57.134200 21312 webserver.cc:533] Webserver started at http://127.20.208.2:36239/ using document root <none> and password file <none>
I20260709 13:09:57.134747 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:57.134922 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:57.135174 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:57.135465 30970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37908
I20260709 13:09:57.136303 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-1-root/instance:
uuid: "d42393166e884a13a08fb2fe119629f2"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-6j4g"
I20260709 13:09:57.141034 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:57.144325 31109 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.145293 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:57.145582 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-1-root
uuid: "d42393166e884a13a08fb2fe119629f2"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-6j4g"
I20260709 13:09:57.145826 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:57.158164 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:57.159271 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:57.160722 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:57.162981 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:57.163196 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.163421 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:57.163571 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.200436 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.2:36033
I20260709 13:09:57.200587 31171 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.2:36033 every 8 connection(s)
I20260709 13:09:57.205148 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:57.211997 31175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.212783 31176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.216325 21312 server_base.cc:1061] running on GCE node
I20260709 13:09:57.217162 31172 heartbeater.cc:344] Connected to a master server at 127.20.208.62:35955
W20260709 13:09:57.217368 31179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.217653 31172 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:57.218356 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:57.218467 31172 heartbeater.cc:507] Master 127.20.208.62:35955 requested a full tablet report, sending...
W20260709 13:09:57.218644 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:57.218916 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602597218900 us; error 0 us; skew 500 ppm
I20260709 13:09:57.219614 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:57.220770 30970 ts_manager.cc:194] Registered new tserver with Master: d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:09:57.222266 30970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37924
I20260709 13:09:57.222421 21312 webserver.cc:533] Webserver started at http://127.20.208.3:38631/ using document root <none> and password file <none>
I20260709 13:09:57.223039 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:57.223273 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:57.223582 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:57.224714 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-2-root/instance:
uuid: "5d80126ecf5f4933a6e789800f96c5f4"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-6j4g"
I20260709 13:09:57.229089 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:57.232424 31183 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.233341 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:57.233640 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-2-root
uuid: "5d80126ecf5f4933a6e789800f96c5f4"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-6j4g"
I20260709 13:09:57.233909 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326409895-21312-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:57.252579 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:57.253661 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:57.255026 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:57.257380 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:57.257591 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.257818 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:57.257972 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.295640 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.3:35053
I20260709 13:09:57.295756 31245 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.3:35053 every 8 connection(s)
I20260709 13:09:57.309237 31246 heartbeater.cc:344] Connected to a master server at 127.20.208.62:35955
I20260709 13:09:57.309712 31246 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:57.310493 31246 heartbeater.cc:507] Master 127.20.208.62:35955 requested a full tablet report, sending...
I20260709 13:09:57.312592 30970 ts_manager.cc:194] Registered new tserver with Master: 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:57.313484 21312 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01457042s
I20260709 13:09:57.314041 30970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37940
I20260709 13:09:57.340380 30970 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37944:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:57.343009 30970 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:57.405857 31062 tablet_service.cc:1511] Processing CreateTablet for tablet ce396f6423ca457bbe84ae15fe26aa3e (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:57.407435 31062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce396f6423ca457bbe84ae15fe26aa3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.414193 31061 tablet_service.cc:1511] Processing CreateTablet for tablet b2402ee9214c4f5ea568e3d3816e9b52 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:57.415831 31061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2402ee9214c4f5ea568e3d3816e9b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.418511 31060 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3fd74c378e4e76b9969c930b4a451d (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:57.421182 31059 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8fb42087c24f308459e5024c577187 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:57.430855 31059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8fb42087c24f308459e5024c577187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.429915 31058 tablet_service.cc:1511] Processing CreateTablet for tablet ec2d68a877274a1eb3d47c3962b21cef (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:57.432430 31060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3fd74c378e4e76b9969c930b4a451d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.434700 31058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2d68a877274a1eb3d47c3962b21cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.437541 31057 tablet_service.cc:1511] Processing CreateTablet for tablet de6dd49ffeca47138091d11fab77470d (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:57.438120 31137 tablet_service.cc:1511] Processing CreateTablet for tablet ce396f6423ca457bbe84ae15fe26aa3e (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:57.439566 31137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce396f6423ca457bbe84ae15fe26aa3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.441598 31136 tablet_service.cc:1511] Processing CreateTablet for tablet b2402ee9214c4f5ea568e3d3816e9b52 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:57.443044 31136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2402ee9214c4f5ea568e3d3816e9b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.445269 31135 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3fd74c378e4e76b9969c930b4a451d (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:57.447000 31135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3fd74c378e4e76b9969c930b4a451d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.447072 31057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6dd49ffeca47138091d11fab77470d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.449829 31134 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8fb42087c24f308459e5024c577187 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:57.451498 31134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8fb42087c24f308459e5024c577187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.454759 31133 tablet_service.cc:1511] Processing CreateTablet for tablet ec2d68a877274a1eb3d47c3962b21cef (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:57.457680 31209 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3fd74c378e4e76b9969c930b4a451d (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:57.459270 31209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3fd74c378e4e76b9969c930b4a451d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.461699 31208 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8fb42087c24f308459e5024c577187 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:57.462425 31261 tablet_bootstrap.cc:492] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:09:57.463289 31208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8fb42087c24f308459e5024c577187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.466213 31207 tablet_service.cc:1511] Processing CreateTablet for tablet ec2d68a877274a1eb3d47c3962b21cef (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:57.467808 31207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2d68a877274a1eb3d47c3962b21cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.469447 31261 tablet_bootstrap.cc:654] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.471675 31210 tablet_service.cc:1511] Processing CreateTablet for tablet b2402ee9214c4f5ea568e3d3816e9b52 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:57.473526 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2402ee9214c4f5ea568e3d3816e9b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.473596 31211 tablet_service.cc:1511] Processing CreateTablet for tablet ce396f6423ca457bbe84ae15fe26aa3e (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:57.456355 31133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2d68a877274a1eb3d47c3962b21cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.476449 31211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce396f6423ca457bbe84ae15fe26aa3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.500681 31262 tablet_bootstrap.cc:492] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:09:57.506970 31262 tablet_bootstrap.cc:654] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.516515 31261 tablet_bootstrap.cc:492] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:09:57.517204 31261 ts_tablet_manager.cc:1403] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.000s
I20260709 13:09:57.523614 31132 tablet_service.cc:1511] Processing CreateTablet for tablet de6dd49ffeca47138091d11fab77470d (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:57.526117 31132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6dd49ffeca47138091d11fab77470d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.526050 31210 tablet_service.cc:1511] Processing CreateTablet for tablet de6dd49ffeca47138091d11fab77470d (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:57.528314 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6dd49ffeca47138091d11fab77470d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.521667 31261 raft_consensus.cc:359] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:09:57.547575 31261 raft_consensus.cc:385] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.547915 31261 raft_consensus.cc:740] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.548169 31057 tablet_service.cc:1511] Processing CreateTablet for tablet c9a63f3b41bc43c584f8ccb597e99142 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:57.550401 31057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a63f3b41bc43c584f8ccb597e99142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.558188 31261 consensus_queue.cc:260] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:09:57.562709 31264 tablet_bootstrap.cc:492] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:09:57.565130 31136 tablet_service.cc:1511] Processing CreateTablet for tablet c9a63f3b41bc43c584f8ccb597e99142 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:57.566465 31136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a63f3b41bc43c584f8ccb597e99142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.575114 31264 tablet_bootstrap.cc:654] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.576772 31060 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc088e451c3470787cf7bdd4872aa63 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:57.578127 31060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc088e451c3470787cf7bdd4872aa63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.576659 31210 tablet_service.cc:1511] Processing CreateTablet for tablet c9a63f3b41bc43c584f8ccb597e99142 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:57.581570 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a63f3b41bc43c584f8ccb597e99142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.582912 31137 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc088e451c3470787cf7bdd4872aa63 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:57.584654 31097 heartbeater.cc:499] Master 127.20.208.62:35955 was elected leader, sending a full tablet report...
I20260709 13:09:57.585160 31261 ts_tablet_manager.cc:1434] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.068s	user 0.018s	sys 0.005s
I20260709 13:09:57.586385 31261 tablet_bootstrap.cc:492] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:09:57.588673 31137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc088e451c3470787cf7bdd4872aa63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.592445 31261 tablet_bootstrap.cc:654] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.598616 31262 tablet_bootstrap.cc:492] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:09:57.599146 31262 ts_tablet_manager.cc:1403] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.006s
I20260709 13:09:57.599184 31209 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc088e451c3470787cf7bdd4872aa63 (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:57.601807 31209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc088e451c3470787cf7bdd4872aa63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.610626 31264 tablet_bootstrap.cc:492] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:09:57.611267 31264 ts_tablet_manager.cc:1403] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.006s
I20260709 13:09:57.614012 31264 raft_consensus.cc:359] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.614661 31264 raft_consensus.cc:385] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.614966 31264 raft_consensus.cc:740] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.615742 31264 consensus_queue.cc:260] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.620781 31133 tablet_service.cc:1511] Processing CreateTablet for tablet 1e20bdc4bdb049279a21da9073cf49fb (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:57.622129 31133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e20bdc4bdb049279a21da9073cf49fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.620250 31262 raft_consensus.cc:359] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.623153 31057 tablet_service.cc:1511] Processing CreateTablet for tablet 1e20bdc4bdb049279a21da9073cf49fb (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:57.629386 31057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e20bdc4bdb049279a21da9073cf49fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.630687 31261 tablet_bootstrap.cc:492] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:09:57.631246 31261 ts_tablet_manager.cc:1403] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:09:57.625712 31172 heartbeater.cc:499] Master 127.20.208.62:35955 was elected leader, sending a full tablet report...
I20260709 13:09:57.626209 31264 ts_tablet_manager.cc:1434] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.006s
I20260709 13:09:57.633675 31264 tablet_bootstrap.cc:492] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:09:57.640161 31264 tablet_bootstrap.cc:654] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.641867 31210 tablet_service.cc:1511] Processing CreateTablet for tablet 1e20bdc4bdb049279a21da9073cf49fb (DEFAULT_TABLE table=test-workload [id=c6f7e2f98eb9426f909402c5ce757141]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:57.643380 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e20bdc4bdb049279a21da9073cf49fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.644266 31262 raft_consensus.cc:385] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.642040 31261 raft_consensus.cc:359] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.644658 31262 raft_consensus.cc:740] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.644892 31261 raft_consensus.cc:385] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.645287 31261 raft_consensus.cc:740] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.645599 31262 consensus_queue.cc:260] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.646145 31261 consensus_queue.cc:260] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.648567 31261 ts_tablet_manager.cc:1434] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:09:57.649554 31261 tablet_bootstrap.cc:492] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:09:57.657192 31246 heartbeater.cc:499] Master 127.20.208.62:35955 was elected leader, sending a full tablet report...
I20260709 13:09:57.657109 31262 ts_tablet_manager.cc:1434] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:09:57.659611 31262 tablet_bootstrap.cc:492] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:09:57.666613 31264 tablet_bootstrap.cc:492] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:09:57.667196 31264 ts_tablet_manager.cc:1403] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.005s
I20260709 13:09:57.667848 31261 tablet_bootstrap.cc:654] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.670071 31264 raft_consensus.cc:359] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.670868 31264 raft_consensus.cc:385] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.671159 31264 raft_consensus.cc:740] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.671701 31262 tablet_bootstrap.cc:654] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.671969 31264 consensus_queue.cc:260] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.674757 31264 ts_tablet_manager.cc:1434] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:57.675768 31264 tablet_bootstrap.cc:492] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:09:57.679787 31261 tablet_bootstrap.cc:492] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:09:57.680366 31261 ts_tablet_manager.cc:1403] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:09:57.681699 31264 tablet_bootstrap.cc:654] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.683282 31261 raft_consensus.cc:359] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.684177 31261 raft_consensus.cc:385] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.684512 31261 raft_consensus.cc:740] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.685444 31261 consensus_queue.cc:260] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.687943 31261 ts_tablet_manager.cc:1434] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:57.689138 31266 raft_consensus.cc:493] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.689802 31266 raft_consensus.cc:515] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.694146 31266 leader_election.cc:290] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:57.695713 31271 raft_consensus.cc:493] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.696386 31262 tablet_bootstrap.cc:492] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:09:57.697073 31262 ts_tablet_manager.cc:1403] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.008s
I20260709 13:09:57.696305 31271 raft_consensus.cc:515] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.689168 31261 tablet_bootstrap.cc:492] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:09:57.702364 31264 tablet_bootstrap.cc:492] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:09:57.703024 31264 ts_tablet_manager.cc:1403] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.012s
I20260709 13:09:57.707139 31271 leader_election.cc:290] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:09:57.712195 31261 tablet_bootstrap.cc:654] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.700316 31262 raft_consensus.cc:359] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.713258 31262 raft_consensus.cc:385] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.713554 31262 raft_consensus.cc:740] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.714300 31262 consensus_queue.cc:260] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.718937 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2402ee9214c4f5ea568e3d3816e9b52" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:09:57.723142 31262 ts_tablet_manager.cc:1434] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
W20260709 13:09:57.724920 31184 leader_election.cc:343] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.742020 31262 tablet_bootstrap.cc:492] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:09:57.749579 31264 raft_consensus.cc:359] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.750671 31264 raft_consensus.cc:385] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.751053 31264 raft_consensus.cc:740] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.752040 31264 consensus_queue.cc:260] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.758117 31264 ts_tablet_manager.cc:1434] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.005s
I20260709 13:09:57.759968 31264 tablet_bootstrap.cc:492] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:09:57.768452 31264 tablet_bootstrap.cc:654] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.773449 31262 tablet_bootstrap.cc:654] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.778523 31261 tablet_bootstrap.cc:492] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:09:57.779173 31261 ts_tablet_manager.cc:1403] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.004s
I20260709 13:09:57.781347 31264 tablet_bootstrap.cc:492] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:09:57.781967 31264 ts_tablet_manager.cc:1403] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.008s
I20260709 13:09:57.782371 31261 raft_consensus.cc:359] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.783351 31261 raft_consensus.cc:385] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.783672 31261 raft_consensus.cc:740] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.785270 31264 raft_consensus.cc:359] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.786121 31264 raft_consensus.cc:385] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.786412 31264 raft_consensus.cc:740] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.787153 31264 consensus_queue.cc:260] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.787436 31261 consensus_queue.cc:260] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.790531 31261 ts_tablet_manager.cc:1434] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:09:57.791795 31261 tablet_bootstrap.cc:492] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:09:57.795607 31264 ts_tablet_manager.cc:1434] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:09:57.797103 31264 tablet_bootstrap.cc:492] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:09:57.798897 31261 tablet_bootstrap.cc:654] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.805066 31264 tablet_bootstrap.cc:654] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.811825 31261 tablet_bootstrap.cc:492] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:09:57.812513 31261 ts_tablet_manager.cc:1403] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:09:57.816279 31261 raft_consensus.cc:359] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.817157 31261 raft_consensus.cc:385] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.817365 31264 tablet_bootstrap.cc:492] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:09:57.817488 31261 raft_consensus.cc:740] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.818312 31264 ts_tablet_manager.cc:1403] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.002s
I20260709 13:09:57.822252 31264 raft_consensus.cc:359] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.818684 31261 consensus_queue.cc:260] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.823050 31264 raft_consensus.cc:385] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.823391 31264 raft_consensus.cc:740] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.824033 31264 consensus_queue.cc:260] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.824898 31261 ts_tablet_manager.cc:1434] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:09:57.826061 31261 tablet_bootstrap.cc:492] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:09:57.826596 31262 tablet_bootstrap.cc:492] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:09:57.826726 31264 ts_tablet_manager.cc:1434] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:57.827222 31262 ts_tablet_manager.cc:1403] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.085s	user 0.039s	sys 0.016s
I20260709 13:09:57.827795 31264 tablet_bootstrap.cc:492] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:09:57.830384 31262 raft_consensus.cc:359] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.831152 31262 raft_consensus.cc:385] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.831525 31262 raft_consensus.cc:740] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.832430 31262 consensus_queue.cc:260] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.833585 31261 tablet_bootstrap.cc:654] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.834720 31262 ts_tablet_manager.cc:1434] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:09:57.835029 31264 tablet_bootstrap.cc:654] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.836010 31262 tablet_bootstrap.cc:492] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:09:57.844555 31262 tablet_bootstrap.cc:654] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.845705 31261 tablet_bootstrap.cc:492] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:09:57.846339 31261 ts_tablet_manager.cc:1403] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:09:57.849874 31261 raft_consensus.cc:359] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.850660 31261 raft_consensus.cc:385] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.850939 31261 raft_consensus.cc:740] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.851680 31261 consensus_queue.cc:260] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.854424 31261 ts_tablet_manager.cc:1434] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.007s
I20260709 13:09:57.855511 31261 tablet_bootstrap.cc:492] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:09:57.862246 31261 tablet_bootstrap.cc:654] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.879468 31262 tablet_bootstrap.cc:492] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:09:57.881541 31266 raft_consensus.cc:493] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.882203 31262 ts_tablet_manager.cc:1403] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.046s	user 0.028s	sys 0.012s
I20260709 13:09:57.882210 31266 raft_consensus.cc:515] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:09:57.883030 31264 tablet_bootstrap.cc:492] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:09:57.883679 31264 ts_tablet_manager.cc:1403] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.056s	user 0.026s	sys 0.024s
I20260709 13:09:57.885227 31266 leader_election.cc:290] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:09:57.886498 31262 raft_consensus.cc:359] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:09:57.887382 31262 raft_consensus.cc:385] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.887526 31261 tablet_bootstrap.cc:492] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:09:57.886974 31264 raft_consensus.cc:359] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:09:57.887750 31262 raft_consensus.cc:740] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.888036 31264 raft_consensus.cc:385] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.888168 31261 ts_tablet_manager.cc:1403] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.012s
I20260709 13:09:57.888677 31264 raft_consensus.cc:740] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.888707 31262 consensus_queue.cc:260] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:09:57.889767 31264 consensus_queue.cc:260] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:09:57.891650 31262 ts_tablet_manager.cc:1434] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:09:57.891517 31261 raft_consensus.cc:359] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.892339 31261 raft_consensus.cc:385] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.892802 31261 raft_consensus.cc:740] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.892819 31262 tablet_bootstrap.cc:492] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:09:57.892373 31264 ts_tablet_manager.cc:1434] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:57.894502 31264 tablet_bootstrap.cc:492] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:09:57.894774 31269 raft_consensus.cc:493] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.895315 31269 raft_consensus.cc:515] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.901191 31264 tablet_bootstrap.cc:654] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.901191 31262 tablet_bootstrap.cc:654] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.906921 31269 leader_election.cc:290] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:57.912529 31261 consensus_queue.cc:260] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.916971 31261 ts_tablet_manager.cc:1434] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.006s
I20260709 13:09:57.918195 31261 tablet_bootstrap.cc:492] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:09:57.924739 31261 tablet_bootstrap.cc:654] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.936376 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce396f6423ca457bbe84ae15fe26aa3e" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:09:57.937067 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8fb42087c24f308459e5024c577187" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:09:57.937295 31146 raft_consensus.cc:2468] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:09:57.937889 31147 raft_consensus.cc:2468] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:09:57.939963 31036 leader_election.cc:304] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:57.941260 31036 leader_election.cc:304] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:57.945912 31292 raft_consensus.cc:2804] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.946393 31292 raft_consensus.cc:493] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.946848 31292 raft_consensus.cc:3060] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.955659 31292 raft_consensus.cc:515] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:09:57.957870 31266 raft_consensus.cc:2804] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.958381 31266 raft_consensus.cc:493] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.958714 31266 raft_consensus.cc:3060] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.964572 31292 leader_election.cc:290] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Requested vote from peers 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:09:57.966529 31221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8fb42087c24f308459e5024c577187" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:09:57.967357 31221 raft_consensus.cc:2468] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 0.
I20260709 13:09:57.967717 31292 raft_consensus.cc:493] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.968364 31292 raft_consensus.cc:515] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.968940 31113 leader_election.cc:304] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:57.970734 31292 leader_election.cc:290] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:57.971338 31292 raft_consensus.cc:493] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.971805 31292 raft_consensus.cc:515] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.973526 31220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce396f6423ca457bbe84ae15fe26aa3e" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:09:57.974090 31292 leader_election.cc:290] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:57.974319 31220 raft_consensus.cc:2468] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:09:57.975625 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce396f6423ca457bbe84ae15fe26aa3e" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:09:57.977432 31266 raft_consensus.cc:515] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:57.979732 31266 leader_election.cc:290] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Requested vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:57.982014 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2402ee9214c4f5ea568e3d3816e9b52" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:09:57.982388 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce396f6423ca457bbe84ae15fe26aa3e" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:09:57.982813 31147 raft_consensus.cc:2468] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 0.
I20260709 13:09:57.982967 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63f3b41bc43c584f8ccb597e99142" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:09:57.983245 31146 raft_consensus.cc:3060] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.976305 31219 raft_consensus.cc:3060] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.985457 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6dd49ffeca47138091d11fab77470d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:09:57.986119 31145 raft_consensus.cc:2468] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:09:57.988199 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8fb42087c24f308459e5024c577187" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:09:57.988957 31145 raft_consensus.cc:3060] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.989682 31185 leader_election.cc:304] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: ce05d2e38f184bc19df1fc532f05fa23
I20260709 13:09:57.990621 31271 raft_consensus.cc:2804] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.991004 31271 raft_consensus.cc:493] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.991365 31271 raft_consensus.cc:3060] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.993047 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8fb42087c24f308459e5024c577187" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:09:57.993568 31218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6dd49ffeca47138091d11fab77470d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
W20260709 13:09:57.987788 31036 leader_election.cc:343] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.996023 31036 leader_election.cc:304] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:57.996904 31220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63f3b41bc43c584f8ccb597e99142" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:09:57.993763 31217 raft_consensus.cc:3060] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.998674 31145 raft_consensus.cc:2468] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:09:58.001240 31269 raft_consensus.cc:2764] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:58.001633 31221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8fb42087c24f308459e5024c577187" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:09:58.001830 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8fb42087c24f308459e5024c577187" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:09:58.002703 31072 raft_consensus.cc:2393] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d42393166e884a13a08fb2fe119629f2 in current term 1: Already voted for candidate ce05d2e38f184bc19df1fc532f05fa23 in this term.
I20260709 13:09:58.003918 31261 tablet_bootstrap.cc:492] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:09:58.004495 31261 ts_tablet_manager.cc:1403] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.009s
I20260709 13:09:58.005514 31219 raft_consensus.cc:2468] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:09:58.006268 31036 leader_election.cc:304] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:58.001307 31264 tablet_bootstrap.cc:492] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:09:58.010664 31293 raft_consensus.cc:2804] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.011425 31293 raft_consensus.cc:493] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.010679 31264 ts_tablet_manager.cc:1403] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.116s	user 0.021s	sys 0.018s
I20260709 13:09:58.011902 31262 tablet_bootstrap.cc:492] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
W20260709 13:09:58.012317 31018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:58.012514 31262 ts_tablet_manager.cc:1403] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.120s	user 0.025s	sys 0.026s
I20260709 13:09:58.011902 31293 raft_consensus.cc:3060] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.015364 31261 raft_consensus.cc:359] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.015697 31262 raft_consensus.cc:359] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.016521 31262 raft_consensus.cc:385] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.016166 31261 raft_consensus.cc:385] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.016746 31294 raft_consensus.cc:2804] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.017503 31264 raft_consensus.cc:359] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.018325 31264 raft_consensus.cc:385] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.018627 31264 raft_consensus.cc:740] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.019447 31264 consensus_queue.cc:260] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.020774 31217 raft_consensus.cc:2468] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:09:58.021605 31146 raft_consensus.cc:2468] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:09:58.009443 31271 raft_consensus.cc:515] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
W20260709 13:09:58.014436 31038 leader_election.cc:343] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.022902 31294 raft_consensus.cc:697] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
W20260709 13:09:58.023433 31038 leader_election.cc:343] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.023927 31038 leader_election.cc:304] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23; no voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2
I20260709 13:09:58.023800 31294 consensus_queue.cc:237] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.016963 31261 raft_consensus.cc:740] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.024811 31266 raft_consensus.cc:2749] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.025192 31036 leader_election.cc:304] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:58.026103 31266 raft_consensus.cc:2804] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.026544 31266 raft_consensus.cc:697] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:09:58.027241 31266 consensus_queue.cc:237] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:09:58.030400 31271 leader_election.cc:290] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:09:58.016856 31262 raft_consensus.cc:740] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.025868 31261 consensus_queue.cc:260] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.031436 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2402ee9214c4f5ea568e3d3816e9b52" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:09:58.032136 31072 raft_consensus.cc:3060] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.033080 31261 ts_tablet_manager.cc:1434] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:09:58.033586 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2402ee9214c4f5ea568e3d3816e9b52" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:09:58.027554 31264 ts_tablet_manager.cc:1434] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:09:58.034343 31146 raft_consensus.cc:3060] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.034643 31292 raft_consensus.cc:493] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.035084 31264 tablet_bootstrap.cc:492] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:09:58.035171 31292 raft_consensus.cc:515] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.037472 31292 leader_election.cc:290] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:58.038163 31262 consensus_queue.cc:260] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.038967 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3fd74c378e4e76b9969c930b4a451d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:09:58.039680 31145 raft_consensus.cc:2468] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:09:58.041219 31036 leader_election.cc:304] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:58.042834 31264 tablet_bootstrap.cc:654] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.043284 31292 raft_consensus.cc:2804] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.034109 31261 tablet_bootstrap.cc:492] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:09:58.059131 31271 raft_consensus.cc:493] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.059794 31271 raft_consensus.cc:515] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.060216 31261 tablet_bootstrap.cc:654] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.062073 31271 leader_election.cc:290] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:09:58.063264 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2d68a877274a1eb3d47c3962b21cef" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:09:58.065833 31145 raft_consensus.cc:2468] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 0.
I20260709 13:09:58.063724 31071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2d68a877274a1eb3d47c3962b21cef" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:09:58.066869 31071 raft_consensus.cc:2468] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 0.
I20260709 13:09:58.067133 31185 leader_election.cc:304] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:58.067859 31072 raft_consensus.cc:2468] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 1.
I20260709 13:09:58.068167 31271 raft_consensus.cc:2804] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.068682 31271 raft_consensus.cc:493] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.069067 31271 raft_consensus.cc:3060] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.052659 31292 raft_consensus.cc:493] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.069772 31293 raft_consensus.cc:515] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.055326 31262 ts_tablet_manager.cc:1434] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 13:09:58.074043 31294 raft_consensus.cc:493] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.072340 31292 raft_consensus.cc:3060] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.075120 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3fd74c378e4e76b9969c930b4a451d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:09:58.075786 31217 raft_consensus.cc:2468] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:09:58.073009 31184 leader_election.cc:304] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: 
I20260709 13:09:58.076602 31146 raft_consensus.cc:2468] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 1.
I20260709 13:09:58.074496 31262 tablet_bootstrap.cc:492] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:09:58.082356 31271 raft_consensus.cc:515] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.074540 31294 raft_consensus.cc:515] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.087406 31293 leader_election.cc:290] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Requested vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:58.087253 31292 raft_consensus.cc:515] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.091144 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6dd49ffeca47138091d11fab77470d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:09:58.094498 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2d68a877274a1eb3d47c3962b21cef" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:09:58.095207 31145 raft_consensus.cc:3060] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.096765 31146 raft_consensus.cc:3060] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.097729 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6dd49ffeca47138091d11fab77470d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:09:58.098883 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2d68a877274a1eb3d47c3962b21cef" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:09:58.097729 31298 raft_consensus.cc:2804] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.099517 30967 catalog_manager.cc:5697] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.100311 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2d68a877274a1eb3d47c3962b21cef" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:09:58.096400 31271 leader_election.cc:290] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:09:58.102135 31072 raft_consensus.cc:3060] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.098934 31292 leader_election.cc:290] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Requested vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:58.102347 30967 catalog_manager.cc:5697] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.102643 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3fd74c378e4e76b9969c930b4a451d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:09:58.104326 31147 raft_consensus.cc:3060] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:58.111369 31038 leader_election.cc:343] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.113886 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2d68a877274a1eb3d47c3962b21cef" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:09:58.114832 31072 raft_consensus.cc:2468] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 1.
I20260709 13:09:58.102468 31294 leader_election.cc:290] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:58.115530 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3fd74c378e4e76b9969c930b4a451d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:09:58.114912 31219 raft_consensus.cc:2393] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce05d2e38f184bc19df1fc532f05fa23 in current term 1: Already voted for candidate 5d80126ecf5f4933a6e789800f96c5f4 in this term.
I20260709 13:09:58.118161 31217 raft_consensus.cc:3060] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.119352 31038 leader_election.cc:304] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23; no voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2
I20260709 13:09:58.120445 31184 leader_election.cc:304] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: 
I20260709 13:09:58.121460 31271 raft_consensus.cc:2804] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.122047 31292 raft_consensus.cc:2749] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.123548 31147 raft_consensus.cc:2468] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:09:58.125114 31264 tablet_bootstrap.cc:492] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:09:58.132983 31264 ts_tablet_manager.cc:1403] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.007s
I20260709 13:09:58.133649 31036 leader_election.cc:304] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:58.134932 31294 raft_consensus.cc:2804] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.135588 31294 raft_consensus.cc:697] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:09:58.136440 31264 raft_consensus.cc:359] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.117388 31145 raft_consensus.cc:2468] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 1.
I20260709 13:09:58.122020 31271 raft_consensus.cc:697] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:09:58.137164 31294 consensus_queue.cc:237] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.117554 31298 raft_consensus.cc:697] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:09:58.128333 31217 raft_consensus.cc:2468] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:09:58.137467 31264 raft_consensus.cc:385] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.139442 31264 raft_consensus.cc:740] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.138314 31271 consensus_queue.cc:237] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.140265 31264 consensus_queue.cc:260] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.139073 31298 consensus_queue.cc:237] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.146291 31264 ts_tablet_manager.cc:1434] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:09:58.147411 31264 tablet_bootstrap.cc:492] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:09:58.147822 31261 tablet_bootstrap.cc:492] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:09:58.131525 31262 tablet_bootstrap.cc:654] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.148444 31261 ts_tablet_manager.cc:1403] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.026s
I20260709 13:09:58.151136 31269 raft_consensus.cc:493] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.151690 31261 raft_consensus.cc:359] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.151813 31269 raft_consensus.cc:515] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.152613 31261 raft_consensus.cc:385] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.152976 31261 raft_consensus.cc:740] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.131304 31146 raft_consensus.cc:2468] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:09:58.153900 31261 consensus_queue.cc:260] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.156692 31036 leader_election.cc:304] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 5d80126ecf5f4933a6e789800f96c5f4
I20260709 13:09:58.156894 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc088e451c3470787cf7bdd4872aa63" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:09:58.158046 31292 raft_consensus.cc:2804] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.158603 31292 raft_consensus.cc:697] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
W20260709 13:09:58.158876 31113 leader_election.cc:343] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.159495 31292 consensus_queue.cc:237] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.159930 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc088e451c3470787cf7bdd4872aa63" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:09:58.160727 31072 raft_consensus.cc:2468] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 0.
I20260709 13:09:58.162165 31110 leader_election.cc:304] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 5d80126ecf5f4933a6e789800f96c5f4
I20260709 13:09:58.163385 31269 leader_election.cc:290] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:58.163811 31261 ts_tablet_manager.cc:1434] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.007s
I20260709 13:09:58.163998 31269 raft_consensus.cc:2804] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.164767 31269 raft_consensus.cc:493] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.165099 31269 raft_consensus.cc:3060] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.174501 30969 catalog_manager.cc:5697] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.184278 31264 tablet_bootstrap.cc:654] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.187615 31269 raft_consensus.cc:515] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.188289 31262 tablet_bootstrap.cc:492] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:09:58.189057 31262 ts_tablet_manager.cc:1403] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.001s
I20260709 13:09:58.190919 31269 leader_election.cc:290] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:58.191051 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc088e451c3470787cf7bdd4872aa63" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:09:58.191805 31072 raft_consensus.cc:3060] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.196820 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc088e451c3470787cf7bdd4872aa63" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
W20260709 13:09:58.198311 31113 leader_election.cc:343] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.200361 31072 raft_consensus.cc:2468] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 1.
I20260709 13:09:58.201793 31110 leader_election.cc:304] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 5d80126ecf5f4933a6e789800f96c5f4
I20260709 13:09:58.201869 31262 raft_consensus.cc:359] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.202833 31262 raft_consensus.cc:385] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.203060 31269 raft_consensus.cc:2804] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.203230 31262 raft_consensus.cc:740] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.203843 31269 raft_consensus.cc:697] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Becoming Leader. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:09:58.204308 31262 consensus_queue.cc:260] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.204789 31269 consensus_queue.cc:237] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.207154 31262 ts_tablet_manager.cc:1434] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:09:58.209769 31262 tablet_bootstrap.cc:492] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:09:58.210067 30967 catalog_manager.cc:5697] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.212001 30967 catalog_manager.cc:5697] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.216533 31262 tablet_bootstrap.cc:654] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.217072 31264 tablet_bootstrap.cc:492] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:09:58.217674 31264 ts_tablet_manager.cc:1403] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.011s
I20260709 13:09:58.220806 31264 raft_consensus.cc:359] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.221627 31264 raft_consensus.cc:385] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.222549 31264 raft_consensus.cc:740] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.223410 31264 consensus_queue.cc:260] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.224556 31262 tablet_bootstrap.cc:492] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:09:58.225179 31262 ts_tablet_manager.cc:1403] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:09:58.225482 31264 ts_tablet_manager.cc:1434] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:58.216212 30968 catalog_manager.cc:5697] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.228674 31262 raft_consensus.cc:359] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.229532 31262 raft_consensus.cc:385] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.229897 31262 raft_consensus.cc:740] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.231353 31262 consensus_queue.cc:260] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.233701 31262 ts_tablet_manager.cc:1434] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:58.234618 31262 tablet_bootstrap.cc:492] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:09:58.234102 30969 catalog_manager.cc:5697] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d42393166e884a13a08fb2fe119629f2 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "d42393166e884a13a08fb2fe119629f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.241204 31262 tablet_bootstrap.cc:654] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.246224 31262 tablet_bootstrap.cc:492] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:09:58.246665 31262 ts_tablet_manager.cc:1403] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:09:58.249151 31262 raft_consensus.cc:359] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.249665 31262 raft_consensus.cc:385] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.249878 31262 raft_consensus.cc:740] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.250561 31262 consensus_queue.cc:260] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.252236 31262 ts_tablet_manager.cc:1434] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:58.253248 31262 tablet_bootstrap.cc:492] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:09:58.257907 31262 tablet_bootstrap.cc:654] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.262279 31262 tablet_bootstrap.cc:492] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:09:58.262738 31262 ts_tablet_manager.cc:1403] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:09:58.264688 31262 raft_consensus.cc:359] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.265159 31262 raft_consensus.cc:385] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.265359 31262 raft_consensus.cc:740] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.265971 31262 consensus_queue.cc:260] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.267524 31262 ts_tablet_manager.cc:1434] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:58.389317 31269 raft_consensus.cc:493] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.389859 31269 raft_consensus.cc:515] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.391541 31269 leader_election.cc:290] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:58.392439 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63f3b41bc43c584f8ccb597e99142" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:09:58.392617 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63f3b41bc43c584f8ccb597e99142" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:09:58.393265 31072 raft_consensus.cc:2468] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 0.
I20260709 13:09:58.393290 31217 raft_consensus.cc:2468] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 0.
I20260709 13:09:58.394518 31113 leader_election.cc:304] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:58.395167 31269 raft_consensus.cc:2804] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.395483 31269 raft_consensus.cc:493] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.395727 31269 raft_consensus.cc:3060] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.400803 31269 raft_consensus.cc:515] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.402557 31269 leader_election.cc:290] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:58.403432 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63f3b41bc43c584f8ccb597e99142" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:09:58.403546 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a63f3b41bc43c584f8ccb597e99142" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:09:58.403982 31072 raft_consensus.cc:3060] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.404049 31217 raft_consensus.cc:3060] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.409026 31072 raft_consensus.cc:2468] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 1.
I20260709 13:09:58.409040 31217 raft_consensus.cc:2468] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 1.
I20260709 13:09:58.410162 31110 leader_election.cc:304] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:58.410825 31269 raft_consensus.cc:2804] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.411252 31269 raft_consensus.cc:697] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Becoming Leader. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:09:58.411976 31269 consensus_queue.cc:237] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.418735 30969 catalog_manager.cc:5697] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d42393166e884a13a08fb2fe119629f2 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "d42393166e884a13a08fb2fe119629f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.484671 31292 consensus_queue.cc:1048] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.496842 31294 consensus_queue.cc:1048] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.549224 31271 consensus_queue.cc:1048] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.549908 31298 consensus_queue.cc:1048] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.570309 31294 consensus_queue.cc:1048] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.582582 31294 consensus_queue.cc:1048] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.593631 31269 consensus_queue.cc:1048] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.604341 31217 raft_consensus.cc:3060] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.608702 31294 raft_consensus.cc:493] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.609352 31294 raft_consensus.cc:515] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.611541 31294 leader_election.cc:290] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:58.612748 31309 consensus_queue.cc:1048] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:58.613507 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e20bdc4bdb049279a21da9073cf49fb" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:09:58.614216 31145 raft_consensus.cc:2468] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:09:58.614595 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e20bdc4bdb049279a21da9073cf49fb" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:09:58.615319 31217 raft_consensus.cc:2468] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:09:58.615453 31036 leader_election.cc:304] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:58.617049 31294 raft_consensus.cc:2804] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.617511 31294 raft_consensus.cc:493] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.617801 31294 raft_consensus.cc:3060] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.623459 31294 raft_consensus.cc:515] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.627169 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e20bdc4bdb049279a21da9073cf49fb" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:09:58.627288 31266 consensus_queue.cc:1048] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.627802 31145 raft_consensus.cc:3060] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.635342 31145 raft_consensus.cc:2468] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:09:58.635932 31294 leader_election.cc:290] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Requested vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:58.636566 31036 leader_election.cc:304] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:58.637850 31266 raft_consensus.cc:2804] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.638370 31266 raft_consensus.cc:697] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:09:58.639245 31266 consensus_queue.cc:237] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.639906 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e20bdc4bdb049279a21da9073cf49fb" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:09:58.640771 31219 raft_consensus.cc:3060] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.643353 31293 consensus_queue.cc:1048] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.651804 31219 raft_consensus.cc:2468] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:09:58.657673 30967 catalog_manager.cc:5697] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.671386 31271 raft_consensus.cc:493] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.671953 31271 raft_consensus.cc:515] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:58.673847 31271 leader_election.cc:290] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:09:58.674597 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6dd49ffeca47138091d11fab77470d" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:09:58.675231 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6dd49ffeca47138091d11fab77470d" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:09:58.676004 31145 raft_consensus.cc:2393] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d80126ecf5f4933a6e789800f96c5f4 in current term 1: Already voted for candidate ce05d2e38f184bc19df1fc532f05fa23 in this term.
I20260709 13:09:58.676877 31185 leader_election.cc:304] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4; no voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2
I20260709 13:09:58.677502 31271 raft_consensus.cc:3060] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.682794 31271 raft_consensus.cc:2749] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.711372 31271 consensus_queue.cc:1048] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.723219 31300 consensus_queue.cc:1048] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.739300 31266 consensus_queue.cc:1048] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.742957 31266 consensus_queue.cc:1048] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.786612 31219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2402ee9214c4f5ea568e3d3816e9b52"
dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
mode: GRACEFUL
new_leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
 from {username='slave'} at 127.0.0.1:34376
I20260709 13:09:58.787444 31219 raft_consensus.cc:606] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Received request to transfer leadership to TS ce05d2e38f184bc19df1fc532f05fa23
I20260709 13:09:58.792724 31328 consensus_queue.cc:1048] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.801115 31219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec2d68a877274a1eb3d47c3962b21cef"
dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
mode: GRACEFUL
new_leader_uuid: "d42393166e884a13a08fb2fe119629f2"
 from {username='slave'} at 127.0.0.1:34376
I20260709 13:09:58.801786 31219 raft_consensus.cc:606] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Received request to transfer leadership to TS d42393166e884a13a08fb2fe119629f2
I20260709 13:09:58.805989 31269 consensus_queue.cc:1048] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:58.827888 31072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de6dd49ffeca47138091d11fab77470d"
dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
mode: GRACEFUL
new_leader_uuid: "d42393166e884a13a08fb2fe119629f2"
 from {username='slave'} at 127.0.0.1:46018
I20260709 13:09:58.828706 31072 raft_consensus.cc:606] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Received request to transfer leadership to TS d42393166e884a13a08fb2fe119629f2
I20260709 13:09:58.840761 31072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e20bdc4bdb049279a21da9073cf49fb"
dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
mode: GRACEFUL
new_leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
 from {username='slave'} at 127.0.0.1:46018
I20260709 13:09:58.841280 31072 raft_consensus.cc:606] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Received request to transfer leadership to TS 5d80126ecf5f4933a6e789800f96c5f4
W20260709 13:09:58.931470 31242 debug-util.cc:398] Leaking SignalData structure 0x7b0800283c00 after lost signal to thread 21315
W20260709 13:09:58.932581 31242 debug-util.cc:398] Leaking SignalData structure 0x7b080003f8c0 after lost signal to thread 31004
W20260709 13:09:58.934482 31242 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb580 after lost signal to thread 31171
I20260709 13:09:59.136592 31294 consensus_queue.cc:1048] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:59.139132 31298 raft_consensus.cc:993] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4: : Instructing follower d42393166e884a13a08fb2fe119629f2 to start an election
I20260709 13:09:59.139685 31298 raft_consensus.cc:1081] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Signalling peer d42393166e884a13a08fb2fe119629f2 to start an election
I20260709 13:09:59.142812 31145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec2d68a877274a1eb3d47c3962b21cef"
dest_uuid: "d42393166e884a13a08fb2fe119629f2"
 from {username='slave'} at 127.0.0.1:38158
I20260709 13:09:59.143447 31145 raft_consensus.cc:493] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.143949 31145 raft_consensus.cc:3060] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.152141 31145 raft_consensus.cc:515] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.155356 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2d68a877274a1eb3d47c3962b21cef" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:09:59.156011 31072 raft_consensus.cc:3060] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.161695 31145 leader_election.cc:290] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 2 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:59.162356 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2d68a877274a1eb3d47c3962b21cef" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:09:59.163064 31219 raft_consensus.cc:3055] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.163430 31219 raft_consensus.cc:740] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:09:59.164636 31298 raft_consensus.cc:993] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4: : Instructing follower ce05d2e38f184bc19df1fc532f05fa23 to start an election
I20260709 13:09:59.165232 31298 raft_consensus.cc:1081] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Signalling peer ce05d2e38f184bc19df1fc532f05fa23 to start an election
I20260709 13:09:59.167049 31071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2402ee9214c4f5ea568e3d3816e9b52"
dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
 from {username='slave'} at 127.0.0.1:45994
I20260709 13:09:59.167675 31071 raft_consensus.cc:493] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.168061 31071 raft_consensus.cc:3060] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.167816 31293 consensus_queue.cc:1048] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.164342 31219 consensus_queue.cc:260] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.170603 31219 raft_consensus.cc:3060] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.178333 31219 raft_consensus.cc:2468] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 2.
I20260709 13:09:59.179761 31113 leader_election.cc:304] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:59.180887 31309 raft_consensus.cc:2804] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.181470 31309 raft_consensus.cc:697] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Becoming Leader. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:09:59.182463 31072 raft_consensus.cc:2468] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 2.
I20260709 13:09:59.182425 31309 consensus_queue.cc:237] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.185505 31071 raft_consensus.cc:515] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.189133 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2402ee9214c4f5ea568e3d3816e9b52" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:09:59.189862 31145 raft_consensus.cc:3060] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.191614 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2402ee9214c4f5ea568e3d3816e9b52" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:09:59.194722 30969 catalog_manager.cc:5697] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 reported cstate change: term changed from 1 to 2, leader changed from 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3) to d42393166e884a13a08fb2fe119629f2 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "d42393166e884a13a08fb2fe119629f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.197842 31145 raft_consensus.cc:2468] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 2.
I20260709 13:09:59.192332 31219 raft_consensus.cc:3055] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.198572 31219 raft_consensus.cc:740] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:09:59.199386 31036 leader_election.cc:304] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:59.199572 31219 consensus_queue.cc:260] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.200510 31293 raft_consensus.cc:2804] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.201035 31293 raft_consensus.cc:697] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:09:59.200922 31219 raft_consensus.cc:3060] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.201962 31293 consensus_queue.cc:237] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.205581 31071 leader_election.cc:290] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 2 election: Requested vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:59.209285 31219 raft_consensus.cc:2468] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 2.
I20260709 13:09:59.211333 30967 catalog_manager.cc:5697] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 1 to 2, leader changed from 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3) to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.217542 31293 raft_consensus.cc:993] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23: : Instructing follower 5d80126ecf5f4933a6e789800f96c5f4 to start an election
I20260709 13:09:59.218130 31293 raft_consensus.cc:1081] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Signalling peer 5d80126ecf5f4933a6e789800f96c5f4 to start an election
I20260709 13:09:59.220085 31217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e20bdc4bdb049279a21da9073cf49fb"
dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
 from {username='slave'} at 127.0.0.1:34362
I20260709 13:09:59.220783 31217 raft_consensus.cc:493] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.221196 31217 raft_consensus.cc:3060] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.236214 31217 raft_consensus.cc:515] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.238706 31217 leader_election.cc:290] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 2 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:09:59.240325 31071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e20bdc4bdb049279a21da9073cf49fb" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:09:59.240419 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e20bdc4bdb049279a21da9073cf49fb" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:09:59.241333 31071 raft_consensus.cc:3055] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.241396 31145 raft_consensus.cc:3060] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.241842 31071 raft_consensus.cc:740] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:09:59.242914 31071 consensus_queue.cc:260] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.244596 31071 raft_consensus.cc:3060] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.248703 31145 raft_consensus.cc:2468] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 2.
I20260709 13:09:59.250411 31185 leader_election.cc:304] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:09:59.251405 31271 raft_consensus.cc:2804] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.252048 31271 raft_consensus.cc:697] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:09:59.253134 31271 consensus_queue.cc:237] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.254513 31071 raft_consensus.cc:2468] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 2.
I20260709 13:09:59.263996 30967 catalog_manager.cc:5697] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 reported cstate change: term changed from 1 to 2, leader changed from ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1) to 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.351670 31293 raft_consensus.cc:993] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23: : Instructing follower d42393166e884a13a08fb2fe119629f2 to start an election
I20260709 13:09:59.352154 31294 raft_consensus.cc:1081] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Signalling peer d42393166e884a13a08fb2fe119629f2 to start an election
I20260709 13:09:59.353853 31145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de6dd49ffeca47138091d11fab77470d"
dest_uuid: "d42393166e884a13a08fb2fe119629f2"
 from {username='slave'} at 127.0.0.1:38156
I20260709 13:09:59.354370 31145 raft_consensus.cc:493] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.354667 31145 raft_consensus.cc:3060] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.360338 31145 raft_consensus.cc:515] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.362289 31145 leader_election.cc:290] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 2 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:09:59.363281 31071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6dd49ffeca47138091d11fab77470d" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:09:59.363979 31071 raft_consensus.cc:3055] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.364298 31071 raft_consensus.cc:740] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:09:59.364197 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6dd49ffeca47138091d11fab77470d" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:09:59.365334 31071 consensus_queue.cc:260] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
W20260709 13:09:59.366300 31294 consensus_queue.cc:1175] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5d80126ecf5f4933a6e789800f96c5f4" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:09:59.366515 31071 raft_consensus.cc:3060] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.372207 31071 raft_consensus.cc:2468] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 2.
I20260709 13:09:59.373275 31110 leader_election.cc:304] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 5d80126ecf5f4933a6e789800f96c5f4
I20260709 13:09:59.374012 31309 raft_consensus.cc:2804] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.374532 31309 raft_consensus.cc:697] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Becoming Leader. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:09:59.375348 31309 consensus_queue.cc:237] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:09:59.382504 30967 catalog_manager.cc:5697] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 reported cstate change: term changed from 1 to 2, leader changed from ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1) to d42393166e884a13a08fb2fe119629f2 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "d42393166e884a13a08fb2fe119629f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.710703 31071 raft_consensus.cc:1275] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Refusing update from remote peer d42393166e884a13a08fb2fe119629f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.712051 31309 consensus_queue.cc:1048] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.726634 31217 raft_consensus.cc:1275] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Refusing update from remote peer d42393166e884a13a08fb2fe119629f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.728087 31328 consensus_queue.cc:1048] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.761991 31145 raft_consensus.cc:1275] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Refusing update from remote peer ce05d2e38f184bc19df1fc532f05fa23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.763409 31294 consensus_queue.cc:1048] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.775689 31217 raft_consensus.cc:1275] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Refusing update from remote peer ce05d2e38f184bc19df1fc532f05fa23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.783699 31293 consensus_queue.cc:1048] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.799193 31217 raft_consensus.cc:3060] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.807365 31217 raft_consensus.cc:1275] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Refusing update from remote peer d42393166e884a13a08fb2fe119629f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.808948 31328 consensus_queue.cc:1048] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.822646 31071 raft_consensus.cc:1275] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Refusing update from remote peer d42393166e884a13a08fb2fe119629f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.824456 31309 consensus_queue.cc:1048] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.835930 31072 raft_consensus.cc:1275] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Refusing update from remote peer 5d80126ecf5f4933a6e789800f96c5f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.837940 31271 consensus_queue.cc:1048] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.851610 31145 raft_consensus.cc:1275] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Refusing update from remote peer 5d80126ecf5f4933a6e789800f96c5f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.853466 31359 consensus_queue.cc:1048] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.875815 30967 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53434:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:01.879114 30967 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:01.936271 31057 tablet_service.cc:1511] Processing CreateTablet for tablet 2b06da5416fe44fe8cc53f8486cd2dfc (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:01.937215 31133 tablet_service.cc:1511] Processing CreateTablet for tablet 2b06da5416fe44fe8cc53f8486cd2dfc (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:01.939834 31133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b06da5416fe44fe8cc53f8486cd2dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.940466 31057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b06da5416fe44fe8cc53f8486cd2dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.940155 31210 tablet_service.cc:1511] Processing CreateTablet for tablet 2b06da5416fe44fe8cc53f8486cd2dfc (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:01.941505 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b06da5416fe44fe8cc53f8486cd2dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.941164 31060 tablet_service.cc:1511] Processing CreateTablet for tablet 45da8414ac654d5bbe2836bbccec66ce (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:01.942538 31136 tablet_service.cc:1511] Processing CreateTablet for tablet 45da8414ac654d5bbe2836bbccec66ce (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:01.943864 31136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45da8414ac654d5bbe2836bbccec66ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.944556 31209 tablet_service.cc:1511] Processing CreateTablet for tablet 45da8414ac654d5bbe2836bbccec66ce (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:01.942538 31060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45da8414ac654d5bbe2836bbccec66ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.945951 31061 tablet_service.cc:1511] Processing CreateTablet for tablet 56477456524849f2bf6636ff4ccbb869 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:01.947499 31061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56477456524849f2bf6636ff4ccbb869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.946043 31209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45da8414ac654d5bbe2836bbccec66ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.957939 31137 tablet_service.cc:1511] Processing CreateTablet for tablet 56477456524849f2bf6636ff4ccbb869 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:01.959342 31208 tablet_service.cc:1511] Processing CreateTablet for tablet 56477456524849f2bf6636ff4ccbb869 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:01.960938 31208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56477456524849f2bf6636ff4ccbb869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.962093 31132 tablet_service.cc:1511] Processing CreateTablet for tablet e4465377aac643f284a288f9de196500 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:01.959425 31137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56477456524849f2bf6636ff4ccbb869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.960952 31058 tablet_service.cc:1511] Processing CreateTablet for tablet e4465377aac643f284a288f9de196500 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:01.966084 31132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4465377aac643f284a288f9de196500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.966122 31058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4465377aac643f284a288f9de196500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.975449 31211 tablet_service.cc:1511] Processing CreateTablet for tablet e4465377aac643f284a288f9de196500 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:01.976677 31062 tablet_service.cc:1511] Processing CreateTablet for tablet 335575478644424d85ddb75b8f010124 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:01.977150 31211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4465377aac643f284a288f9de196500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.978080 31062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335575478644424d85ddb75b8f010124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.987634 31135 tablet_service.cc:1511] Processing CreateTablet for tablet 335575478644424d85ddb75b8f010124 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:01.989203 31135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335575478644424d85ddb75b8f010124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.999579 31207 tablet_service.cc:1511] Processing CreateTablet for tablet 335575478644424d85ddb75b8f010124 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:02.001313 31207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335575478644424d85ddb75b8f010124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.019860 31134 tablet_service.cc:1511] Processing CreateTablet for tablet a6c79eed15b94621bddf666bfc8fdaeb (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:02.021353 31134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c79eed15b94621bddf666bfc8fdaeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.027027 31061 tablet_service.cc:1511] Processing CreateTablet for tablet a6c79eed15b94621bddf666bfc8fdaeb (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:02.041592 31061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c79eed15b94621bddf666bfc8fdaeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.046993 31206 tablet_service.cc:1511] Processing CreateTablet for tablet a6c79eed15b94621bddf666bfc8fdaeb (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:02.048655 31206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c79eed15b94621bddf666bfc8fdaeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.056282 31059 tablet_service.cc:1511] Processing CreateTablet for tablet eab46c22e6c545ea8c5d902d18e8008d (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:02.057914 31059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab46c22e6c545ea8c5d902d18e8008d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:02.067440 31018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:02.074884 31373 tablet_bootstrap.cc:492] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:10:02.085299 31375 tablet_bootstrap.cc:492] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:10:02.088320 31131 tablet_service.cc:1511] Processing CreateTablet for tablet eab46c22e6c545ea8c5d902d18e8008d (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:02.089882 31131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab46c22e6c545ea8c5d902d18e8008d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.104313 31057 tablet_service.cc:1511] Processing CreateTablet for tablet 32bd2e42647d4ddc99da3e29be81229e (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:02.114619 31057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32bd2e42647d4ddc99da3e29be81229e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.105911 31211 tablet_service.cc:1511] Processing CreateTablet for tablet eab46c22e6c545ea8c5d902d18e8008d (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:02.117969 31211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab46c22e6c545ea8c5d902d18e8008d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.106889 31130 tablet_service.cc:1511] Processing CreateTablet for tablet 32bd2e42647d4ddc99da3e29be81229e (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:02.121838 31130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32bd2e42647d4ddc99da3e29be81229e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.125911 31375 tablet_bootstrap.cc:654] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.113209 31062 tablet_service.cc:1511] Processing CreateTablet for tablet ca79943d87e54c9ba6d86ffa2c7e9369 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:02.130128 31062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca79943d87e54c9ba6d86ffa2c7e9369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.133503 31373 tablet_bootstrap.cc:654] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.139218 31376 tablet_bootstrap.cc:492] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:10:02.145422 31136 tablet_service.cc:1511] Processing CreateTablet for tablet ca79943d87e54c9ba6d86ffa2c7e9369 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:02.149802 31210 tablet_service.cc:1511] Processing CreateTablet for tablet ca79943d87e54c9ba6d86ffa2c7e9369 (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:02.151356 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca79943d87e54c9ba6d86ffa2c7e9369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.112134 31209 tablet_service.cc:1511] Processing CreateTablet for tablet 32bd2e42647d4ddc99da3e29be81229e (DEFAULT_TABLE table=soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:02.157104 31209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32bd2e42647d4ddc99da3e29be81229e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.159641 31376 tablet_bootstrap.cc:654] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.186679 31375 tablet_bootstrap.cc:492] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:10:02.187338 31375 ts_tablet_manager.cc:1403] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.013s
I20260709 13:10:02.190479 31373 tablet_bootstrap.cc:492] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:10:02.191107 31373 ts_tablet_manager.cc:1403] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.015s
I20260709 13:10:02.177146 31136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca79943d87e54c9ba6d86ffa2c7e9369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.198786 31375 raft_consensus.cc:359] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.199690 31375 raft_consensus.cc:385] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.200001 31375 raft_consensus.cc:740] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.203258 31373 raft_consensus.cc:359] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.204166 31373 raft_consensus.cc:385] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.204496 31373 raft_consensus.cc:740] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.206444 31373 consensus_queue.cc:260] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.205569 31375 consensus_queue.cc:260] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.230393 31375 ts_tablet_manager.cc:1434] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:10:02.236927 31375 tablet_bootstrap.cc:492] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:10:02.241284 31376 tablet_bootstrap.cc:492] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:10:02.244846 31376 ts_tablet_manager.cc:1403] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.029s
I20260709 13:10:02.239230 31373 ts_tablet_manager.cc:1434] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.001s
I20260709 13:10:02.246272 31373 tablet_bootstrap.cc:492] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:10:02.255225 31376 raft_consensus.cc:359] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.255873 31376 raft_consensus.cc:385] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.256102 31376 raft_consensus.cc:740] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.256762 31376 consensus_queue.cc:260] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.259536 31373 tablet_bootstrap.cc:654] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.259867 31376 ts_tablet_manager.cc:1434] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:10:02.262068 31376 tablet_bootstrap.cc:492] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:10:02.269315 31376 tablet_bootstrap.cc:654] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.282771 31376 tablet_bootstrap.cc:492] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:10:02.282888 31375 tablet_bootstrap.cc:654] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.283486 31376 ts_tablet_manager.cc:1403] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:10:02.286191 31373 tablet_bootstrap.cc:492] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:10:02.286823 31373 ts_tablet_manager.cc:1403] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.008s
I20260709 13:10:02.286742 31376 raft_consensus.cc:359] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.287686 31376 raft_consensus.cc:385] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.288020 31376 raft_consensus.cc:740] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.288870 31376 consensus_queue.cc:260] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.290297 31373 raft_consensus.cc:359] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.291121 31373 raft_consensus.cc:385] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.291428 31373 raft_consensus.cc:740] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.291527 31376 ts_tablet_manager.cc:1434] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:10:02.292253 31373 consensus_queue.cc:260] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.292819 31376 tablet_bootstrap.cc:492] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:10:02.294799 31373 ts_tablet_manager.cc:1434] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:10:02.296119 31373 tablet_bootstrap.cc:492] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:10:02.300436 31376 tablet_bootstrap.cc:654] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.304451 31373 tablet_bootstrap.cc:654] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.317121 31373 tablet_bootstrap.cc:492] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:10:02.317723 31373 ts_tablet_manager.cc:1403] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 13:10:02.320089 31376 tablet_bootstrap.cc:492] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:10:02.320748 31376 ts_tablet_manager.cc:1403] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.000s
I20260709 13:10:02.320911 31373 raft_consensus.cc:359] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.321745 31373 raft_consensus.cc:385] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.322060 31373 raft_consensus.cc:740] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.322873 31373 consensus_queue.cc:260] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.324612 31376 raft_consensus.cc:359] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.325461 31373 ts_tablet_manager.cc:1434] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:10:02.325461 31376 raft_consensus.cc:385] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.326076 31376 raft_consensus.cc:740] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.326867 31373 tablet_bootstrap.cc:492] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:10:02.326937 31376 consensus_queue.cc:260] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.329705 31376 ts_tablet_manager.cc:1434] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:02.330960 31376 tablet_bootstrap.cc:492] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:10:02.334820 31373 tablet_bootstrap.cc:654] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.337941 31376 tablet_bootstrap.cc:654] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.340263 31359 raft_consensus.cc:493] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.340937 31359 raft_consensus.cc:515] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.343361 31359 leader_election.cc:290] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:10:02.344389 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335575478644424d85ddb75b8f010124" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:10:02.345209 31072 raft_consensus.cc:2468] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 0.
I20260709 13:10:02.345811 31375 tablet_bootstrap.cc:492] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:10:02.346441 31375 ts_tablet_manager.cc:1403] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.006s
I20260709 13:10:02.347586 31373 tablet_bootstrap.cc:492] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:10:02.348208 31373 ts_tablet_manager.cc:1403] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:10:02.349212 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335575478644424d85ddb75b8f010124" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:10:02.349988 31145 raft_consensus.cc:2468] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 0.
I20260709 13:10:02.350955 31376 tablet_bootstrap.cc:492] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:10:02.351512 31184 leader_election.cc:304] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: 
I20260709 13:10:02.351554 31376 ts_tablet_manager.cc:1403] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:10:02.351533 31373 raft_consensus.cc:359] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.353041 31373 raft_consensus.cc:385] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.353400 31373 raft_consensus.cc:740] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.354202 31373 consensus_queue.cc:260] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.355826 31376 raft_consensus.cc:359] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.356205 31359 raft_consensus.cc:2804] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.356781 31376 raft_consensus.cc:385] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.356805 31373 ts_tablet_manager.cc:1434] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:02.356904 31359 raft_consensus.cc:493] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.357292 31376 raft_consensus.cc:740] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.358428 31373 tablet_bootstrap.cc:492] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:10:02.365810 31375 raft_consensus.cc:359] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.371389 31375 raft_consensus.cc:385] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.370225 31376 consensus_queue.cc:260] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.371711 31375 raft_consensus.cc:740] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.362385 31362 raft_consensus.cc:493] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.372711 31362 raft_consensus.cc:515] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.376691 31375 consensus_queue.cc:260] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.377696 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56477456524849f2bf6636ff4ccbb869" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:10:02.378434 31217 raft_consensus.cc:2468] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:10:02.362617 31359 raft_consensus.cc:3060] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.375273 31362 leader_election.cc:290] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.385263 31373 tablet_bootstrap.cc:654] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.393319 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56477456524849f2bf6636ff4ccbb869" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
W20260709 13:10:02.395465 31036 leader_election.cc:343] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.402518 31376 ts_tablet_manager.cc:1434] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.050s	user 0.012s	sys 0.007s
I20260709 13:10:02.405267 31376 tablet_bootstrap.cc:492] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:10:02.412885 31376 tablet_bootstrap.cc:654] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.417743 31359 raft_consensus.cc:515] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.420827 31375 ts_tablet_manager.cc:1434] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.004s
I20260709 13:10:02.421953 31389 raft_consensus.cc:493] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.422623 31389 raft_consensus.cc:515] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.423055 31038 leader_election.cc:304] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: d42393166e884a13a08fb2fe119629f2
I20260709 13:10:02.424021 31362 raft_consensus.cc:2804] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.424459 31362 raft_consensus.cc:493] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.424834 31362 raft_consensus.cc:3060] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.425289 31375 tablet_bootstrap.cc:492] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:10:02.425145 31389 leader_election.cc:290] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.435669 31359 leader_election.cc:290] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:10:02.437795 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335575478644424d85ddb75b8f010124" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:02.438681 31146 raft_consensus.cc:3060] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.440086 31362 raft_consensus.cc:515] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.441459 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:10:02.442680 31362 leader_election.cc:290] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Requested vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.445259 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:10:02.446125 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56477456524849f2bf6636ff4ccbb869" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:02.446589 31375 tablet_bootstrap.cc:654] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:02.445369 31036 leader_election.cc:343] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.448192 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56477456524849f2bf6636ff4ccbb869" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:10:02.449029 31217 raft_consensus.cc:3060] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:02.451854 31038 leader_election.cc:343] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.452543 31038 leader_election.cc:304] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23; no voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2
I20260709 13:10:02.421788 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335575478644424d85ddb75b8f010124" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:02.453455 31072 raft_consensus.cc:3060] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:02.458689 31036 leader_election.cc:343] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.461630 31146 raft_consensus.cc:2468] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 1.
I20260709 13:10:02.461845 31362 raft_consensus.cc:2749] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.463349 31185 leader_election.cc:304] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.464267 31359 raft_consensus.cc:2804] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.461652 31217 raft_consensus.cc:2468] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:10:02.465148 31359 raft_consensus.cc:697] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:10:02.466189 31376 tablet_bootstrap.cc:492] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:10:02.466629 31373 tablet_bootstrap.cc:492] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:10:02.466316 31038 leader_election.cc:304] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: d42393166e884a13a08fb2fe119629f2
I20260709 13:10:02.466135 31359 consensus_queue.cc:237] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.466902 31376 ts_tablet_manager.cc:1403] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.028s
I20260709 13:10:02.467198 31373 ts_tablet_manager.cc:1403] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.009s
I20260709 13:10:02.467892 31362 raft_consensus.cc:2804] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.468500 31362 raft_consensus.cc:697] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:10:02.464208 31072 raft_consensus.cc:2468] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 1.
I20260709 13:10:02.469477 31362 consensus_queue.cc:237] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.471103 31373 raft_consensus.cc:359] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.471937 31373 raft_consensus.cc:385] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.472249 31373 raft_consensus.cc:740] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.473066 31373 consensus_queue.cc:260] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.475708 31373 ts_tablet_manager.cc:1434] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:02.477583 31376 raft_consensus.cc:359] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.478456 31376 raft_consensus.cc:385] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.478550 31375 tablet_bootstrap.cc:492] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:10:02.479100 31375 ts_tablet_manager.cc:1403] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.007s
I20260709 13:10:02.479406 31376 raft_consensus.cc:740] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.480271 31376 consensus_queue.cc:260] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.482715 31376 ts_tablet_manager.cc:1434] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:10:02.483009 31375 raft_consensus.cc:359] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.483805 31375 raft_consensus.cc:385] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.484086 31375 raft_consensus.cc:740] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.484952 31375 consensus_queue.cc:260] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.486243 31376 tablet_bootstrap.cc:492] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:10:02.488584 30968 catalog_manager.cc:5697] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.491101 31375 ts_tablet_manager.cc:1434] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:10:02.479235 31373 tablet_bootstrap.cc:492] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:10:02.498955 31375 tablet_bootstrap.cc:492] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:10:02.506844 31375 tablet_bootstrap.cc:654] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.510738 30969 catalog_manager.cc:5697] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.511931 31373 tablet_bootstrap.cc:654] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.517601 31376 tablet_bootstrap.cc:654] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.532127 31373 tablet_bootstrap.cc:492] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:10:02.532284 31375 tablet_bootstrap.cc:492] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:10:02.532908 31373 ts_tablet_manager.cc:1403] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.003s
I20260709 13:10:02.533041 31375 ts_tablet_manager.cc:1403] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.015s
I20260709 13:10:02.539331 31373 raft_consensus.cc:359] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.540267 31373 raft_consensus.cc:385] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.539829 31375 raft_consensus.cc:359] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.540834 31375 raft_consensus.cc:385] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.540717 31373 raft_consensus.cc:740] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.542032 31373 consensus_queue.cc:260] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.544906 31373 ts_tablet_manager.cc:1434] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:02.546106 31373 tablet_bootstrap.cc:492] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:10:02.552947 31373 tablet_bootstrap.cc:654] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.554956 31376 tablet_bootstrap.cc:492] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:10:02.555709 31376 ts_tablet_manager.cc:1403] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.016s
I20260709 13:10:02.558827 31376 raft_consensus.cc:359] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.559713 31376 raft_consensus.cc:385] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.560082 31376 raft_consensus.cc:740] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.560904 31376 consensus_queue.cc:260] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.561414 31375 raft_consensus.cc:740] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.562644 31375 consensus_queue.cc:260] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.565232 31375 ts_tablet_manager.cc:1434] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:10:02.563628 31376 ts_tablet_manager.cc:1434] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:10:02.567075 31376 tablet_bootstrap.cc:492] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:10:02.571498 31375 tablet_bootstrap.cc:492] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:10:02.575184 31373 tablet_bootstrap.cc:492] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:10:02.579890 31373 ts_tablet_manager.cc:1403] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.011s
I20260709 13:10:02.583087 31373 raft_consensus.cc:359] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.579265 31376 tablet_bootstrap.cc:654] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.584323 31373 raft_consensus.cc:385] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.584841 31373 raft_consensus.cc:740] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.585776 31373 consensus_queue.cc:260] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.588253 31373 ts_tablet_manager.cc:1434] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:10:02.589478 31373 tablet_bootstrap.cc:492] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:10:02.596179 31373 tablet_bootstrap.cc:654] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.605618 31375 tablet_bootstrap.cc:654] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.607990 31373 tablet_bootstrap.cc:492] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:10:02.608673 31373 ts_tablet_manager.cc:1403] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.013s
I20260709 13:10:02.611570 31373 raft_consensus.cc:359] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.612462 31373 raft_consensus.cc:385] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.612855 31373 raft_consensus.cc:740] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.613516 31376 tablet_bootstrap.cc:492] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:10:02.614127 31376 ts_tablet_manager.cc:1403] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.018s
I20260709 13:10:02.613752 31373 consensus_queue.cc:260] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.615514 31375 tablet_bootstrap.cc:492] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:10:02.616058 31375 ts_tablet_manager.cc:1403] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.004s
I20260709 13:10:02.616320 31373 ts_tablet_manager.cc:1434] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:02.617448 31373 tablet_bootstrap.cc:492] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23: Bootstrap starting.
I20260709 13:10:02.617324 31376 raft_consensus.cc:359] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.623273 31376 raft_consensus.cc:385] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.623606 31376 raft_consensus.cc:740] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.624358 31376 consensus_queue.cc:260] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.626761 31376 ts_tablet_manager.cc:1434] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.006s
I20260709 13:10:02.627777 31376 tablet_bootstrap.cc:492] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:10:02.634279 31373 tablet_bootstrap.cc:654] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.624946 31375 raft_consensus.cc:359] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.634976 31375 raft_consensus.cc:385] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.635488 31375 raft_consensus.cc:740] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.636397 31375 consensus_queue.cc:260] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.638100 31362 raft_consensus.cc:493] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.638659 31362 raft_consensus.cc:515] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.634279 31376 tablet_bootstrap.cc:654] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.641001 31362 leader_election.cc:290] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.642537 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4465377aac643f284a288f9de196500" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:10:02.643368 31146 raft_consensus.cc:2468] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:10:02.644034 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4465377aac643f284a288f9de196500" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:10:02.644773 31217 raft_consensus.cc:2468] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:10:02.644830 31036 leader_election.cc:304] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.645792 31362 raft_consensus.cc:2804] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.646166 31362 raft_consensus.cc:493] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.646472 31362 raft_consensus.cc:3060] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.653007 31375 ts_tablet_manager.cc:1434] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.004s
I20260709 13:10:02.654286 31375 tablet_bootstrap.cc:492] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:10:02.654237 31362 raft_consensus.cc:515] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.657657 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4465377aac643f284a288f9de196500" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:02.658344 31146 raft_consensus.cc:3060] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.662660 31375 tablet_bootstrap.cc:654] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.663338 31376 tablet_bootstrap.cc:492] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:10:02.663909 31376 ts_tablet_manager.cc:1403] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.011s
I20260709 13:10:02.665342 31373 tablet_bootstrap.cc:492] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23: No bootstrap required, opened a new log
I20260709 13:10:02.665881 31373 ts_tablet_manager.cc:1403] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.000s
I20260709 13:10:02.666778 31376 raft_consensus.cc:359] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.667550 31376 raft_consensus.cc:385] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.667091 31146 raft_consensus.cc:2468] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:10:02.668813 31373 raft_consensus.cc:359] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.667838 31376 raft_consensus.cc:740] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.669524 31036 leader_election.cc:304] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.669530 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4465377aac643f284a288f9de196500" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:10:02.670387 31217 raft_consensus.cc:3060] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.670186 31376 consensus_queue.cc:260] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.670531 31387 raft_consensus.cc:2804] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.671177 31387 raft_consensus.cc:697] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:10:02.671996 31387 consensus_queue.cc:237] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.672551 31376 ts_tablet_manager.cc:1434] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:10:02.676401 31376 tablet_bootstrap.cc:492] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4: Bootstrap starting.
I20260709 13:10:02.669555 31373 raft_consensus.cc:385] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.680697 31373 raft_consensus.cc:740] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.668277 31362 leader_election.cc:290] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Requested vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.685298 31373 consensus_queue.cc:260] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.687263 31376 tablet_bootstrap.cc:654] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.687757 31373 ts_tablet_manager.cc:1434] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:10:02.697149 31217 raft_consensus.cc:2468] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:10:02.702464 31375 tablet_bootstrap.cc:492] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:10:02.702718 31376 tablet_bootstrap.cc:492] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4: No bootstrap required, opened a new log
I20260709 13:10:02.703179 31376 ts_tablet_manager.cc:1403] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 13:10:02.703152 31375 ts_tablet_manager.cc:1403] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.018s
I20260709 13:10:02.705397 30967 catalog_manager.cc:5697] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.706400 31376 raft_consensus.cc:359] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.706727 31375 raft_consensus.cc:359] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.707211 31376 raft_consensus.cc:385] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.707486 31375 raft_consensus.cc:385] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.707510 31376 raft_consensus.cc:740] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.707917 31375 raft_consensus.cc:740] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.708422 31376 consensus_queue.cc:260] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.708850 31375 consensus_queue.cc:260] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.710817 31376 ts_tablet_manager.cc:1434] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:02.711542 31375 ts_tablet_manager.cc:1434] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:10:02.712363 31359 raft_consensus.cc:493] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.712939 31359 raft_consensus.cc:515] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.714068 31375 tablet_bootstrap.cc:492] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:10:02.718658 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45da8414ac654d5bbe2836bbccec66ce" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:10:02.719478 31146 raft_consensus.cc:2468] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 0.
I20260709 13:10:02.720953 31359 leader_election.cc:290] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:10:02.721276 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45da8414ac654d5bbe2836bbccec66ce" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:10:02.722064 31072 raft_consensus.cc:2468] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 0.
I20260709 13:10:02.722127 31185 leader_election.cc:304] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.723196 31359 raft_consensus.cc:2804] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.723595 31359 raft_consensus.cc:493] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.723933 31359 raft_consensus.cc:3060] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.724257 31388 raft_consensus.cc:493] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.724822 31388 raft_consensus.cc:515] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.725410 31375 tablet_bootstrap.cc:654] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.727244 31388 leader_election.cc:290] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:10:02.728163 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79943d87e54c9ba6d86ffa2c7e9369" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:10:02.728395 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79943d87e54c9ba6d86ffa2c7e9369" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:10:02.729004 31072 raft_consensus.cc:2468] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 0.
W20260709 13:10:02.730079 31185 leader_election.cc:343] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.730777 31184 leader_election.cc:304] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: d42393166e884a13a08fb2fe119629f2
I20260709 13:10:02.735807 31388 raft_consensus.cc:2804] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.736245 31388 raft_consensus.cc:493] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.736606 31388 raft_consensus.cc:3060] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.739079 31359 raft_consensus.cc:515] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.742301 31340 raft_consensus.cc:493] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.742859 31340 raft_consensus.cc:515] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.745070 31340 leader_election.cc:290] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.746785 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:10:02.747376 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:10:02.747614 31072 raft_consensus.cc:2468] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 0.
I20260709 13:10:02.748054 31217 raft_consensus.cc:2468] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 0.
I20260709 13:10:02.748628 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45da8414ac654d5bbe2836bbccec66ce" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:02.749282 31146 raft_consensus.cc:3060] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.750017 31110 leader_election.cc:304] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.751763 31387 raft_consensus.cc:493] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.752334 31387 raft_consensus.cc:515] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.753831 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45da8414ac654d5bbe2836bbccec66ce" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:02.754598 31072 raft_consensus.cc:3060] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.756791 31340 raft_consensus.cc:2804] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.757305 31340 raft_consensus.cc:493] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.757725 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:10:02.754592 31387 leader_election.cc:290] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.758468 31217 raft_consensus.cc:2468] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 0.
I20260709 13:10:02.757786 31340 raft_consensus.cc:3060] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.759920 31038 leader_election.cc:304] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: 
I20260709 13:10:02.761788 31388 raft_consensus.cc:515] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.762744 31387 raft_consensus.cc:2804] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.763319 31387 raft_consensus.cc:493] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.764253 31388 leader_election.cc:290] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:10:02.765214 31071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79943d87e54c9ba6d86ffa2c7e9369" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:02.765645 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79943d87e54c9ba6d86ffa2c7e9369" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:02.766031 31071 raft_consensus.cc:3060] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:02.767293 31185 leader_election.cc:343] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.771746 31146 raft_consensus.cc:2468] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 1.
I20260709 13:10:02.777917 31185 leader_election.cc:304] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.772504 31387 raft_consensus.cc:3060] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.779214 31388 raft_consensus.cc:2804] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.775889 31359 leader_election.cc:290] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:10:02.780887 31072 raft_consensus.cc:2468] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 1.
I20260709 13:10:02.782295 31388 raft_consensus.cc:697] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:10:02.783582 31388 consensus_queue.cc:237] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.786353 31071 raft_consensus.cc:2468] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 1.
I20260709 13:10:02.787787 31184 leader_election.cc:304] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: d42393166e884a13a08fb2fe119629f2
I20260709 13:10:02.788424 31375 tablet_bootstrap.cc:492] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:10:02.789057 31375 ts_tablet_manager.cc:1403] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.003s
I20260709 13:10:02.789171 31359 raft_consensus.cc:2804] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.789873 31359 raft_consensus.cc:697] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:10:02.794598 31359 consensus_queue.cc:237] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.792394 31412 raft_consensus.cc:493] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.795166 31375 raft_consensus.cc:359] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.795984 31375 raft_consensus.cc:385] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.795850 31412 raft_consensus.cc:515] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.796301 31375 raft_consensus.cc:740] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.798449 31340 raft_consensus.cc:515] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.799639 31071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c79eed15b94621bddf666bfc8fdaeb" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:10:02.799499 31375 consensus_queue.cc:260] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.800143 31412 leader_election.cc:290] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.793306 31387 raft_consensus.cc:515] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.801391 31340 leader_election.cc:290] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.801622 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:02.802282 31072 raft_consensus.cc:3060] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.804658 31387 leader_election.cc:290] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Requested vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.791692 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2" is_pre_election: true
I20260709 13:10:02.806026 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:10:02.806622 31217 raft_consensus.cc:3060] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.800494 31071 raft_consensus.cc:2468] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 0.
I20260709 13:10:02.808030 31110 leader_election.cc:304] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.808897 31340 raft_consensus.cc:2804] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.809293 31340 raft_consensus.cc:493] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.809635 31340 raft_consensus.cc:3060] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.814967 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c79eed15b94621bddf666bfc8fdaeb" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:10:02.815841 31219 raft_consensus.cc:2468] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 0.
I20260709 13:10:02.814883 30968 catalog_manager.cc:5697] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.816390 31217 raft_consensus.cc:2468] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 1.
I20260709 13:10:02.817130 31340 raft_consensus.cc:515] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.817601 31038 leader_election.cc:304] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: 
I20260709 13:10:02.818022 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:10:02.814881 31072 raft_consensus.cc:2468] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 1.
I20260709 13:10:02.820271 31110 leader_election.cc:304] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.818681 31219 raft_consensus.cc:3060] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.823004 31375 ts_tablet_manager.cc:1434] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.005s
I20260709 13:10:02.824124 31375 tablet_bootstrap.cc:492] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:10:02.827334 31387 raft_consensus.cc:2804] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.828382 31387 raft_consensus.cc:697] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
W20260709 13:10:02.828948 31036 leader_election.cc:343] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.829917 31387 consensus_queue.cc:237] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.834276 31340 leader_election.cc:290] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.837393 31219 raft_consensus.cc:2468] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 1.
I20260709 13:10:02.835494 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c79eed15b94621bddf666bfc8fdaeb" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:02.828246 31414 raft_consensus.cc:2804] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.842165 31414 raft_consensus.cc:697] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Becoming Leader. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:10:02.843175 31414 consensus_queue.cc:237] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.840497 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:02.844204 31340 raft_consensus.cc:493] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.847970 31340 raft_consensus.cc:515] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.849205 31375 tablet_bootstrap.cc:654] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.850279 31340 leader_election.cc:290] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.843200 30968 catalog_manager.cc:5697] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3). New cstate: current_term: 1 leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.846020 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c79eed15b94621bddf666bfc8fdaeb" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:10:02.854050 31219 raft_consensus.cc:3060] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.854197 31071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32bd2e42647d4ddc99da3e29be81229e" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:10:02.855074 31071 raft_consensus.cc:2468] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 0.
W20260709 13:10:02.857115 31036 leader_election.cc:343] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.857750 31110 leader_election.cc:304] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.859050 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32bd2e42647d4ddc99da3e29be81229e" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:10:02.859396 31340 raft_consensus.cc:2804] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.859853 31340 raft_consensus.cc:493] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.859815 31217 raft_consensus.cc:2468] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 0.
I20260709 13:10:02.860329 31340 raft_consensus.cc:3060] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.839215 31072 raft_consensus.cc:3060] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.869890 30968 catalog_manager.cc:5697] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.871258 31340 raft_consensus.cc:515] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.874821 31070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32bd2e42647d4ddc99da3e29be81229e" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:02.875525 31070 raft_consensus.cc:3060] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.885818 31070 raft_consensus.cc:2468] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 1.
I20260709 13:10:02.887279 31110 leader_election.cc:304] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.889048 31219 raft_consensus.cc:2468] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 1.
I20260709 13:10:02.890282 31414 raft_consensus.cc:2804] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.890923 31414 raft_consensus.cc:697] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Becoming Leader. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:10:02.891412 31113 leader_election.cc:304] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:02.891857 31414 consensus_queue.cc:237] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.892567 31412 raft_consensus.cc:493] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.893138 31412 raft_consensus.cc:515] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.895267 31412 leader_election.cc:290] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.896333 31412 raft_consensus.cc:2804] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.891984 31072 raft_consensus.cc:2468] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 1.
I20260709 13:10:02.897047 31412 raft_consensus.cc:697] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Becoming Leader. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:10:02.897341 31340 leader_election.cc:290] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:02.897938 31412 consensus_queue.cc:237] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.895615 30968 catalog_manager.cc:5697] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d42393166e884a13a08fb2fe119629f2 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "d42393166e884a13a08fb2fe119629f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.899744 31375 tablet_bootstrap.cc:492] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:10:02.900398 31375 ts_tablet_manager.cc:1403] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.012s
I20260709 13:10:02.903302 31375 raft_consensus.cc:359] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.903976 31375 raft_consensus.cc:385] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.904260 31375 raft_consensus.cc:740] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.904961 31375 consensus_queue.cc:260] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.906981 31375 ts_tablet_manager.cc:1434] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:02.908023 31375 tablet_bootstrap.cc:492] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2: Bootstrap starting.
I20260709 13:10:02.910095 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56477456524849f2bf6636ff4ccbb869" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:10:02.914805 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56477456524849f2bf6636ff4ccbb869" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:10:02.915784 31219 raft_consensus.cc:2393] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d42393166e884a13a08fb2fe119629f2 in current term 1: Already voted for candidate ce05d2e38f184bc19df1fc532f05fa23 in this term.
I20260709 13:10:02.916810 31375 tablet_bootstrap.cc:654] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.919163 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32bd2e42647d4ddc99da3e29be81229e" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:10:02.919849 31219 raft_consensus.cc:3060] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.922288 31359 consensus_queue.cc:1048] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.928339 31219 raft_consensus.cc:2468] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 1.
I20260709 13:10:02.939898 31113 leader_election.cc:304] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d42393166e884a13a08fb2fe119629f2; no voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23
I20260709 13:10:02.945463 31421 raft_consensus.cc:3060] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.949261 31359 consensus_queue.cc:1048] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:02.950764 30968 catalog_manager.cc:5697] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d42393166e884a13a08fb2fe119629f2 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "d42393166e884a13a08fb2fe119629f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.953445 30968 catalog_manager.cc:5697] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d42393166e884a13a08fb2fe119629f2 (127.20.208.2). New cstate: current_term: 1 leader_uuid: "d42393166e884a13a08fb2fe119629f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.955775 31421 raft_consensus.cc:2749] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.972522 31375 tablet_bootstrap.cc:492] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2: No bootstrap required, opened a new log
I20260709 13:10:02.973043 31375 ts_tablet_manager.cc:1403] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.009s
I20260709 13:10:02.976401 31375 raft_consensus.cc:359] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.977139 31375 raft_consensus.cc:385] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.977537 31375 raft_consensus.cc:740] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.978312 31375 consensus_queue.cc:260] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:02.980612 31375 ts_tablet_manager.cc:1434] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:03.001075 31421 raft_consensus.cc:493] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.001561 31421 raft_consensus.cc:515] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.003758 31421 leader_election.cc:290] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:03.004518 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:10:03.004794 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:10:03.005520 31219 raft_consensus.cc:2393] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d42393166e884a13a08fb2fe119629f2 in current term 1: Already voted for candidate ce05d2e38f184bc19df1fc532f05fa23 in this term.
I20260709 13:10:03.006539 31113 leader_election.cc:304] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d42393166e884a13a08fb2fe119629f2; no voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23
I20260709 13:10:03.007169 31421 raft_consensus.cc:3060] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.012526 31421 raft_consensus.cc:2749] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.033226 31412 raft_consensus.cc:493] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.033785 31412 raft_consensus.cc:515] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.035907 31412 leader_election.cc:290] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:03.036873 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79943d87e54c9ba6d86ffa2c7e9369" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23" is_pre_election: true
I20260709 13:10:03.037003 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79943d87e54c9ba6d86ffa2c7e9369" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4" is_pre_election: true
I20260709 13:10:03.037652 31072 raft_consensus.cc:2393] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d42393166e884a13a08fb2fe119629f2 in current term 1: Already voted for candidate 5d80126ecf5f4933a6e789800f96c5f4 in this term.
I20260709 13:10:03.038828 31110 leader_election.cc:304] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d42393166e884a13a08fb2fe119629f2; no voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23
I20260709 13:10:03.039664 31412 raft_consensus.cc:3060] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.045517 31412 raft_consensus.cc:2749] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.053864 31387 consensus_queue.cc:1048] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.067780 31362 consensus_queue.cc:1048] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.111449 31362 consensus_queue.cc:1048] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.123121 31389 consensus_queue.cc:1048] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.159535 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc"
dest_uuid: "d42393166e884a13a08fb2fe119629f2"
mode: GRACEFUL
new_leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
 from {username='slave'} at 127.0.0.1:58936
I20260709 13:10:03.160254 31146 raft_consensus.cc:606] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Received request to transfer leadership to TS ce05d2e38f184bc19df1fc532f05fa23
I20260709 13:10:03.167197 31217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45da8414ac654d5bbe2836bbccec66ce"
dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
mode: GRACEFUL
new_leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
 from {username='slave'} at 127.0.0.1:34376
I20260709 13:10:03.167804 31217 raft_consensus.cc:606] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Received request to transfer leadership to TS ce05d2e38f184bc19df1fc532f05fa23
I20260709 13:10:03.180519 31217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "335575478644424d85ddb75b8f010124"
dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
mode: GRACEFUL
new_leader_uuid: "d42393166e884a13a08fb2fe119629f2"
 from {username='slave'} at 127.0.0.1:34376
I20260709 13:10:03.181037 31217 raft_consensus.cc:606] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Received request to transfer leadership to TS d42393166e884a13a08fb2fe119629f2
I20260709 13:10:03.191955 31072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d"
dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
mode: GRACEFUL
new_leader_uuid: "d42393166e884a13a08fb2fe119629f2"
 from {username='slave'} at 127.0.0.1:46018
I20260709 13:10:03.192682 31072 raft_consensus.cc:606] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Received request to transfer leadership to TS d42393166e884a13a08fb2fe119629f2
I20260709 13:10:03.195926 31359 consensus_queue.cc:1048] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.198508 31359 consensus_queue.cc:1048] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.220950 31413 consensus_queue.cc:1048] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.228869 31413 raft_consensus.cc:993] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4: : Instructing follower ce05d2e38f184bc19df1fc532f05fa23 to start an election
I20260709 13:10:03.229410 31388 raft_consensus.cc:1081] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Signalling peer ce05d2e38f184bc19df1fc532f05fa23 to start an election
I20260709 13:10:03.234417 31070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45da8414ac654d5bbe2836bbccec66ce"
dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
 from {username='slave'} at 127.0.0.1:45994
I20260709 13:10:03.234928 31070 raft_consensus.cc:493] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.235247 31070 raft_consensus.cc:3060] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.236027 31388 consensus_queue.cc:1048] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.243640 31070 raft_consensus.cc:515] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.244623 31072 raft_consensus.cc:1240] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Rejecting Update request from peer 5d80126ecf5f4933a6e789800f96c5f4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:03.246644 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45da8414ac654d5bbe2836bbccec66ce" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:03.250500 31217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45da8414ac654d5bbe2836bbccec66ce" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:10:03.251144 31217 raft_consensus.cc:3055] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.251489 31217 raft_consensus.cc:740] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:10:03.252359 31217 consensus_queue.cc:260] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.252995 31070 leader_election.cc:290] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 2 election: Requested vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:03.253516 31217 raft_consensus.cc:3060] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.261236 31217 raft_consensus.cc:2468] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 2.
I20260709 13:10:03.273813 31387 consensus_queue.cc:1048] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.277534 31038 leader_election.cc:304] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: d42393166e884a13a08fb2fe119629f2
I20260709 13:10:03.278645 31387 raft_consensus.cc:2804] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.279263 31387 raft_consensus.cc:697] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 2 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:10:03.280268 31387 consensus_queue.cc:237] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.295238 31362 consensus_queue.cc:1048] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.295113 30968 catalog_manager.cc:5697] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 1 to 2, leader changed from 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3) to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.310000 31412 consensus_queue.cc:1048] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.317299 31389 raft_consensus.cc:993] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23: : Instructing follower d42393166e884a13a08fb2fe119629f2 to start an election
I20260709 13:10:03.317775 31387 raft_consensus.cc:1081] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Signalling peer d42393166e884a13a08fb2fe119629f2 to start an election
I20260709 13:10:03.322734 31147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d"
dest_uuid: "d42393166e884a13a08fb2fe119629f2"
 from {username='slave'} at 127.0.0.1:38156
I20260709 13:10:03.323330 31147 raft_consensus.cc:493] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.323740 31147 raft_consensus.cc:3060] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.328590 31412 consensus_queue.cc:1048] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.333470 31147 raft_consensus.cc:515] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.336818 31072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:03.336928 31147 leader_election.cc:290] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 2 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:03.337437 31072 raft_consensus.cc:3055] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.337766 31072 raft_consensus.cc:740] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:10:03.338490 31072 consensus_queue.cc:260] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.338770 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:10:03.339437 31219 raft_consensus.cc:3060] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.339764 31072 raft_consensus.cc:3060] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.358886 31421 consensus_queue.cc:1048] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.361570 31219 raft_consensus.cc:2468] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 2.
I20260709 13:10:03.363260 31113 leader_election.cc:304] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:03.364025 31421 raft_consensus.cc:2804] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.365856 31340 consensus_queue.cc:1048] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.364988 31421 raft_consensus.cc:697] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Becoming Leader. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:10:03.369179 31340 raft_consensus.cc:993] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2: : Instructing follower ce05d2e38f184bc19df1fc532f05fa23 to start an election
I20260709 13:10:03.371297 31340 raft_consensus.cc:1081] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Signalling peer ce05d2e38f184bc19df1fc532f05fa23 to start an election
I20260709 13:10:03.371078 31421 consensus_queue.cc:237] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.368651 31072 raft_consensus.cc:2468] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 2.
I20260709 13:10:03.384145 30969 catalog_manager.cc:5697] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 reported cstate change: term changed from 1 to 2, leader changed from ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1) to d42393166e884a13a08fb2fe119629f2 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "d42393166e884a13a08fb2fe119629f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.388628 31421 consensus_queue.cc:1048] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.389633 31071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc"
dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:10:03.391136 31071 raft_consensus.cc:493] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.391544 31071 raft_consensus.cc:3060] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.410723 31071 raft_consensus.cc:515] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.413390 31071 leader_election.cc:290] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 2 election: Requested vote from peers d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:03.413669 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:03.414390 31147 raft_consensus.cc:3055] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.414701 31147 raft_consensus.cc:740] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:10:03.415531 31147 consensus_queue.cc:260] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.419657 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc" candidate_uuid: "ce05d2e38f184bc19df1fc532f05fa23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:10:03.420326 31219 raft_consensus.cc:3060] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.423421 31147 raft_consensus.cc:3060] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.427791 31219 raft_consensus.cc:2468] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 2.
I20260709 13:10:03.430302 31038 leader_election.cc:304] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: 
I20260709 13:10:03.431234 31389 raft_consensus.cc:2804] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.431730 31389 raft_consensus.cc:697] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 2 LEADER]: Becoming Leader. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:10:03.432669 31421 consensus_queue.cc:1048] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.432520 31389 consensus_queue.cc:237] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.441269 31147 raft_consensus.cc:2468] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce05d2e38f184bc19df1fc532f05fa23 in term 2.
I20260709 13:10:03.442076 30967 catalog_manager.cc:5697] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 reported cstate change: term changed from 1 to 2, leader changed from d42393166e884a13a08fb2fe119629f2 (127.20.208.2) to ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "ce05d2e38f184bc19df1fc532f05fa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.537799 31359 raft_consensus.cc:993] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4: : Instructing follower d42393166e884a13a08fb2fe119629f2 to start an election
I20260709 13:10:03.538270 31388 raft_consensus.cc:1081] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Signalling peer d42393166e884a13a08fb2fe119629f2 to start an election
I20260709 13:10:03.539889 31147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "335575478644424d85ddb75b8f010124"
dest_uuid: "d42393166e884a13a08fb2fe119629f2"
 from {username='slave'} at 127.0.0.1:38158
I20260709 13:10:03.540521 31147 raft_consensus.cc:493] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.540904 31147 raft_consensus.cc:3060] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.546147 31147 raft_consensus.cc:515] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.548346 31147 leader_election.cc:290] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 2 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3:35053)
I20260709 13:10:03.548789 31071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335575478644424d85ddb75b8f010124" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:03.549140 31219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335575478644424d85ddb75b8f010124" candidate_uuid: "d42393166e884a13a08fb2fe119629f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
I20260709 13:10:03.549541 31071 raft_consensus.cc:3060] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.549803 31219 raft_consensus.cc:3055] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.550150 31219 raft_consensus.cc:740] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:10:03.550877 31219 consensus_queue.cc:260] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.551844 31219 raft_consensus.cc:3060] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.555172 31071 raft_consensus.cc:2468] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 2.
I20260709 13:10:03.556428 31110 leader_election.cc:304] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce05d2e38f184bc19df1fc532f05fa23, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:03.557147 31421 raft_consensus.cc:2804] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.557245 31219 raft_consensus.cc:2468] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d42393166e884a13a08fb2fe119629f2 in term 2.
I20260709 13:10:03.557591 31421 raft_consensus.cc:697] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Becoming Leader. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:10:03.558459 31421 consensus_queue.cc:237] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:03.565456 30968 catalog_manager.cc:5697] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 reported cstate change: term changed from 1 to 2, leader changed from 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3) to d42393166e884a13a08fb2fe119629f2 (127.20.208.2). New cstate: current_term: 2 leader_uuid: "d42393166e884a13a08fb2fe119629f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.683357 31147 raft_consensus.cc:3060] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.689842 31147 raft_consensus.cc:1275] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Refusing update from remote peer ce05d2e38f184bc19df1fc532f05fa23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.691159 31389 consensus_queue.cc:1048] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.693884 31219 raft_consensus.cc:1275] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Refusing update from remote peer ce05d2e38f184bc19df1fc532f05fa23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.695319 31362 consensus_queue.cc:1048] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.775681 31071 raft_consensus.cc:1275] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Refusing update from remote peer d42393166e884a13a08fb2fe119629f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.776968 31421 consensus_queue.cc:1048] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.784811 31219 raft_consensus.cc:1275] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Refusing update from remote peer d42393166e884a13a08fb2fe119629f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.786698 31412 consensus_queue.cc:1048] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.934154 31219 raft_consensus.cc:1275] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Refusing update from remote peer ce05d2e38f184bc19df1fc532f05fa23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.935487 31387 consensus_queue.cc:1048] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.944355 31147 raft_consensus.cc:1275] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Refusing update from remote peer ce05d2e38f184bc19df1fc532f05fa23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.947489 31362 consensus_queue.cc:1048] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.135349 31221 raft_consensus.cc:1275] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Refusing update from remote peer d42393166e884a13a08fb2fe119629f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.136719 31412 consensus_queue.cc:1048] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.145830 31070 raft_consensus.cc:1275] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Refusing update from remote peer d42393166e884a13a08fb2fe119629f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.147673 31412 consensus_queue.cc:1048] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:06.220520 30968 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53434:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:06.250156 30968 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53434:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:06.379561 31488 tablet.cc:1724] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.441639 21312 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:06.448699 31494 tablet.cc:1724] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.454911 31493 tablet.cc:1724] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.420316 31486 tablet.cc:1724] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:06.485440 31247 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:56477456524849f2bf6636ff4ccbb869)
W20260709 13:10:06.485989 31036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:36033, user_credentials={real_user=slave}} blocked reactor thread for 87744.8us
I20260709 13:10:06.370857 31489 tablet.cc:1724] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:06.495716 31247 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:56477456524849f2bf6636ff4ccbb869)
W20260709 13:10:06.499158 31247 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:56477456524849f2bf6636ff4ccbb869)
I20260709 13:10:06.485797 31487 tablet.cc:1724] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:06.538935 31038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:35053, user_credentials={real_user=slave}} blocked reactor thread for 48221.4us
W20260709 13:10:06.552942 31491 log.cc:927] Time spent T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:10:06.604833 31494 tablet.cc:1724] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.654186 31487 tablet.cc:1724] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.657512 31510 tablet.cc:1724] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.663682 31517 tablet.cc:1724] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.666013 31513 tablet.cc:1724] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.688750 31489 tablet.cc:1724] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.692447 31488 tablet.cc:1724] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.709203 31518 tablet.cc:1724] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.724184 31522 tablet.cc:1724] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.733311 31520 tablet.cc:1724] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.745790 31486 tablet.cc:1724] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.748306 31487 tablet.cc:1724] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.757643 31493 tablet.cc:1724] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.754747 31494 tablet.cc:1724] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.767539 31070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc"
dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
mode: GRACEFUL
new_leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
 from {username='slave'} at 127.0.0.1:56108
I20260709 13:10:06.768489 31070 raft_consensus.cc:606] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 2 LEADER]: Received request to transfer leadership to TS 5d80126ecf5f4933a6e789800f96c5f4
I20260709 13:10:06.786103 31522 tablet.cc:1724] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.787168 31510 tablet.cc:1724] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.790402 31489 tablet.cc:1724] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.802407 31147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d"
dest_uuid: "d42393166e884a13a08fb2fe119629f2"
mode: GRACEFUL
new_leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
 from {username='slave'} at 127.0.0.1:58952
I20260709 13:10:06.803157 31147 raft_consensus.cc:606] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Received request to transfer leadership to TS 5d80126ecf5f4933a6e789800f96c5f4
I20260709 13:10:06.805578 21312 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:10:06.806284 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:06.808934 31513 tablet.cc:1724] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.814800 31488 tablet.cc:1724] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.819665 31520 tablet.cc:1724] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.824543 31518 tablet.cc:1724] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:06.839814 31147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cc088e451c3470787cf7bdd4872aa63"
dest_uuid: "d42393166e884a13a08fb2fe119629f2"
mode: GRACEFUL
new_leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
 from {username='slave'} at 127.0.0.1:58952
I20260709 13:10:06.840399 31147 raft_consensus.cc:606] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Received request to transfer leadership to TS 5d80126ecf5f4933a6e789800f96c5f4
I20260709 13:10:06.843724 31069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce396f6423ca457bbe84ae15fe26aa3e"
dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
mode: GRACEFUL
new_leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
 from {username='slave'} at 127.0.0.1:56108
I20260709 13:10:06.844408 31069 raft_consensus.cc:606] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Received request to transfer leadership to TS 5d80126ecf5f4933a6e789800f96c5f4
I20260709 13:10:06.844053 30968 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d: soft_deleted_table [id=a0c9249422cd4df28684bae1117f0335] alter complete (version 1)
I20260709 13:10:06.848412 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:06.849112 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:06.912670 31499 raft_consensus.cc:993] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23: : Instructing follower 5d80126ecf5f4933a6e789800f96c5f4 to start an election
I20260709 13:10:06.913282 31502 raft_consensus.cc:1081] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Signalling peer 5d80126ecf5f4933a6e789800f96c5f4 to start an election
I20260709 13:10:06.915132 31217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce396f6423ca457bbe84ae15fe26aa3e"
dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
 from {username='slave'} at 127.0.0.1:34362
I20260709 13:10:06.915988 31217 raft_consensus.cc:493] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.916460 31217 raft_consensus.cc:3060] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:06.923740 31217 raft_consensus.cc:515] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:10:06.925572 31217 leader_election.cc:290] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 2 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:10:06.926872 31069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce396f6423ca457bbe84ae15fe26aa3e" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:06.926878 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce396f6423ca457bbe84ae15fe26aa3e" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:06.928138 31069 raft_consensus.cc:3055] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:06.928192 31147 raft_consensus.cc:3060] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:06.928588 31069 raft_consensus.cc:740] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:10:06.929674 31069 consensus_queue.cc:260] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:10:06.931277 31069 raft_consensus.cc:3060] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:06.938271 31147 raft_consensus.cc:2468] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 2.
I20260709 13:10:06.939745 31069 raft_consensus.cc:2468] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 2.
I20260709 13:10:06.939903 31185 leader_election.cc:304] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:06.941000 31503 raft_consensus.cc:2804] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:06.941638 31503 raft_consensus.cc:697] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:10:06.942617 31503 consensus_queue.cc:237] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } }
I20260709 13:10:06.954456 30968 catalog_manager.cc:5697] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 reported cstate change: term changed from 1 to 2, leader changed from ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1) to 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.091408 31502 raft_consensus.cc:993] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23: : Instructing follower 5d80126ecf5f4933a6e789800f96c5f4 to start an election
I20260709 13:10:07.091853 31499 raft_consensus.cc:1081] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 2 LEADER]: Signalling peer 5d80126ecf5f4933a6e789800f96c5f4 to start an election
I20260709 13:10:07.093554 31221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc"
dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
 from {username='slave'} at 127.0.0.1:34362
I20260709 13:10:07.094092 31221 raft_consensus.cc:493] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.094416 31221 raft_consensus.cc:3060] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.101511 31221 raft_consensus.cc:515] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:07.103215 31221 leader_election.cc:290] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 3 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:10:07.104210 31069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:07.104265 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b06da5416fe44fe8cc53f8486cd2dfc" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:07.104884 31069 raft_consensus.cc:3055] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:07.104938 31147 raft_consensus.cc:3060] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.105206 31069 raft_consensus.cc:740] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce05d2e38f184bc19df1fc532f05fa23, State: Running, Role: LEADER
I20260709 13:10:07.106331 31069 consensus_queue.cc:260] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:07.107424 31069 raft_consensus.cc:3060] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.110945 31147 raft_consensus.cc:2468] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 3.
I20260709 13:10:07.112330 31185 leader_election.cc:304] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:07.113281 31503 raft_consensus.cc:2804] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:07.113521 31069 raft_consensus.cc:2468] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 3.
I20260709 13:10:07.113734 31503 raft_consensus.cc:697] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 3 LEADER]: Becoming Leader. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:10:07.114986 31503 consensus_queue.cc:237] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:07.125131 30968 catalog_manager.cc:5697] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 reported cstate change: term changed from 2 to 3, leader changed from ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1) to 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3). New cstate: current_term: 3 leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.125864 31479 raft_consensus.cc:993] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2: : Instructing follower 5d80126ecf5f4933a6e789800f96c5f4 to start an election
I20260709 13:10:07.126638 31505 raft_consensus.cc:1081] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Signalling peer 5d80126ecf5f4933a6e789800f96c5f4 to start an election
I20260709 13:10:07.128944 31221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d"
dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
 from {username='slave'} at 127.0.0.1:34368
I20260709 13:10:07.129678 31221 raft_consensus.cc:493] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.130116 31221 raft_consensus.cc:3060] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.140434 31221 raft_consensus.cc:515] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:07.142944 31221 leader_election.cc:290] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 3 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:10:07.144621 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:07.145506 31147 raft_consensus.cc:3055] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:07.145869 31147 raft_consensus.cc:740] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:10:07.146498 31505 raft_consensus.cc:993] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2: : Instructing follower 5d80126ecf5f4933a6e789800f96c5f4 to start an election
I20260709 13:10:07.147132 31479 raft_consensus.cc:1081] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Signalling peer 5d80126ecf5f4933a6e789800f96c5f4 to start an election
I20260709 13:10:07.146716 31147 consensus_queue.cc:260] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:07.143748 31069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab46c22e6c545ea8c5d902d18e8008d" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:07.147883 31069 raft_consensus.cc:3060] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.148988 31147 raft_consensus.cc:3060] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.149580 31221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cc088e451c3470787cf7bdd4872aa63"
dest_uuid: "5d80126ecf5f4933a6e789800f96c5f4"
 from {username='slave'} at 127.0.0.1:34368
I20260709 13:10:07.151353 31221 raft_consensus.cc:493] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.151674 31221 raft_consensus.cc:3060] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.156438 31069 raft_consensus.cc:2468] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 3.
I20260709 13:10:07.157820 31184 leader_election.cc:304] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, ce05d2e38f184bc19df1fc532f05fa23; no voters: 
I20260709 13:10:07.158143 31221 raft_consensus.cc:515] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:07.158792 31503 raft_consensus.cc:2804] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:07.159296 31503 raft_consensus.cc:697] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 3 LEADER]: Becoming Leader. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:10:07.160216 31503 consensus_queue.cc:237] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:07.161011 31147 raft_consensus.cc:2468] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 3.
I20260709 13:10:07.161281 31221 leader_election.cc:290] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 2 election: Requested vote from peers ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027), d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033)
I20260709 13:10:07.165346 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc088e451c3470787cf7bdd4872aa63" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d42393166e884a13a08fb2fe119629f2"
I20260709 13:10:07.166163 31147 raft_consensus.cc:3055] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.166488 31147 raft_consensus.cc:740] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d42393166e884a13a08fb2fe119629f2, State: Running, Role: LEADER
I20260709 13:10:07.167359 31147 consensus_queue.cc:260] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:07.169137 31147 raft_consensus.cc:3060] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.169081 30968 catalog_manager.cc:5697] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 reported cstate change: term changed from 2 to 3, leader changed from d42393166e884a13a08fb2fe119629f2 (127.20.208.2) to 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3). New cstate: current_term: 3 leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.172916 31069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc088e451c3470787cf7bdd4872aa63" candidate_uuid: "5d80126ecf5f4933a6e789800f96c5f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce05d2e38f184bc19df1fc532f05fa23"
I20260709 13:10:07.173673 31069 raft_consensus.cc:3060] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.176247 31147 raft_consensus.cc:2468] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 2.
I20260709 13:10:07.177630 31185 leader_election.cc:304] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d80126ecf5f4933a6e789800f96c5f4, d42393166e884a13a08fb2fe119629f2; no voters: 
I20260709 13:10:07.178560 31503 raft_consensus.cc:2804] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.179096 31503 raft_consensus.cc:697] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d80126ecf5f4933a6e789800f96c5f4, State: Running, Role: LEADER
I20260709 13:10:07.180014 31503 consensus_queue.cc:237] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } }
I20260709 13:10:07.185909 31069 raft_consensus.cc:2468] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d80126ecf5f4933a6e789800f96c5f4 in term 2.
I20260709 13:10:07.188978 30968 catalog_manager.cc:5697] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 reported cstate change: term changed from 1 to 2, leader changed from d42393166e884a13a08fb2fe119629f2 (127.20.208.2) to 5d80126ecf5f4933a6e789800f96c5f4 (127.20.208.3). New cstate: current_term: 2 leader_uuid: "5d80126ecf5f4933a6e789800f96c5f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d80126ecf5f4933a6e789800f96c5f4" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 35053 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.323251 31147 raft_consensus.cc:1275] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Refusing update from remote peer 5d80126ecf5f4933a6e789800f96c5f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.324622 31503 consensus_queue.cc:1048] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.334903 31069 raft_consensus.cc:1275] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Refusing update from remote peer 5d80126ecf5f4933a6e789800f96c5f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.336544 31503 consensus_queue.cc:1048] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.580523 31147 raft_consensus.cc:1275] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Refusing update from remote peer 5d80126ecf5f4933a6e789800f96c5f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.581672 31503 consensus_queue.cc:1048] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.593240 31069 raft_consensus.cc:1275] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Refusing update from remote peer 5d80126ecf5f4933a6e789800f96c5f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.594679 31532 consensus_queue.cc:1048] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.605803 31069 raft_consensus.cc:1275] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 3 FOLLOWER]: Refusing update from remote peer 5d80126ecf5f4933a6e789800f96c5f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:07.607218 31532 consensus_queue.cc:1048] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.616559 31147 raft_consensus.cc:1275] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 3 FOLLOWER]: Refusing update from remote peer 5d80126ecf5f4933a6e789800f96c5f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:07.619134 31538 consensus_queue.cc:1048] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.699376 31069 raft_consensus.cc:1275] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 3 FOLLOWER]: Refusing update from remote peer 5d80126ecf5f4933a6e789800f96c5f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:07.700947 31538 consensus_queue.cc:1048] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce05d2e38f184bc19df1fc532f05fa23" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.709256 31147 raft_consensus.cc:1275] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 3 FOLLOWER]: Refusing update from remote peer 5d80126ecf5f4933a6e789800f96c5f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:07.711012 31532 consensus_queue.cc:1048] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d42393166e884a13a08fb2fe119629f2" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.912287 21312 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:07.917656 21312 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:10:07.918087 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:07.922748 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:10:07.923161 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:08.953824 21312 tablet_server.cc:179] TabletServer@127.20.208.1:0 shutting down...
W20260709 13:10:08.976451 31110 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:10:08.980274 31110 consensus_peers.cc:597] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 -> Peer ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027): Couldn't send request to peer ce05d2e38f184bc19df1fc532f05fa23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:08.981432 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:08.982163 21312 tablet_replica.cc:333] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:08.982982 21312 raft_consensus.cc:2243] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.983484 21312 raft_consensus.cc:2272] T a6c79eed15b94621bddf666bfc8fdaeb P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.985826 21312 tablet_replica.cc:333] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:08.986407 21312 raft_consensus.cc:2243] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:08.987212 21312 raft_consensus.cc:2272] T e4465377aac643f284a288f9de196500 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.989477 21312 tablet_replica.cc:333] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:08.990170 21312 raft_consensus.cc:2243] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.990638 21312 raft_consensus.cc:2272] T 32bd2e42647d4ddc99da3e29be81229e P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.992836 21312 tablet_replica.cc:333] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:08.993464 21312 raft_consensus.cc:2243] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:08.994208 21312 raft_consensus.cc:2272] T 45da8414ac654d5bbe2836bbccec66ce P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.996245 21312 tablet_replica.cc:333] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:08.996830 21312 raft_consensus.cc:2243] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.997375 21312 raft_consensus.cc:2272] T eab46c22e6c545ea8c5d902d18e8008d P ce05d2e38f184bc19df1fc532f05fa23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.999374 21312 tablet_replica.cc:333] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:08.999966 21312 raft_consensus.cc:2243] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.000412 21312 raft_consensus.cc:2272] T 335575478644424d85ddb75b8f010124 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.002430 21312 tablet_replica.cc:333] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.002995 21312 raft_consensus.cc:2243] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.003799 21312 raft_consensus.cc:2272] T 8b3fd74c378e4e76b9969c930b4a451d P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.006160 21312 tablet_replica.cc:333] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.006752 21312 raft_consensus.cc:2243] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.007153 21312 raft_consensus.cc:2272] T 2b06da5416fe44fe8cc53f8486cd2dfc P ce05d2e38f184bc19df1fc532f05fa23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.009573 21312 tablet_replica.cc:333] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.010313 21312 raft_consensus.cc:2243] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.011261 21312 raft_consensus.cc:2272] T 56477456524849f2bf6636ff4ccbb869 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.013686 21312 tablet_replica.cc:333] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.014282 21312 raft_consensus.cc:2243] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.014778 21312 raft_consensus.cc:2272] T 7cc088e451c3470787cf7bdd4872aa63 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.017032 21312 tablet_replica.cc:333] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.017638 21312 raft_consensus.cc:2243] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.018474 21312 raft_consensus.cc:2272] T 4e8fb42087c24f308459e5024c577187 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.020819 21312 tablet_replica.cc:333] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.021404 21312 raft_consensus.cc:2243] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.021883 21312 raft_consensus.cc:2272] T de6dd49ffeca47138091d11fab77470d P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.024376 21312 tablet_replica.cc:333] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.025125 21312 raft_consensus.cc:2243] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.025545 21312 raft_consensus.cc:2272] T ce396f6423ca457bbe84ae15fe26aa3e P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.027745 21312 tablet_replica.cc:333] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.028302 21312 raft_consensus.cc:2243] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.028836 21312 raft_consensus.cc:2272] T 1e20bdc4bdb049279a21da9073cf49fb P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.031134 21312 tablet_replica.cc:333] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.031761 21312 raft_consensus.cc:2243] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.032244 21312 raft_consensus.cc:2272] T ca79943d87e54c9ba6d86ffa2c7e9369 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.034463 21312 tablet_replica.cc:333] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.035063 21312 raft_consensus.cc:2243] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.035976 21312 raft_consensus.cc:2272] T b2402ee9214c4f5ea568e3d3816e9b52 P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.038408 21312 tablet_replica.cc:333] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.038969 21312 raft_consensus.cc:2243] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.039440 21312 raft_consensus.cc:2272] T ec2d68a877274a1eb3d47c3962b21cef P ce05d2e38f184bc19df1fc532f05fa23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.042075 21312 tablet_replica.cc:333] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23: stopping tablet replica
I20260709 13:10:09.042671 21312 raft_consensus.cc:2243] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.043181 21312 raft_consensus.cc:2272] T c9a63f3b41bc43c584f8ccb597e99142 P ce05d2e38f184bc19df1fc532f05fa23 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:09.066372 31110 consensus_peers.cc:597] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 -> Peer ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027): Couldn't send request to peer ce05d2e38f184bc19df1fc532f05fa23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:09.067057 31110 consensus_peers.cc:597] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 -> Peer ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027): Couldn't send request to peer ce05d2e38f184bc19df1fc532f05fa23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.089192 21312 tablet_server.cc:196] TabletServer@127.20.208.1:0 shutdown complete.
W20260709 13:10:09.103399 31184 consensus_peers.cc:597] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 -> Peer ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027): Couldn't send request to peer ce05d2e38f184bc19df1fc532f05fa23. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:38027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.126230 21312 tablet_server.cc:179] TabletServer@127.20.208.2:0 shutting down...
I20260709 13:10:09.155637 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:09.156383 21312 tablet_replica.cc:333] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.157449 21312 raft_consensus.cc:2243] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.158027 21312 raft_consensus.cc:2272] T eab46c22e6c545ea8c5d902d18e8008d P d42393166e884a13a08fb2fe119629f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.160265 21312 tablet_replica.cc:333] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.160981 21312 raft_consensus.cc:2243] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.161936 21312 raft_consensus.cc:2272] T 32bd2e42647d4ddc99da3e29be81229e P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:09.162366 31110 consensus_peers.cc:597] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 -> Peer ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027): Couldn't send request to peer ce05d2e38f184bc19df1fc532f05fa23. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:38027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.164767 21312 tablet_replica.cc:333] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
W20260709 13:10:09.165472 31185 consensus_peers.cc:597] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 -> Peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Couldn't send request to peer d42393166e884a13a08fb2fe119629f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.165681 21312 raft_consensus.cc:2243] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.166381 21312 raft_consensus.cc:2272] T 45da8414ac654d5bbe2836bbccec66ce P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:09.168238 31184 consensus_peers.cc:597] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 -> Peer ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027): Couldn't send request to peer ce05d2e38f184bc19df1fc532f05fa23. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:38027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.169062 21312 tablet_replica.cc:333] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.169816 21312 raft_consensus.cc:2243] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.170281 21312 raft_consensus.cc:2272] T 56477456524849f2bf6636ff4ccbb869 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.172245 21312 tablet_replica.cc:333] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.172874 21312 raft_consensus.cc:2243] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.173643 21312 raft_consensus.cc:2272] T a6c79eed15b94621bddf666bfc8fdaeb P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.175805 21312 tablet_replica.cc:333] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.176679 21312 raft_consensus.cc:2243] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.177178 21312 raft_consensus.cc:2272] T e4465377aac643f284a288f9de196500 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.179593 21312 tablet_replica.cc:333] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
W20260709 13:10:09.179592 31184 consensus_peers.cc:597] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 -> Peer ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027): Couldn't send request to peer ce05d2e38f184bc19df1fc532f05fa23. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:38027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.180666 21312 raft_consensus.cc:2243] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.181138 21312 raft_consensus.cc:2272] T 7cc088e451c3470787cf7bdd4872aa63 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.183382 21312 tablet_replica.cc:333] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.184115 21312 raft_consensus.cc:2243] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.185089 21312 raft_consensus.cc:2272] T 335575478644424d85ddb75b8f010124 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.187842 21312 tablet_replica.cc:333] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.188426 21312 raft_consensus.cc:2243] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:09.188616 31184 consensus_peers.cc:597] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 -> Peer ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027): Couldn't send request to peer ce05d2e38f184bc19df1fc532f05fa23. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:38027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.189507 21312 raft_consensus.cc:2272] T ec2d68a877274a1eb3d47c3962b21cef P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.191639 21312 tablet_replica.cc:333] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.192216 21312 raft_consensus.cc:2243] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.193061 21312 raft_consensus.cc:2272] T c9a63f3b41bc43c584f8ccb597e99142 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.195190 21312 tablet_replica.cc:333] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.195757 21312 raft_consensus.cc:2243] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.196164 21312 raft_consensus.cc:2272] T 4e8fb42087c24f308459e5024c577187 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.198348 21312 tablet_replica.cc:333] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.198875 21312 raft_consensus.cc:2243] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.199653 21312 raft_consensus.cc:2272] T de6dd49ffeca47138091d11fab77470d P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.201773 21312 tablet_replica.cc:333] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.202296 21312 raft_consensus.cc:2243] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.202694 21312 raft_consensus.cc:2272] T ce396f6423ca457bbe84ae15fe26aa3e P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.204918 21312 tablet_replica.cc:333] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.205478 21312 raft_consensus.cc:2243] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.205924 21312 raft_consensus.cc:2272] T 2b06da5416fe44fe8cc53f8486cd2dfc P d42393166e884a13a08fb2fe119629f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.208129 21312 tablet_replica.cc:333] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.208741 21312 raft_consensus.cc:2243] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:09.208964 31184 consensus_peers.cc:597] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 -> Peer ce05d2e38f184bc19df1fc532f05fa23 (127.20.208.1:38027): Couldn't send request to peer ce05d2e38f184bc19df1fc532f05fa23. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:38027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.209199 21312 raft_consensus.cc:2272] T 8b3fd74c378e4e76b9969c930b4a451d P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.211545 21312 tablet_replica.cc:333] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.212384 21312 raft_consensus.cc:2243] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.212984 21312 raft_consensus.cc:2272] T 1e20bdc4bdb049279a21da9073cf49fb P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.215188 21312 tablet_replica.cc:333] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.215726 21312 raft_consensus.cc:2243] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.216171 21312 raft_consensus.cc:2272] T ca79943d87e54c9ba6d86ffa2c7e9369 P d42393166e884a13a08fb2fe119629f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.218282 21312 tablet_replica.cc:333] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2: stopping tablet replica
I20260709 13:10:09.218777 21312 raft_consensus.cc:2243] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.219283 21312 raft_consensus.cc:2272] T b2402ee9214c4f5ea568e3d3816e9b52 P d42393166e884a13a08fb2fe119629f2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:09.239185 31185 consensus_peers.cc:597] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 -> Peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Couldn't send request to peer d42393166e884a13a08fb2fe119629f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.264842 21312 tablet_server.cc:196] TabletServer@127.20.208.2:0 shutdown complete.
I20260709 13:10:09.300282 21312 tablet_server.cc:179] TabletServer@127.20.208.3:0 shutting down...
W20260709 13:10:09.315841 31185 consensus_peers.cc:597] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 -> Peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Couldn't send request to peer d42393166e884a13a08fb2fe119629f2. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:36033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.331456 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:09.332343 21312 tablet_replica.cc:333] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.333230 21312 raft_consensus.cc:2243] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.334451 21312 raft_consensus.cc:2272] T eab46c22e6c545ea8c5d902d18e8008d P 5d80126ecf5f4933a6e789800f96c5f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.336796 21312 tablet_replica.cc:333] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.337368 21312 raft_consensus.cc:2243] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.337792 21312 raft_consensus.cc:2272] T a6c79eed15b94621bddf666bfc8fdaeb P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.339736 21312 tablet_replica.cc:333] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.340317 21312 raft_consensus.cc:2243] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.340785 21312 raft_consensus.cc:2272] T 32bd2e42647d4ddc99da3e29be81229e P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.342793 21312 tablet_replica.cc:333] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.343451 21312 raft_consensus.cc:2243] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.343937 21312 raft_consensus.cc:2272] T 45da8414ac654d5bbe2836bbccec66ce P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.346298 21312 tablet_replica.cc:333] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.346944 21312 raft_consensus.cc:2243] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.347502 21312 raft_consensus.cc:2272] T 56477456524849f2bf6636ff4ccbb869 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.349900 21312 tablet_replica.cc:333] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.350649 21312 raft_consensus.cc:2243] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.351138 21312 raft_consensus.cc:2272] T e4465377aac643f284a288f9de196500 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:09.351744 31185 consensus_peers.cc:597] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 -> Peer d42393166e884a13a08fb2fe119629f2 (127.20.208.2:36033): Couldn't send request to peer d42393166e884a13a08fb2fe119629f2. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:36033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.353354 21312 tablet_replica.cc:333] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.353998 21312 raft_consensus.cc:2243] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.354764 21312 raft_consensus.cc:2272] T 7cc088e451c3470787cf7bdd4872aa63 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.356936 21312 tablet_replica.cc:333] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.357522 21312 raft_consensus.cc:2243] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.357968 21312 raft_consensus.cc:2272] T 4e8fb42087c24f308459e5024c577187 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.360140 21312 tablet_replica.cc:333] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.360772 21312 raft_consensus.cc:2243] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.361244 21312 raft_consensus.cc:2272] T de6dd49ffeca47138091d11fab77470d P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.363341 21312 tablet_replica.cc:333] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.363898 21312 raft_consensus.cc:2243] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.364709 21312 raft_consensus.cc:2272] T 2b06da5416fe44fe8cc53f8486cd2dfc P 5d80126ecf5f4933a6e789800f96c5f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.366945 21312 tablet_replica.cc:333] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.367535 21312 raft_consensus.cc:2243] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.367995 21312 raft_consensus.cc:2272] T 8b3fd74c378e4e76b9969c930b4a451d P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.370077 21312 tablet_replica.cc:333] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.370620 21312 raft_consensus.cc:2243] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.371429 21312 raft_consensus.cc:2272] T ce396f6423ca457bbe84ae15fe26aa3e P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.373485 21312 tablet_replica.cc:333] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.374003 21312 raft_consensus.cc:2243] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.374419 21312 raft_consensus.cc:2272] T c9a63f3b41bc43c584f8ccb597e99142 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.376821 21312 tablet_replica.cc:333] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.377411 21312 raft_consensus.cc:2243] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.377879 21312 raft_consensus.cc:2272] T 335575478644424d85ddb75b8f010124 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.379906 21312 tablet_replica.cc:333] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.380400 21312 raft_consensus.cc:2243] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.380873 21312 raft_consensus.cc:2272] T ec2d68a877274a1eb3d47c3962b21cef P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.382840 21312 tablet_replica.cc:333] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.383327 21312 raft_consensus.cc:2243] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.384110 21312 raft_consensus.cc:2272] T 1e20bdc4bdb049279a21da9073cf49fb P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.386170 21312 tablet_replica.cc:333] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.386680 21312 raft_consensus.cc:2243] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.387470 21312 raft_consensus.cc:2272] T ca79943d87e54c9ba6d86ffa2c7e9369 P 5d80126ecf5f4933a6e789800f96c5f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.389694 21312 tablet_replica.cc:333] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4: stopping tablet replica
I20260709 13:10:09.390187 21312 raft_consensus.cc:2243] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:09.390661 21312 raft_consensus.cc:2272] T b2402ee9214c4f5ea568e3d3816e9b52 P 5d80126ecf5f4933a6e789800f96c5f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.451443 21312 tablet_server.cc:196] TabletServer@127.20.208.3:0 shutdown complete.
I20260709 13:10:09.484999 21312 master.cc:562] Master@127.20.208.62:35955 shutting down...
I20260709 13:10:09.508105 21312 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:09.508698 21312 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:09.509056 21312 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6e4aa2f2127b4332916b420a677aa85d: stopping tablet replica
I20260709 13:10:09.529537 21312 master.cc:584] Master@127.20.208.62:35955 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12745 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:10:09.578114 21312 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.208.62:46033
I20260709 13:10:09.579228 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:09.584585 31546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:09.584628 31547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:09.586171 31549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:09.587284 21312 server_base.cc:1061] running on GCE node
I20260709 13:10:09.588166 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:09.588342 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:09.588454 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602609588442 us; error 0 us; skew 500 ppm
I20260709 13:10:09.588982 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:09.591254 21312 webserver.cc:533] Webserver started at http://127.20.208.62:44987/ using document root <none> and password file <none>
I20260709 13:10:09.591687 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:09.591835 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:09.592038 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:09.593101 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/master-0-root/instance:
uuid: "7cabd3083fff4882b97bf3e541924bc6"
format_stamp: "Formatted at 2026-07-09 13:10:09 on dist-test-slave-6j4g"
I20260709 13:10:09.597551 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:10:09.600929 31554 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:09.601687 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:09.601958 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/master-0-root
uuid: "7cabd3083fff4882b97bf3e541924bc6"
format_stamp: "Formatted at 2026-07-09 13:10:09 on dist-test-slave-6j4g"
I20260709 13:10:09.602226 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:09.614233 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:09.615518 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:09.652885 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.62:46033
I20260709 13:10:09.652985 31605 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.62:46033 every 8 connection(s)
I20260709 13:10:09.656788 31606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.668097 31606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6: Bootstrap starting.
I20260709 13:10:09.673197 31606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.677817 31606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6: No bootstrap required, opened a new log
I20260709 13:10:09.680033 31606 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cabd3083fff4882b97bf3e541924bc6" member_type: VOTER }
I20260709 13:10:09.680431 31606 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.680685 31606 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cabd3083fff4882b97bf3e541924bc6, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.681317 31606 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cabd3083fff4882b97bf3e541924bc6" member_type: VOTER }
I20260709 13:10:09.681767 31606 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:09.681985 31606 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:09.682246 31606 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.687029 31606 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cabd3083fff4882b97bf3e541924bc6" member_type: VOTER }
I20260709 13:10:09.687564 31606 leader_election.cc:304] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cabd3083fff4882b97bf3e541924bc6; no voters: 
I20260709 13:10:09.688807 31606 leader_election.cc:290] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:09.689136 31609 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.690438 31609 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cabd3083fff4882b97bf3e541924bc6, State: Running, Role: LEADER
I20260709 13:10:09.691120 31609 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cabd3083fff4882b97bf3e541924bc6" member_type: VOTER }
I20260709 13:10:09.691757 31606 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:09.695762 31611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cabd3083fff4882b97bf3e541924bc6. Latest consensus state: current_term: 1 leader_uuid: "7cabd3083fff4882b97bf3e541924bc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cabd3083fff4882b97bf3e541924bc6" member_type: VOTER } }
I20260709 13:10:09.695611 31610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cabd3083fff4882b97bf3e541924bc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cabd3083fff4882b97bf3e541924bc6" member_type: VOTER } }
I20260709 13:10:09.696422 31611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:09.696561 31610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:09.701684 31616 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:09.709328 31616 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:09.710335 21312 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:09.719447 31616 catalog_manager.cc:1383] Generated new cluster ID: bafac894b3304fc7a0a26779fbbfa3e5
I20260709 13:10:09.719784 31616 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:09.734689 31616 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:09.736088 31616 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:09.754634 31616 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6: Generated new TSK 0
I20260709 13:10:09.755295 31616 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:09.776926 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:09.783236 31627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:09.784319 31628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:09.785651 31630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:09.786388 21312 server_base.cc:1061] running on GCE node
I20260709 13:10:09.787331 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:09.787518 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:09.787645 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602609787633 us; error 0 us; skew 500 ppm
I20260709 13:10:09.788125 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:09.790444 21312 webserver.cc:533] Webserver started at http://127.20.208.1:44355/ using document root <none> and password file <none>
I20260709 13:10:09.790921 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:09.791079 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:09.791309 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:09.792512 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-0-root/instance:
uuid: "8cafcc485f084cd79accfcaab629c721"
format_stamp: "Formatted at 2026-07-09 13:10:09 on dist-test-slave-6j4g"
I20260709 13:10:09.796975 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:09.800395 31635 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:09.801227 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:10:09.801519 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-0-root
uuid: "8cafcc485f084cd79accfcaab629c721"
format_stamp: "Formatted at 2026-07-09 13:10:09 on dist-test-slave-6j4g"
I20260709 13:10:09.801807 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:09.813052 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:09.814280 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:09.815691 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:09.818274 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:09.818562 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:09.818877 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:09.819046 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:09.859897 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.1:43965
I20260709 13:10:09.859997 31697 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.1:43965 every 8 connection(s)
I20260709 13:10:09.865101 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:09.873029 31702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:09.874858 31703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:09.877825 21312 server_base.cc:1061] running on GCE node
W20260709 13:10:09.877745 31705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:09.879588 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:09.879896 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:09.880100 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602609880078 us; error 0 us; skew 500 ppm
I20260709 13:10:09.880697 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:09.883347 31698 heartbeater.cc:344] Connected to a master server at 127.20.208.62:46033
I20260709 13:10:09.883515 21312 webserver.cc:533] Webserver started at http://127.20.208.2:33761/ using document root <none> and password file <none>
I20260709 13:10:09.883721 31698 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:09.884189 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:09.884408 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:09.884625 31698 heartbeater.cc:507] Master 127.20.208.62:46033 requested a full tablet report, sending...
I20260709 13:10:09.884737 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:09.886279 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-1-root/instance:
uuid: "40160dd8a5d24fa0b035643d5b06852b"
format_stamp: "Formatted at 2026-07-09 13:10:09 on dist-test-slave-6j4g"
I20260709 13:10:09.887033 31571 ts_manager.cc:194] Registered new tserver with Master: 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965)
I20260709 13:10:09.889591 31571 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55470
I20260709 13:10:09.892690 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:09.896338 31710 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:09.897173 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:09.897490 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-1-root
uuid: "40160dd8a5d24fa0b035643d5b06852b"
format_stamp: "Formatted at 2026-07-09 13:10:09 on dist-test-slave-6j4g"
I20260709 13:10:09.897778 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:09.910413 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:09.911725 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:09.913288 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:09.915598 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:09.915817 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:09.916044 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:09.916191 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:09.956516 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.2:43751
I20260709 13:10:09.956660 31772 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.2:43751 every 8 connection(s)
I20260709 13:10:09.961269 21312 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:09.969079 31776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:09.970539 31777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:09.973122 21312 server_base.cc:1061] running on GCE node
W20260709 13:10:09.974821 31779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:09.974913 31773 heartbeater.cc:344] Connected to a master server at 127.20.208.62:46033
I20260709 13:10:09.975605 31773 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:09.976059 21312 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:09.976351 21312 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:09.976382 31773 heartbeater.cc:507] Master 127.20.208.62:46033 requested a full tablet report, sending...
I20260709 13:10:09.976542 21312 hybrid_clock.cc:648] HybridClock initialized: now 1783602609976529 us; error 0 us; skew 500 ppm
I20260709 13:10:09.977313 21312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:09.978909 31571 ts_manager.cc:194] Registered new tserver with Master: 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:09.980029 21312 webserver.cc:533] Webserver started at http://127.20.208.3:34251/ using document root <none> and password file <none>
I20260709 13:10:09.980522 31571 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55472
I20260709 13:10:09.980645 21312 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:09.980999 21312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:09.981266 21312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:09.982570 21312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-2-root/instance:
uuid: "725413eea23c4befac3b8c042489f99d"
format_stamp: "Formatted at 2026-07-09 13:10:09 on dist-test-slave-6j4g"
I20260709 13:10:09.987211 21312 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:09.990806 31784 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:09.991641 21312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:10:09.991973 21312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-2-root
uuid: "725413eea23c4befac3b8c042489f99d"
format_stamp: "Formatted at 2026-07-09 13:10:09 on dist-test-slave-6j4g"
I20260709 13:10:09.992265 21312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrc5JEf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326409895-21312-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:10.020066 21312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:10.021375 21312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:10.022941 21312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:10.025328 21312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:10.025547 21312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.025775 21312 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:10.025925 21312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:10.065934 21312 rpc_server.cc:307] RPC server started. Bound to: 127.20.208.3:37305
I20260709 13:10:10.066048 31846 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.208.3:37305 every 8 connection(s)
I20260709 13:10:10.079813 31847 heartbeater.cc:344] Connected to a master server at 127.20.208.62:46033
I20260709 13:10:10.080257 31847 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:10.081003 31847 heartbeater.cc:507] Master 127.20.208.62:46033 requested a full tablet report, sending...
I20260709 13:10:10.083077 31571 ts_manager.cc:194] Registered new tserver with Master: 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:10.083984 21312 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014812518s
I20260709 13:10:10.084507 31571 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55478
I20260709 13:10:10.111409 31571 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55488:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:10.114377 31571 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:10.181641 31663 tablet_service.cc:1511] Processing CreateTablet for tablet a97017c1d79a46a8825c86ac5a84510e (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:10.183145 31663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97017c1d79a46a8825c86ac5a84510e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.190332 31662 tablet_service.cc:1511] Processing CreateTablet for tablet 866e0a18158041bf9305e80037c1348e (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:10.191987 31662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866e0a18158041bf9305e80037c1348e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.196273 31661 tablet_service.cc:1511] Processing CreateTablet for tablet 12d6957f83594a099f9c3ba7be1b2954 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:10.197928 31661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d6957f83594a099f9c3ba7be1b2954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.209723 31660 tablet_service.cc:1511] Processing CreateTablet for tablet 5b1d7a1d3fa74b59b53889e43b4c17ee (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:10.211364 31660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b1d7a1d3fa74b59b53889e43b4c17ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.213081 31733 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8e775b928e4fe6bd777c353f4d1eb9 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:10.214627 31733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8e775b928e4fe6bd777c353f4d1eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.214280 31737 tablet_service.cc:1511] Processing CreateTablet for tablet 866e0a18158041bf9305e80037c1348e (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:10.215703 31737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866e0a18158041bf9305e80037c1348e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.213073 31738 tablet_service.cc:1511] Processing CreateTablet for tablet a97017c1d79a46a8825c86ac5a84510e (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:10.217860 31738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97017c1d79a46a8825c86ac5a84510e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.217643 31736 tablet_service.cc:1511] Processing CreateTablet for tablet 12d6957f83594a099f9c3ba7be1b2954 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:10.218189 31659 tablet_service.cc:1511] Processing CreateTablet for tablet 092fe73e98964dcb88e38942af7f7547 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:10.219060 31736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d6957f83594a099f9c3ba7be1b2954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.219637 31659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092fe73e98964dcb88e38942af7f7547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.221515 31735 tablet_service.cc:1511] Processing CreateTablet for tablet 5b1d7a1d3fa74b59b53889e43b4c17ee (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:10.223085 31735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b1d7a1d3fa74b59b53889e43b4c17ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.224180 31658 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8e775b928e4fe6bd777c353f4d1eb9 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:10.225697 31658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8e775b928e4fe6bd777c353f4d1eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.229789 31657 tablet_service.cc:1511] Processing CreateTablet for tablet fba1459b707d44b4aa23227d78f85d4f (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:10.231316 31657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba1459b707d44b4aa23227d78f85d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.233777 31656 tablet_service.cc:1511] Processing CreateTablet for tablet cbfbe8b26a41464a9cb202c8da214541 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:10.235306 31656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfbe8b26a41464a9cb202c8da214541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.237653 31655 tablet_service.cc:1511] Processing CreateTablet for tablet 7451f4fda1dd4f55bdfddb9ab544753e (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:10.239060 31655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7451f4fda1dd4f55bdfddb9ab544753e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.241757 31732 tablet_service.cc:1511] Processing CreateTablet for tablet fba1459b707d44b4aa23227d78f85d4f (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:10.243311 31732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba1459b707d44b4aa23227d78f85d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.245669 31731 tablet_service.cc:1511] Processing CreateTablet for tablet cbfbe8b26a41464a9cb202c8da214541 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:10.247144 31731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfbe8b26a41464a9cb202c8da214541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.249841 31730 tablet_service.cc:1511] Processing CreateTablet for tablet 7451f4fda1dd4f55bdfddb9ab544753e (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:10.225716 31734 tablet_service.cc:1511] Processing CreateTablet for tablet 092fe73e98964dcb88e38942af7f7547 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:10.259510 31730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7451f4fda1dd4f55bdfddb9ab544753e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.261031 31734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092fe73e98964dcb88e38942af7f7547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.262050 31810 tablet_service.cc:1511] Processing CreateTablet for tablet 12d6957f83594a099f9c3ba7be1b2954 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:10.263623 31810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d6957f83594a099f9c3ba7be1b2954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.265911 31809 tablet_service.cc:1511] Processing CreateTablet for tablet 5b1d7a1d3fa74b59b53889e43b4c17ee (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:10.267409 31809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b1d7a1d3fa74b59b53889e43b4c17ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.269623 31808 tablet_service.cc:1511] Processing CreateTablet for tablet 092fe73e98964dcb88e38942af7f7547 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:10.271304 31808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092fe73e98964dcb88e38942af7f7547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.273738 31807 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8e775b928e4fe6bd777c353f4d1eb9 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:10.275303 31807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8e775b928e4fe6bd777c353f4d1eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.280354 31811 tablet_service.cc:1511] Processing CreateTablet for tablet 866e0a18158041bf9305e80037c1348e (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:10.282003 31811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866e0a18158041bf9305e80037c1348e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.285640 31812 tablet_service.cc:1511] Processing CreateTablet for tablet a97017c1d79a46a8825c86ac5a84510e (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:10.287106 31812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97017c1d79a46a8825c86ac5a84510e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.290275 31806 tablet_service.cc:1511] Processing CreateTablet for tablet fba1459b707d44b4aa23227d78f85d4f (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:10.291812 31806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba1459b707d44b4aa23227d78f85d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.294289 31805 tablet_service.cc:1511] Processing CreateTablet for tablet cbfbe8b26a41464a9cb202c8da214541 (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:10.295734 31805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfbe8b26a41464a9cb202c8da214541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.302306 31804 tablet_service.cc:1511] Processing CreateTablet for tablet 7451f4fda1dd4f55bdfddb9ab544753e (DEFAULT_TABLE table=test-workload [id=98ad0c09319e4915a654b3a50eccd44a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:10.303876 31804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7451f4fda1dd4f55bdfddb9ab544753e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.333829 31862 tablet_bootstrap.cc:492] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:10.333745 31863 tablet_bootstrap.cc:492] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:10.389940 31862 tablet_bootstrap.cc:654] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.399808 31863 tablet_bootstrap.cc:654] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.413648 31864 tablet_bootstrap.cc:492] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:10.416121 31862 tablet_bootstrap.cc:492] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:10.416816 31862 ts_tablet_manager.cc:1403] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.008s
I20260709 13:10:10.419703 31862 raft_consensus.cc:359] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:10.420665 31862 raft_consensus.cc:385] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.421089 31862 raft_consensus.cc:740] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.421919 31862 consensus_queue.cc:260] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:10.422742 31864 tablet_bootstrap.cc:654] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.423703 31863 tablet_bootstrap.cc:492] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:10.424259 31863 ts_tablet_manager.cc:1403] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.002s
I20260709 13:10:10.424320 31698 heartbeater.cc:499] Master 127.20.208.62:46033 was elected leader, sending a full tablet report...
I20260709 13:10:10.424749 31862 ts_tablet_manager.cc:1434] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:10.425945 31862 tablet_bootstrap.cc:492] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:10.427415 31863 raft_consensus.cc:359] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.428222 31863 raft_consensus.cc:385] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.428522 31863 raft_consensus.cc:740] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.429349 31863 consensus_queue.cc:260] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.434090 31862 tablet_bootstrap.cc:654] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.434564 31864 tablet_bootstrap.cc:492] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:10.435149 31864 ts_tablet_manager.cc:1403] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 13:10:10.438257 31864 raft_consensus.cc:359] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.439028 31864 raft_consensus.cc:385] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.439333 31864 raft_consensus.cc:740] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.440291 31864 consensus_queue.cc:260] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.446348 31862 tablet_bootstrap.cc:492] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:10.447137 31862 ts_tablet_manager.cc:1403] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:10:10.448001 31864 ts_tablet_manager.cc:1434] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:10:10.448882 31847 heartbeater.cc:499] Master 127.20.208.62:46033 was elected leader, sending a full tablet report...
I20260709 13:10:10.450784 31863 ts_tablet_manager.cc:1434] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.012s
I20260709 13:10:10.452011 31863 tablet_bootstrap.cc:492] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:10.452593 31773 heartbeater.cc:499] Master 127.20.208.62:46033 was elected leader, sending a full tablet report...
I20260709 13:10:10.454236 31862 raft_consensus.cc:359] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.455106 31862 raft_consensus.cc:385] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.455422 31862 raft_consensus.cc:740] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.452596 31864 tablet_bootstrap.cc:492] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:10.458703 31863 tablet_bootstrap.cc:654] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.460323 31862 consensus_queue.cc:260] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.463790 31862 ts_tablet_manager.cc:1434] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.008s
I20260709 13:10:10.463938 31864 tablet_bootstrap.cc:654] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.465011 31862 tablet_bootstrap.cc:492] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:10.471170 31863 tablet_bootstrap.cc:492] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:10.471189 31864 tablet_bootstrap.cc:492] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:10.472039 31863 ts_tablet_manager.cc:1403] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 13:10:10.472194 31864 ts_tablet_manager.cc:1403] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 13:10:10.472798 31862 tablet_bootstrap.cc:654] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.475569 31864 raft_consensus.cc:359] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.475926 31863 raft_consensus.cc:359] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.476634 31864 raft_consensus.cc:385] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.476804 31863 raft_consensus.cc:385] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.477077 31864 raft_consensus.cc:740] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.477197 31863 raft_consensus.cc:740] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.478334 31863 consensus_queue.cc:260] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.478361 31864 consensus_queue.cc:260] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.480723 31863 ts_tablet_manager.cc:1434] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:10.481387 31864 ts_tablet_manager.cc:1434] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:10.481805 31863 tablet_bootstrap.cc:492] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:10.482765 31864 tablet_bootstrap.cc:492] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:10.489490 31863 tablet_bootstrap.cc:654] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.490720 31862 tablet_bootstrap.cc:492] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:10.491360 31862 ts_tablet_manager.cc:1403] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.012s
I20260709 13:10:10.492182 31864 tablet_bootstrap.cc:654] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.494675 31862 raft_consensus.cc:359] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.495512 31862 raft_consensus.cc:385] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.495821 31862 raft_consensus.cc:740] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.496842 31862 consensus_queue.cc:260] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.501580 31863 tablet_bootstrap.cc:492] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:10.502076 31862 ts_tablet_manager.cc:1434] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:10:10.502276 31863 ts_tablet_manager.cc:1403] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 13:10:10.503759 31862 tablet_bootstrap.cc:492] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:10.504202 31864 tablet_bootstrap.cc:492] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:10.504812 31864 ts_tablet_manager.cc:1403] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:10:10.505674 31863 raft_consensus.cc:359] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.506461 31863 raft_consensus.cc:385] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.506736 31863 raft_consensus.cc:740] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.507622 31863 consensus_queue.cc:260] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.508051 31864 raft_consensus.cc:359] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.508934 31864 raft_consensus.cc:385] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.509222 31864 raft_consensus.cc:740] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.510012 31863 ts_tablet_manager.cc:1434] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:10:10.510207 31864 consensus_queue.cc:260] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.511056 31862 tablet_bootstrap.cc:654] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.511107 31863 tablet_bootstrap.cc:492] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:10.512913 31864 ts_tablet_manager.cc:1434] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:10.513950 31864 tablet_bootstrap.cc:492] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:10.519716 31863 tablet_bootstrap.cc:654] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.520177 31864 tablet_bootstrap.cc:654] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.527570 31869 raft_consensus.cc:493] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.528268 31869 raft_consensus.cc:515] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.539711 31869 leader_election.cc:290] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:10.542960 31863 tablet_bootstrap.cc:492] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:10.543617 31863 ts_tablet_manager.cc:1403] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.012s
I20260709 13:10:10.545059 31864 tablet_bootstrap.cc:492] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:10.545706 31864 ts_tablet_manager.cc:1403] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.015s
I20260709 13:10:10.546608 31863 raft_consensus.cc:359] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.547425 31863 raft_consensus.cc:385] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.547730 31863 raft_consensus.cc:740] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.548550 31863 consensus_queue.cc:260] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.548978 31864 raft_consensus.cc:359] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.549860 31864 raft_consensus.cc:385] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.550164 31864 raft_consensus.cc:740] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.550851 31863 ts_tablet_manager.cc:1434] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:10:10.550969 31864 consensus_queue.cc:260] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.553200 31863 tablet_bootstrap.cc:492] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:10.555609 31864 ts_tablet_manager.cc:1434] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:10.557040 31864 tablet_bootstrap.cc:492] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:10.560353 31863 tablet_bootstrap.cc:654] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.560808 31862 tablet_bootstrap.cc:492] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:10.561457 31862 ts_tablet_manager.cc:1403] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.006s
I20260709 13:10:10.563426 31864 tablet_bootstrap.cc:654] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.566745 31862 raft_consensus.cc:359] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.570899 31862 raft_consensus.cc:385] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.571422 31862 raft_consensus.cc:740] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.572554 31862 consensus_queue.cc:260] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.586360 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092fe73e98964dcb88e38942af7f7547" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:10.587265 31673 raft_consensus.cc:2468] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:10.588912 31712 leader_election.cc:304] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:10.590030 31869 raft_consensus.cc:2804] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.590461 31869 raft_consensus.cc:493] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.590721 31869 raft_consensus.cc:3060] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.590859 31862 ts_tablet_manager.cc:1434] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:10:10.592243 31862 tablet_bootstrap.cc:492] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:10.595695 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092fe73e98964dcb88e38942af7f7547" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
W20260709 13:10:10.597651 31711 leader_election.cc:343] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.598869 31869 raft_consensus.cc:515] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.601959 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092fe73e98964dcb88e38942af7f7547" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d"
W20260709 13:10:10.604045 31711 leader_election.cc:343] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.604202 31863 tablet_bootstrap.cc:492] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:10.604941 31863 ts_tablet_manager.cc:1403] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.019s
I20260709 13:10:10.605132 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092fe73e98964dcb88e38942af7f7547" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:10.605825 31673 raft_consensus.cc:3060] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.608448 31863 raft_consensus.cc:359] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.609468 31863 raft_consensus.cc:385] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.609557 31862 tablet_bootstrap.cc:654] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.609939 31863 raft_consensus.cc:740] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.610885 31863 consensus_queue.cc:260] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.614620 31673 raft_consensus.cc:2468] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:10.615481 31863 ts_tablet_manager.cc:1434] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:10:10.615864 31864 tablet_bootstrap.cc:492] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:10.616183 31712 leader_election.cc:304] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 725413eea23c4befac3b8c042489f99d
I20260709 13:10:10.616847 31863 tablet_bootstrap.cc:492] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:10.616457 31864 ts_tablet_manager.cc:1403] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.060s	user 0.027s	sys 0.028s
I20260709 13:10:10.619218 31884 raft_consensus.cc:2804] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.616925 31862 tablet_bootstrap.cc:492] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:10.619822 31884 raft_consensus.cc:697] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:10.620079 31862 ts_tablet_manager.cc:1403] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.002s
I20260709 13:10:10.620431 31864 raft_consensus.cc:359] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.620788 31884 consensus_queue.cc:237] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.621284 31864 raft_consensus.cc:385] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.623744 31862 raft_consensus.cc:359] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.624562 31864 raft_consensus.cc:740] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.624750 31862 raft_consensus.cc:385] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.625239 31862 raft_consensus.cc:740] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.625600 31863 tablet_bootstrap.cc:654] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.625635 31864 consensus_queue.cc:260] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.626222 31862 consensus_queue.cc:260] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.633225 31871 raft_consensus.cc:493] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.633838 31871 raft_consensus.cc:515] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.636977 31871 leader_election.cc:290] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:10.637574 31862 ts_tablet_manager.cc:1434] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:10:10.639106 31864 ts_tablet_manager.cc:1434] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:10:10.640568 31864 tablet_bootstrap.cc:492] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:10.641918 31862 tablet_bootstrap.cc:492] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:10.652408 31871 raft_consensus.cc:493] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.653231 31871 raft_consensus.cc:515] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.658216 31871 leader_election.cc:290] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:10.658818 31871 raft_consensus.cc:493] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.662820 31712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43965, user_credentials={real_user=slave}} blocked reactor thread for 46735.6us
I20260709 13:10:10.663250 31864 tablet_bootstrap.cc:654] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.661006 31869 leader_election.cc:290] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:10.662063 31871 raft_consensus.cc:515] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.667412 31862 tablet_bootstrap.cc:654] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.674353 31871 leader_election.cc:290] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:10.676662 31568 catalog_manager.cc:5697] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 1 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.678908 31863 tablet_bootstrap.cc:492] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:10.679541 31863 ts_tablet_manager.cc:1403] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.063s	user 0.028s	sys 0.018s
I20260709 13:10:10.680171 31864 tablet_bootstrap.cc:492] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:10.680790 31864 ts_tablet_manager.cc:1403] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.040s	user 0.005s	sys 0.011s
I20260709 13:10:10.682775 31863 raft_consensus.cc:359] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.683598 31863 raft_consensus.cc:385] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.683878 31864 raft_consensus.cc:359] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.688861 31864 raft_consensus.cc:385] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.689209 31864 raft_consensus.cc:740] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.690052 31864 consensus_queue.cc:260] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.694669 31748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d6957f83594a099f9c3ba7be1b2954" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:10.695456 31748 raft_consensus.cc:2468] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:10.696805 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092fe73e98964dcb88e38942af7f7547" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:10.697582 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d6957f83594a099f9c3ba7be1b2954" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:10.698318 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092fe73e98964dcb88e38942af7f7547" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:10.698447 31673 raft_consensus.cc:2468] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:10.699277 31672 raft_consensus.cc:2393] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 725413eea23c4befac3b8c042489f99d in current term 1: Already voted for candidate 40160dd8a5d24fa0b035643d5b06852b in this term.
I20260709 13:10:10.683897 31863 raft_consensus.cc:740] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.699977 31787 leader_election.cc:304] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:10.700431 31671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866e0a18158041bf9305e80037c1348e" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:10.700392 31863 consensus_queue.cc:260] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.701366 31671 raft_consensus.cc:2468] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:10.698423 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866e0a18158041bf9305e80037c1348e" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:10.704456 31746 raft_consensus.cc:2468] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:10.705356 31863 ts_tablet_manager.cc:1434] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 13:10:10.702740 31871 raft_consensus.cc:2804] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.692373 31864 ts_tablet_manager.cc:1434] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:10:10.705857 31871 raft_consensus.cc:493] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.705905 31787 leader_election.cc:304] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:10.706326 31871 raft_consensus.cc:3060] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:10.703128 31619 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:10.706512 31863 tablet_bootstrap.cc:492] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:10.705209 31786 leader_election.cc:304] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 725413eea23c4befac3b8c042489f99d; no voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:10.707032 31891 raft_consensus.cc:2804] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.707540 31891 raft_consensus.cc:493] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.707888 31891 raft_consensus.cc:3060] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.708398 31895 raft_consensus.cc:3060] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.713972 31863 tablet_bootstrap.cc:654] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.716712 31891 raft_consensus.cc:515] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.719610 31895 raft_consensus.cc:2749] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.720620 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866e0a18158041bf9305e80037c1348e" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:10.721580 31746 raft_consensus.cc:3060] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.720727 31871 raft_consensus.cc:515] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.723536 31871 leader_election.cc:290] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:10.724750 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d6957f83594a099f9c3ba7be1b2954" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:10.725450 31747 raft_consensus.cc:3060] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.726562 31867 raft_consensus.cc:493] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.727146 31867 raft_consensus.cc:515] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:10.729375 31863 tablet_bootstrap.cc:492] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:10.729955 31863 ts_tablet_manager.cc:1403] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 13:10:10.732800 31867 leader_election.cc:290] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:10.733321 31747 raft_consensus.cc:2468] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:10.734632 31787 leader_election.cc:304] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:10.734687 31671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866e0a18158041bf9305e80037c1348e" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:10.735390 31671 raft_consensus.cc:3060] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.735659 31895 raft_consensus.cc:493] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.736307 31895 raft_consensus.cc:515] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.735029 31863 raft_consensus.cc:359] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.740048 31895 leader_election.cc:290] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:10.740216 31863 raft_consensus.cc:385] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.740756 31863 raft_consensus.cc:740] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.707006 31864 tablet_bootstrap.cc:492] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:10.741029 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfbe8b26a41464a9cb202c8da214541" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:10.741686 31895 raft_consensus.cc:2804] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.743227 31895 raft_consensus.cc:697] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
W20260709 13:10:10.744335 31787 leader_election.cc:343] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.744102 31895 consensus_queue.cc:237] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.741731 31863 consensus_queue.cc:260] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.748387 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d6957f83594a099f9c3ba7be1b2954" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:10.749244 31672 raft_consensus.cc:3060] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.752377 31746 raft_consensus.cc:2468] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:10.753767 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfbe8b26a41464a9cb202c8da214541" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:10.754029 31787 leader_election.cc:304] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:10.755285 31862 tablet_bootstrap.cc:492] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
W20260709 13:10:10.755539 31786 leader_election.cc:343] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.756007 31862 ts_tablet_manager.cc:1403] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.114s	user 0.016s	sys 0.022s
I20260709 13:10:10.756287 31786 leader_election.cc:304] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 725413eea23c4befac3b8c042489f99d; no voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:10.757951 31863 ts_tablet_manager.cc:1434] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:10:10.759178 31863 tablet_bootstrap.cc:492] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:10.759559 31862 raft_consensus.cc:359] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.760418 31862 raft_consensus.cc:385] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.760890 31871 raft_consensus.cc:2804] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.761077 31862 raft_consensus.cc:740] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.762059 31862 consensus_queue.cc:260] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.766888 31862 ts_tablet_manager.cc:1434] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:10.768074 31862 tablet_bootstrap.cc:492] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:10.773880 31891 leader_election.cc:290] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:10.774611 31891 raft_consensus.cc:2749] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.776582 31871 raft_consensus.cc:697] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:10.778101 31869 raft_consensus.cc:493] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.778666 31869 raft_consensus.cc:515] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.780931 31869 leader_election.cc:290] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:10.782837 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:10.783726 31673 raft_consensus.cc:2468] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:10.782910 31864 tablet_bootstrap.cc:654] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.785234 31712 leader_election.cc:304] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:10.785455 31871 consensus_queue.cc:237] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.786242 31869 raft_consensus.cc:2804] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.786628 31869 raft_consensus.cc:493] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.786984 31869 raft_consensus.cc:3060] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.787596 31886 raft_consensus.cc:493] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.788111 31886 raft_consensus.cc:515] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.790370 31886 leader_election.cc:290] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:10.792311 31672 raft_consensus.cc:2468] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:10.795174 31869 raft_consensus.cc:515] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.796895 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7451f4fda1dd4f55bdfddb9ab544753e" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
W20260709 13:10:10.798219 31712 leader_election.cc:343] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.798362 31862 tablet_bootstrap.cc:654] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:10.799384 31786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.208.1:43965, user_credentials={real_user=slave}} blocked reactor thread for 43900.1us
I20260709 13:10:10.800002 31864 tablet_bootstrap.cc:492] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:10.795233 31671 raft_consensus.cc:2468] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:10.801029 31864 ts_tablet_manager.cc:1403] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.001s
I20260709 13:10:10.802368 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7451f4fda1dd4f55bdfddb9ab544753e" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:10.800570 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:10.803800 31673 raft_consensus.cc:3060] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.805796 31863 tablet_bootstrap.cc:654] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.806316 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97017c1d79a46a8825c86ac5a84510e" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
W20260709 13:10:10.808194 31638 leader_election.cc:343] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.802983 31869 leader_election.cc:290] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:10.800935 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:10.809435 31822 raft_consensus.cc:2468] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:10.803156 31821 raft_consensus.cc:2468] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:10.811245 31864 raft_consensus.cc:359] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.812096 31864 raft_consensus.cc:385] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.812438 31864 raft_consensus.cc:740] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.812896 31673 raft_consensus.cc:2468] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:10.813305 31864 consensus_queue.cc:260] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.813752 31711 leader_election.cc:304] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:10.814255 31712 leader_election.cc:304] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:10.815181 31886 raft_consensus.cc:2804] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.815600 31886 raft_consensus.cc:493] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.815955 31886 raft_consensus.cc:3060] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.816402 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97017c1d79a46a8825c86ac5a84510e" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:10.818135 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:10.815210 31869 raft_consensus.cc:2804] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.818754 31821 raft_consensus.cc:3060] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.819196 31869 raft_consensus.cc:697] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:10.820058 31869 consensus_queue.cc:237] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
W20260709 13:10:10.822355 31636 leader_election.cc:343] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.822899 31636 leader_election.cc:304] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cafcc485f084cd79accfcaab629c721; no voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d
I20260709 13:10:10.824093 31867 raft_consensus.cc:2749] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.824435 31886 raft_consensus.cc:515] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.827272 31821 raft_consensus.cc:2468] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:10.827524 31671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7451f4fda1dd4f55bdfddb9ab544753e" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:10.828961 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7451f4fda1dd4f55bdfddb9ab544753e" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d"
W20260709 13:10:10.829114 31712 leader_election.cc:343] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.829685 31821 raft_consensus.cc:3060] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.818063 31864 ts_tablet_manager.cc:1434] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:10:10.837826 31864 tablet_bootstrap.cc:492] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:10.839833 31821 raft_consensus.cc:2468] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:10.828111 31886 leader_election.cc:290] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:10.841203 31711 leader_election.cc:304] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:10.842428 31886 raft_consensus.cc:2804] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.842984 31886 raft_consensus.cc:697] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:10.843111 31571 catalog_manager.cc:5697] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 0 to 1, leader changed from <none> to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 1 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.844012 31886 consensus_queue.cc:237] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.844535 31864 tablet_bootstrap.cc:654] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.845438 31863 tablet_bootstrap.cc:492] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:10.846006 31863 ts_tablet_manager.cc:1403] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.087s	user 0.007s	sys 0.006s
I20260709 13:10:10.845145 31571 catalog_manager.cc:5697] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 0 to 1, leader changed from <none> to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 1 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.849185 31863 raft_consensus.cc:359] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.850039 31863 raft_consensus.cc:385] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.850400 31863 raft_consensus.cc:740] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.851253 31863 consensus_queue.cc:260] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.853947 31863 ts_tablet_manager.cc:1434] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:10.855125 31863 tablet_bootstrap.cc:492] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:10.856258 31862 tablet_bootstrap.cc:492] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:10.857004 31862 ts_tablet_manager.cc:1403] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.000s
I20260709 13:10:10.861735 31863 tablet_bootstrap.cc:654] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.864909 31569 catalog_manager.cc:5697] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 1 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.874073 31863 tablet_bootstrap.cc:492] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:10.874903 31863 ts_tablet_manager.cc:1403] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:10:10.878413 31863 raft_consensus.cc:359] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:10.879349 31863 raft_consensus.cc:385] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.879702 31863 raft_consensus.cc:740] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.880743 31863 consensus_queue.cc:260] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:10.883606 31863 ts_tablet_manager.cc:1434] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:10.889603 31862 raft_consensus.cc:359] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.891597 31862 raft_consensus.cc:385] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.892091 31862 raft_consensus.cc:740] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.893118 31862 consensus_queue.cc:260] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.898113 31862 ts_tablet_manager.cc:1434] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.041s	user 0.000s	sys 0.007s
I20260709 13:10:10.899155 31862 tablet_bootstrap.cc:492] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:10.900388 31864 tablet_bootstrap.cc:492] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:10.900970 31864 ts_tablet_manager.cc:1403] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.063s	user 0.031s	sys 0.028s
I20260709 13:10:10.903841 31864 raft_consensus.cc:359] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:10.904856 31864 raft_consensus.cc:385] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.903723 31569 catalog_manager.cc:5697] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 1 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.905241 31864 raft_consensus.cc:740] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.906244 31862 tablet_bootstrap.cc:654] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.906530 31864 consensus_queue.cc:260] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:10.909760 31864 ts_tablet_manager.cc:1434] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:10.915635 31864 tablet_bootstrap.cc:492] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:10.922869 31864 tablet_bootstrap.cc:654] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.924454 31862 tablet_bootstrap.cc:492] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:10.925293 31862 ts_tablet_manager.cc:1403] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 13:10:10.928695 31862 raft_consensus.cc:359] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.929524 31862 raft_consensus.cc:385] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.929795 31862 raft_consensus.cc:740] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.930537 31862 consensus_queue.cc:260] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.931303 31864 tablet_bootstrap.cc:492] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:10.932178 31864 ts_tablet_manager.cc:1403] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:10:10.933013 31862 ts_tablet_manager.cc:1434] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:10.934405 31862 tablet_bootstrap.cc:492] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:10.935240 31864 raft_consensus.cc:359] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.936030 31864 raft_consensus.cc:385] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.936259 31864 raft_consensus.cc:740] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.936946 31864 consensus_queue.cc:260] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.938935 31864 ts_tablet_manager.cc:1434] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:10.941483 31862 tablet_bootstrap.cc:654] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.947464 31862 tablet_bootstrap.cc:492] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:10.948108 31862 ts_tablet_manager.cc:1403] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:10:10.948954 31886 raft_consensus.cc:493] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.949529 31886 raft_consensus.cc:515] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.950908 31862 raft_consensus.cc:359] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.952268 31886 leader_election.cc:290] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:10.953119 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8e775b928e4fe6bd777c353f4d1eb9" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:10.953847 31673 raft_consensus.cc:2468] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:10.953647 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8e775b928e4fe6bd777c353f4d1eb9" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:10.952370 31862 raft_consensus.cc:385] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.954747 31821 raft_consensus.cc:2468] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:10.955159 31862 raft_consensus.cc:740] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.955528 31712 leader_election.cc:304] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:10.956492 31862 consensus_queue.cc:260] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.957221 31886 raft_consensus.cc:2804] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.957707 31886 raft_consensus.cc:493] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.958086 31886 raft_consensus.cc:3060] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.959057 31862 ts_tablet_manager.cc:1434] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:10.965968 31886 raft_consensus.cc:515] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.968842 31886 leader_election.cc:290] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:10.969820 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8e775b928e4fe6bd777c353f4d1eb9" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:10.970571 31673 raft_consensus.cc:3060] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.973383 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8e775b928e4fe6bd777c353f4d1eb9" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:10.974403 31821 raft_consensus.cc:3060] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.978869 31673 raft_consensus.cc:2468] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:10.980181 31712 leader_election.cc:304] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:10.981074 31886 raft_consensus.cc:2804] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.981566 31886 raft_consensus.cc:697] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:10.981671 31821 raft_consensus.cc:2468] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:10.982407 31886 consensus_queue.cc:237] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:10.989915 31570 catalog_manager.cc:5697] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 1 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.025748 31867 raft_consensus.cc:493] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.026314 31867 raft_consensus.cc:515] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.028148 31867 leader_election.cc:290] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.028966 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba1459b707d44b4aa23227d78f85d4f" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:11.029253 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba1459b707d44b4aa23227d78f85d4f" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:11.029780 31746 raft_consensus.cc:2468] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 0.
I20260709 13:10:11.029853 31821 raft_consensus.cc:2468] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 0.
I20260709 13:10:11.030949 31636 leader_election.cc:304] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:11.031620 31867 raft_consensus.cc:2804] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.031932 31867 raft_consensus.cc:493] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.032173 31867 raft_consensus.cc:3060] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.035392 31916 raft_consensus.cc:493] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.035903 31916 raft_consensus.cc:515] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.037796 31916 leader_election.cc:290] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.037937 31867 raft_consensus.cc:515] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.038628 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7451f4fda1dd4f55bdfddb9ab544753e" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:11.038964 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7451f4fda1dd4f55bdfddb9ab544753e" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:11.040026 31867 leader_election.cc:290] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 election: Requested vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.040372 31821 raft_consensus.cc:2393] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8cafcc485f084cd79accfcaab629c721 in current term 1: Already voted for candidate 40160dd8a5d24fa0b035643d5b06852b in this term.
I20260709 13:10:11.040817 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba1459b707d44b4aa23227d78f85d4f" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:11.041112 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba1459b707d44b4aa23227d78f85d4f" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:11.041507 31746 raft_consensus.cc:3060] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.041684 31636 leader_election.cc:304] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cafcc485f084cd79accfcaab629c721; no voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d
I20260709 13:10:11.041764 31822 raft_consensus.cc:3060] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.043001 31867 raft_consensus.cc:3060] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.050109 31822 raft_consensus.cc:2468] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 1.
I20260709 13:10:11.050138 31867 raft_consensus.cc:2749] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.050105 31746 raft_consensus.cc:2468] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 1.
I20260709 13:10:11.051992 31636 leader_election.cc:304] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:11.052891 31867 raft_consensus.cc:2804] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.053403 31867 raft_consensus.cc:697] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 1 LEADER]: Becoming Leader. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:11.054119 31867 consensus_queue.cc:237] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.057366 31886 raft_consensus.cc:493] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.058005 31886 raft_consensus.cc:515] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.060105 31886 leader_election.cc:290] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.060848 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfbe8b26a41464a9cb202c8da214541" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:11.061589 31673 raft_consensus.cc:2468] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:11.061733 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfbe8b26a41464a9cb202c8da214541" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:11.062433 31822 raft_consensus.cc:2468] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:11.062760 31712 leader_election.cc:304] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:11.062506 31570 catalog_manager.cc:5697] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cafcc485f084cd79accfcaab629c721 (127.20.208.1). New cstate: current_term: 1 leader_uuid: "8cafcc485f084cd79accfcaab629c721" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.063591 31886 raft_consensus.cc:2804] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.063985 31886 raft_consensus.cc:493] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.064267 31886 raft_consensus.cc:3060] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.071533 31886 raft_consensus.cc:515] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.073596 31886 leader_election.cc:290] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.074259 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfbe8b26a41464a9cb202c8da214541" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:11.074764 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfbe8b26a41464a9cb202c8da214541" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:11.074944 31673 raft_consensus.cc:3060] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.075464 31822 raft_consensus.cc:3060] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.082556 31673 raft_consensus.cc:2468] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:11.082556 31822 raft_consensus.cc:2468] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:11.084103 31712 leader_election.cc:304] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:11.084954 31886 raft_consensus.cc:2804] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.085335 31886 raft_consensus.cc:697] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:11.085927 31886 consensus_queue.cc:237] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.093391 31570 catalog_manager.cc:5697] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 1 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.158334 31886 consensus_queue.cc:1048] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.170060 31869 consensus_queue.cc:1048] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.212426 31869 consensus_queue.cc:1048] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.225522 31886 consensus_queue.cc:1048] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.233498 31871 consensus_queue.cc:1048] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.244624 31871 consensus_queue.cc:1048] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.260027 31871 consensus_queue.cc:1048] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.272389 31895 consensus_queue.cc:1048] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.278861 31925 raft_consensus.cc:493] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.279376 31925 raft_consensus.cc:515] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:11.281762 31925 leader_election.cc:290] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.282891 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97017c1d79a46a8825c86ac5a84510e" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:11.283150 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97017c1d79a46a8825c86ac5a84510e" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:11.283671 31673 raft_consensus.cc:2468] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:11.283818 31822 raft_consensus.cc:2468] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:11.284850 31712 leader_election.cc:304] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:11.285815 31925 raft_consensus.cc:2804] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.286125 31925 raft_consensus.cc:493] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.286381 31925 raft_consensus.cc:3060] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.292011 31925 raft_consensus.cc:515] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:11.293694 31925 leader_election.cc:290] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.294533 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97017c1d79a46a8825c86ac5a84510e" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:11.294654 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97017c1d79a46a8825c86ac5a84510e" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:11.295128 31673 raft_consensus.cc:3060] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.295234 31822 raft_consensus.cc:3060] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.300642 31822 raft_consensus.cc:2468] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:11.300642 31673 raft_consensus.cc:2468] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:11.301791 31712 leader_election.cc:304] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:11.302523 31925 raft_consensus.cc:2804] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.302958 31925 raft_consensus.cc:697] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:11.303702 31925 consensus_queue.cc:237] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:11.311322 31569 catalog_manager.cc:5697] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 1 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.384120 31746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a97017c1d79a46a8825c86ac5a84510e"
dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
mode: GRACEFUL
new_leader_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:59928
I20260709 13:10:11.384730 31746 raft_consensus.cc:606] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Received request to transfer leadership to TS 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:11.398545 31822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "866e0a18158041bf9305e80037c1348e"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
mode: GRACEFUL
new_leader_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:54324
I20260709 13:10:11.399120 31822 raft_consensus.cc:606] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Received request to transfer leadership to TS 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:11.404618 31822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12d6957f83594a099f9c3ba7be1b2954"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
mode: GRACEFUL
new_leader_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:54324
I20260709 13:10:11.405226 31822 raft_consensus.cc:606] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Received request to transfer leadership to TS 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:11.408099 31925 consensus_queue.cc:1048] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.410575 31746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee"
dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
mode: GRACEFUL
new_leader_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:59928
I20260709 13:10:11.411208 31746 raft_consensus.cc:606] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Received request to transfer leadership to TS 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:11.420961 31884 consensus_queue.cc:1048] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.437078 31673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fba1459b707d44b4aa23227d78f85d4f"
dest_uuid: "8cafcc485f084cd79accfcaab629c721"
mode: GRACEFUL
new_leader_uuid: "40160dd8a5d24fa0b035643d5b06852b"
 from {username='slave'} at 127.0.0.1:58310
I20260709 13:10:11.437592 31673 raft_consensus.cc:606] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 1 LEADER]: Received request to transfer leadership to TS 40160dd8a5d24fa0b035643d5b06852b
I20260709 13:10:11.441061 31867 consensus_queue.cc:1048] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.448549 31746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7451f4fda1dd4f55bdfddb9ab544753e"
dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
mode: GRACEFUL
new_leader_uuid: "725413eea23c4befac3b8c042489f99d"
 from {username='slave'} at 127.0.0.1:59928
I20260709 13:10:11.448830 31867 raft_consensus.cc:993] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721: : Instructing follower 40160dd8a5d24fa0b035643d5b06852b to start an election
I20260709 13:10:11.449179 31746 raft_consensus.cc:606] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Received request to transfer leadership to TS 725413eea23c4befac3b8c042489f99d
I20260709 13:10:11.449393 31916 raft_consensus.cc:1081] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 1 LEADER]: Signalling peer 40160dd8a5d24fa0b035643d5b06852b to start an election
I20260709 13:10:11.454721 31746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fba1459b707d44b4aa23227d78f85d4f"
dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
 from {username='slave'} at 127.0.0.1:59920
I20260709 13:10:11.455397 31746 raft_consensus.cc:493] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.455778 31746 raft_consensus.cc:3060] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.457973 31940 consensus_queue.cc:1048] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.464191 31746 raft_consensus.cc:515] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.467470 31746 leader_election.cc:290] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 2 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.467550 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba1459b707d44b4aa23227d78f85d4f" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:11.468166 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba1459b707d44b4aa23227d78f85d4f" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:11.468295 31673 raft_consensus.cc:3055] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.468851 31673 raft_consensus.cc:740] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:11.468943 31821 raft_consensus.cc:3060] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.469739 31673 consensus_queue.cc:260] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.471071 31673 raft_consensus.cc:3060] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.476204 31821 raft_consensus.cc:2468] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 2.
I20260709 13:10:11.477617 31711 leader_election.cc:304] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:11.478281 31673 raft_consensus.cc:2468] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 2.
I20260709 13:10:11.478549 31884 raft_consensus.cc:2804] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.479149 31884 raft_consensus.cc:697] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 2 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:11.479907 31884 consensus_queue.cc:237] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.485304 31884 consensus_queue.cc:1048] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.487061 31569 catalog_manager.cc:5697] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 1 to 2, leader changed from 8cafcc485f084cd79accfcaab629c721 (127.20.208.1) to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 2 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.498464 31925 consensus_queue.cc:1048] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.524138 31925 consensus_queue.cc:1048] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.535432 31884 consensus_queue.cc:1048] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.693425 31902 raft_consensus.cc:993] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d: : Instructing follower 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:11.693928 31895 raft_consensus.cc:1081] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Signalling peer 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:11.695516 31673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "866e0a18158041bf9305e80037c1348e"
dest_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:58298
I20260709 13:10:11.696094 31673 raft_consensus.cc:493] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.696446 31673 raft_consensus.cc:3060] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.701915 31673 raft_consensus.cc:515] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.703804 31673 leader_election.cc:290] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Requested vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.704800 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866e0a18158041bf9305e80037c1348e" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:11.704632 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866e0a18158041bf9305e80037c1348e" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:11.705402 31821 raft_consensus.cc:3055] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.705461 31746 raft_consensus.cc:3060] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.705725 31821 raft_consensus.cc:740] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:11.706496 31821 consensus_queue.cc:260] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.707481 31821 raft_consensus.cc:3060] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.712884 31821 raft_consensus.cc:2468] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:11.713542 31746 raft_consensus.cc:2468] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:11.714067 31636 leader_election.cc:304] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:11.714931 31939 raft_consensus.cc:2804] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.715417 31939 raft_consensus.cc:697] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Becoming Leader. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:11.716133 31939 consensus_queue.cc:237] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.725492 31569 catalog_manager.cc:5697] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 reported cstate change: term changed from 1 to 2, leader changed from 725413eea23c4befac3b8c042489f99d (127.20.208.3) to 8cafcc485f084cd79accfcaab629c721 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "8cafcc485f084cd79accfcaab629c721" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.824025 31884 consensus_queue.cc:1048] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.824627 31886 raft_consensus.cc:993] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b: : Instructing follower 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:11.825187 31886 raft_consensus.cc:1081] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Signalling peer 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:11.825927 31902 raft_consensus.cc:993] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d: : Instructing follower 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:11.826411 31902 raft_consensus.cc:1081] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Signalling peer 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:11.826833 31671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee"
dest_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:58286
I20260709 13:10:11.827502 31671 raft_consensus.cc:493] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.827890 31671 raft_consensus.cc:3060] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.828200 31673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12d6957f83594a099f9c3ba7be1b2954"
dest_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:58298
I20260709 13:10:11.828851 31673 raft_consensus.cc:493] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.829286 31673 raft_consensus.cc:3060] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.836321 31671 raft_consensus.cc:515] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.839401 31886 consensus_queue.cc:1048] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.841173 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:11.841936 31822 raft_consensus.cc:3060] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.841431 31673 raft_consensus.cc:515] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.846218 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:11.846951 31746 raft_consensus.cc:3055] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.847301 31746 raft_consensus.cc:740] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:11.848129 31746 consensus_queue.cc:260] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.849360 31746 raft_consensus.cc:3060] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.858575 31673 leader_election.cc:290] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Requested vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.860522 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d6957f83594a099f9c3ba7be1b2954" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:11.861189 31747 raft_consensus.cc:3060] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.862774 31671 leader_election.cc:290] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Requested vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:11.863003 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d6957f83594a099f9c3ba7be1b2954" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:11.863794 31821 raft_consensus.cc:3055] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.860071 31822 raft_consensus.cc:2468] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:11.864164 31821 raft_consensus.cc:740] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:11.865289 31636 leader_election.cc:304] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:11.865196 31821 consensus_queue.cc:260] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.866163 31939 raft_consensus.cc:2804] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.866698 31821 raft_consensus.cc:3060] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.866690 31939 raft_consensus.cc:697] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Becoming Leader. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:11.868048 31746 raft_consensus.cc:2468] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:11.867889 31939 consensus_queue.cc:237] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.872649 31886 raft_consensus.cc:993] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b: : Instructing follower 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:11.873199 31886 raft_consensus.cc:1081] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Signalling peer 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:11.873580 31747 raft_consensus.cc:2468] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:11.874944 31638 leader_election.cc:304] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:11.875811 31821 raft_consensus.cc:2468] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:11.875855 31939 raft_consensus.cc:2804] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.875923 31671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a97017c1d79a46a8825c86ac5a84510e"
dest_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:58286
I20260709 13:10:11.876978 31671 raft_consensus.cc:493] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.877072 31939 raft_consensus.cc:697] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Becoming Leader. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:11.877429 31671 raft_consensus.cc:3060] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.878096 31939 consensus_queue.cc:237] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.880179 31569 catalog_manager.cc:5697] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 reported cstate change: term changed from 1 to 2, leader changed from 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2) to 8cafcc485f084cd79accfcaab629c721 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "8cafcc485f084cd79accfcaab629c721" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.886437 31671 raft_consensus.cc:515] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:11.889482 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97017c1d79a46a8825c86ac5a84510e" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:11.890141 31821 raft_consensus.cc:3060] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.891734 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97017c1d79a46a8825c86ac5a84510e" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:11.892549 31747 raft_consensus.cc:3055] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.892584 31925 raft_consensus.cc:993] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b: : Instructing follower 725413eea23c4befac3b8c042489f99d to start an election
I20260709 13:10:11.893321 31884 raft_consensus.cc:1081] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Signalling peer 725413eea23c4befac3b8c042489f99d to start an election
I20260709 13:10:11.893376 31747 raft_consensus.cc:740] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:11.893078 31671 leader_election.cc:290] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Requested vote from peers 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:11.895695 31822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7451f4fda1dd4f55bdfddb9ab544753e"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
 from {username='slave'} at 127.0.0.1:54298
I20260709 13:10:11.896406 31822 raft_consensus.cc:493] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.896858 31822 raft_consensus.cc:3060] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.894811 31747 consensus_queue.cc:260] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:11.898190 31821 raft_consensus.cc:2468] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:11.899381 31747 raft_consensus.cc:3060] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.899475 31636 leader_election.cc:304] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:11.900462 31939 raft_consensus.cc:2804] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.901320 31939 raft_consensus.cc:697] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Becoming Leader. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:11.902289 31939 consensus_queue.cc:237] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } }
I20260709 13:10:11.902349 31569 catalog_manager.cc:5697] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 reported cstate change: term changed from 1 to 2, leader changed from 725413eea23c4befac3b8c042489f99d (127.20.208.3) to 8cafcc485f084cd79accfcaab629c721 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "8cafcc485f084cd79accfcaab629c721" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.905398 31822 raft_consensus.cc:515] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.907058 31747 raft_consensus.cc:2468] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:11.909042 31822 leader_election.cc:290] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 2 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:11.909351 31671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7451f4fda1dd4f55bdfddb9ab544753e" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:11.909713 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7451f4fda1dd4f55bdfddb9ab544753e" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:11.910162 31671 raft_consensus.cc:3060] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.910346 31747 raft_consensus.cc:3055] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.910770 31747 raft_consensus.cc:740] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:11.911584 31747 consensus_queue.cc:260] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.912964 31747 raft_consensus.cc:3060] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.917765 31569 catalog_manager.cc:5697] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 reported cstate change: term changed from 1 to 2, leader changed from 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2) to 8cafcc485f084cd79accfcaab629c721 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "8cafcc485f084cd79accfcaab629c721" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.919734 31747 raft_consensus.cc:2468] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 2.
I20260709 13:10:11.920010 31671 raft_consensus.cc:2468] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 2.
I20260709 13:10:11.920913 31787 leader_election.cc:304] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:11.921712 31902 raft_consensus.cc:2804] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.922201 31902 raft_consensus.cc:697] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 2 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:11.922981 31902 consensus_queue.cc:237] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:11.929797 31569 catalog_manager.cc:5697] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 1 to 2, leader changed from 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2) to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 2 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.975056 31822 raft_consensus.cc:1275] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 40160dd8a5d24fa0b035643d5b06852b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:11.976586 31884 consensus_queue.cc:1048] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:11.977285 31671 raft_consensus.cc:1275] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Refusing update from remote peer 40160dd8a5d24fa0b035643d5b06852b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:11.978859 31884 consensus_queue.cc:1048] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.134781 31747 raft_consensus.cc:1275] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.136157 31939 consensus_queue.cc:1048] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.144364 31822 raft_consensus.cc:1275] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.145970 31939 consensus_queue.cc:1048] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.254380 31822 raft_consensus.cc:1275] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.255897 31939 consensus_queue.cc:1048] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.266057 31747 raft_consensus.cc:1275] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.267714 31939 consensus_queue.cc:1048] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.321763 31747 raft_consensus.cc:1275] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Refusing update from remote peer 725413eea23c4befac3b8c042489f99d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.322053 31672 raft_consensus.cc:1275] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Refusing update from remote peer 725413eea23c4befac3b8c042489f99d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.323235 31895 consensus_queue.cc:1048] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.324051 31902 consensus_queue.cc:1048] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.325022 31822 raft_consensus.cc:1275] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.326941 31939 consensus_queue.cc:1048] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.343865 31747 raft_consensus.cc:1275] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.345523 31948 consensus_queue.cc:1048] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:12.373917 31746 raft_consensus.cc:1275] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.375849 31948 consensus_queue.cc:1048] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.387202 31822 raft_consensus.cc:1275] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.389992 31948 consensus_queue.cc:1048] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.487931 31570 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55496:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:14.492112 31570 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:14.551872 31656 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3f8bab2c07449c9738c4140450f5ff (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:14.552613 31738 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3f8bab2c07449c9738c4140450f5ff (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:14.553977 31656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3f8bab2c07449c9738c4140450f5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.554519 31738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3f8bab2c07449c9738c4140450f5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.555382 31806 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3f8bab2c07449c9738c4140450f5ff (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:14.557053 31806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3f8bab2c07449c9738c4140450f5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.560572 31731 tablet_service.cc:1511] Processing CreateTablet for tablet d5a51abc95984430bb9df37c5f2db4f4 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:14.562229 31731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a51abc95984430bb9df37c5f2db4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.563735 31663 tablet_service.cc:1511] Processing CreateTablet for tablet d5a51abc95984430bb9df37c5f2db4f4 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:14.565353 31663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a51abc95984430bb9df37c5f2db4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.569816 31655 tablet_service.cc:1511] Processing CreateTablet for tablet 718e675c107b46118802c8c22df47215 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:14.571470 31655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718e675c107b46118802c8c22df47215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.575476 31805 tablet_service.cc:1511] Processing CreateTablet for tablet 718e675c107b46118802c8c22df47215 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:14.577073 31805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718e675c107b46118802c8c22df47215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.561129 31812 tablet_service.cc:1511] Processing CreateTablet for tablet d5a51abc95984430bb9df37c5f2db4f4 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:14.581724 31812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a51abc95984430bb9df37c5f2db4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.582203 31732 tablet_service.cc:1511] Processing CreateTablet for tablet 718e675c107b46118802c8c22df47215 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:14.583956 31732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718e675c107b46118802c8c22df47215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.583688 31737 tablet_service.cc:1511] Processing CreateTablet for tablet 193128ed48b64520811ed4ec111bd61f (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:14.586192 31733 tablet_service.cc:1511] Processing CreateTablet for tablet e21ad04fdee44d719203135135323820 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:14.586913 31736 tablet_service.cc:1511] Processing CreateTablet for tablet 5b60620f72924f63b6386eb5fa0169eb (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:14.588383 31657 tablet_service.cc:1511] Processing CreateTablet for tablet e21ad04fdee44d719203135135323820 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:14.589918 31657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21ad04fdee44d719203135135323820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.593829 31662 tablet_service.cc:1511] Processing CreateTablet for tablet 5b60620f72924f63b6386eb5fa0169eb (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:14.595449 31662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b60620f72924f63b6386eb5fa0169eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.586382 31807 tablet_service.cc:1511] Processing CreateTablet for tablet 193128ed48b64520811ed4ec111bd61f (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:14.597868 31658 tablet_service.cc:1511] Processing CreateTablet for tablet 193128ed48b64520811ed4ec111bd61f (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:14.598908 31807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193128ed48b64520811ed4ec111bd61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.599509 31658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193128ed48b64520811ed4ec111bd61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.597600 31661 tablet_service.cc:1511] Processing CreateTablet for tablet 6defaac93f924c8eb4e37d05fe7b3b5f (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:14.600677 31661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6defaac93f924c8eb4e37d05fe7b3b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.588456 31736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b60620f72924f63b6386eb5fa0169eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.605211 31808 tablet_service.cc:1511] Processing CreateTablet for tablet 5b60620f72924f63b6386eb5fa0169eb (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:14.606834 31808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b60620f72924f63b6386eb5fa0169eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.606478 31809 tablet_service.cc:1511] Processing CreateTablet for tablet e21ad04fdee44d719203135135323820 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:14.607971 31809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21ad04fdee44d719203135135323820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.612340 31737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193128ed48b64520811ed4ec111bd61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.615442 31733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21ad04fdee44d719203135135323820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.638305 31734 tablet_service.cc:1511] Processing CreateTablet for tablet 6defaac93f924c8eb4e37d05fe7b3b5f (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:14.639891 31734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6defaac93f924c8eb4e37d05fe7b3b5f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:14.676045 31636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:37305, user_credentials={real_user=slave}} blocked reactor thread for 45398.1us
I20260709 13:10:14.681162 31969 tablet_bootstrap.cc:492] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:14.688549 31811 tablet_service.cc:1511] Processing CreateTablet for tablet 6defaac93f924c8eb4e37d05fe7b3b5f (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:14.689761 31656 tablet_service.cc:1511] Processing CreateTablet for tablet 83c7099b6bb04b3299bcc8ae30f05e00 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:14.691212 31656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c7099b6bb04b3299bcc8ae30f05e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.691520 31733 tablet_service.cc:1511] Processing CreateTablet for tablet 83c7099b6bb04b3299bcc8ae30f05e00 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:14.693120 31733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c7099b6bb04b3299bcc8ae30f05e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.690225 31811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6defaac93f924c8eb4e37d05fe7b3b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.707060 31658 tablet_service.cc:1511] Processing CreateTablet for tablet eabc6e419b2f476f9628c27fe54731db (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:14.708550 31658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabc6e419b2f476f9628c27fe54731db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.710942 31804 tablet_service.cc:1511] Processing CreateTablet for tablet eabc6e419b2f476f9628c27fe54731db (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:14.712416 31804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabc6e419b2f476f9628c27fe54731db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.714236 31731 tablet_service.cc:1511] Processing CreateTablet for tablet eabc6e419b2f476f9628c27fe54731db (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:14.716686 31731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabc6e419b2f476f9628c27fe54731db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.707101 31812 tablet_service.cc:1511] Processing CreateTablet for tablet 83c7099b6bb04b3299bcc8ae30f05e00 (DEFAULT_TABLE table=soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:14.718896 31812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c7099b6bb04b3299bcc8ae30f05e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.744028 31970 tablet_bootstrap.cc:492] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
W20260709 13:10:14.750403 31619 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:14.752981 31971 tablet_bootstrap.cc:492] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:14.758829 31970 tablet_bootstrap.cc:654] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.766049 31971 tablet_bootstrap.cc:654] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.772959 31969 tablet_bootstrap.cc:654] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.779141 31970 tablet_bootstrap.cc:492] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:14.779774 31970 ts_tablet_manager.cc:1403] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.005s
I20260709 13:10:14.783371 31970 raft_consensus.cc:359] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.784433 31970 raft_consensus.cc:385] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.784775 31970 raft_consensus.cc:740] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.785621 31969 tablet_bootstrap.cc:492] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:14.786159 31969 ts_tablet_manager.cc:1403] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.012s
I20260709 13:10:14.785552 31970 consensus_queue.cc:260] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.786921 31971 tablet_bootstrap.cc:492] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:14.787654 31971 ts_tablet_manager.cc:1403] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.017s
I20260709 13:10:14.788517 31970 ts_tablet_manager.cc:1434] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:10:14.789708 31970 tablet_bootstrap.cc:492] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:14.789371 31969 raft_consensus.cc:359] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.790199 31969 raft_consensus.cc:385] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.790488 31969 raft_consensus.cc:740] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.790885 31971 raft_consensus.cc:359] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.791729 31971 raft_consensus.cc:385] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.791410 31969 consensus_queue.cc:260] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.792033 31971 raft_consensus.cc:740] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.794189 31969 ts_tablet_manager.cc:1434] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:14.795248 31969 tablet_bootstrap.cc:492] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:14.797415 31970 tablet_bootstrap.cc:654] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.802245 31969 tablet_bootstrap.cc:654] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.804204 31971 consensus_queue.cc:260] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.807156 31971 ts_tablet_manager.cc:1434] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 13:10:14.808362 31971 tablet_bootstrap.cc:492] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:14.815284 31952 raft_consensus.cc:493] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.816079 31971 tablet_bootstrap.cc:654] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.815965 31952 raft_consensus.cc:515] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.819959 31952 leader_election.cc:290] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:14.820523 31970 tablet_bootstrap.cc:492] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:14.821185 31970 ts_tablet_manager.cc:1403] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.008s
I20260709 13:10:14.821557 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ad04fdee44d719203135135323820" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:14.822013 31671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ad04fdee44d719203135135323820" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:14.822791 31671 raft_consensus.cc:2468] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:14.824400 31786 leader_election.cc:304] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:14.824749 31970 raft_consensus.cc:359] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.825462 31952 raft_consensus.cc:2804] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:14.825613 31970 raft_consensus.cc:385] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.826012 31952 raft_consensus.cc:493] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.826076 31970 raft_consensus.cc:740] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.826606 31952 raft_consensus.cc:3060] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.827021 31970 consensus_queue.cc:260] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
W20260709 13:10:14.828990 31787 leader_election.cc:343] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.831939 31969 tablet_bootstrap.cc:492] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:14.832567 31969 ts_tablet_manager.cc:1403] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.004s
I20260709 13:10:14.835774 31969 raft_consensus.cc:359] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.836565 31969 raft_consensus.cc:385] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.836899 31969 raft_consensus.cc:740] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.837633 31969 consensus_queue.cc:260] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.839697 31948 raft_consensus.cc:493] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.840292 31948 raft_consensus.cc:515] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.842660 31948 leader_election.cc:290] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:14.845543 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a51abc95984430bb9df37c5f2db4f4" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
W20260709 13:10:14.848968 31638 leader_election.cc:343] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.849812 31952 raft_consensus.cc:515] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.850634 31969 ts_tablet_manager.cc:1434] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:14.851876 31969 tablet_bootstrap.cc:492] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:14.853644 31970 ts_tablet_manager.cc:1434] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:10:14.854800 31970 tablet_bootstrap.cc:492] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:14.855990 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a51abc95984430bb9df37c5f2db4f4" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
W20260709 13:10:14.858273 31636 leader_election.cc:343] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.858793 31636 leader_election.cc:304] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cafcc485f084cd79accfcaab629c721; no voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d
I20260709 13:10:14.860214 31968 raft_consensus.cc:2749] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:14.864964 31969 tablet_bootstrap.cc:654] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.868728 31970 tablet_bootstrap.cc:654] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.870064 31671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ad04fdee44d719203135135323820" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:14.870857 31671 raft_consensus.cc:3060] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.873448 31952 leader_election.cc:290] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:14.874730 31886 raft_consensus.cc:493] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.875259 31886 raft_consensus.cc:515] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.875273 31971 tablet_bootstrap.cc:492] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:14.876513 31971 ts_tablet_manager.cc:1403] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.035s
I20260709 13:10:14.878589 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:14.879506 31671 raft_consensus.cc:2468] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:14.879701 31971 raft_consensus.cc:359] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
W20260709 13:10:14.880385 31712 leader_election.cc:343] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.880548 31971 raft_consensus.cc:385] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.880973 31971 raft_consensus.cc:740] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.880999 31786 leader_election.cc:304] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:14.881381 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ad04fdee44d719203135135323820" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:14.882085 31978 raft_consensus.cc:2804] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:14.881901 31971 consensus_queue.cc:260] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.882711 31978 raft_consensus.cc:697] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
W20260709 13:10:14.882879 31787 leader_election.cc:343] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.883311 31886 leader_election.cc:290] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:14.884008 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
W20260709 13:10:14.885708 31711 leader_election.cc:343] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.885571 31978 consensus_queue.cc:237] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.886225 31711 leader_election.cc:304] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b; no voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:14.887358 31969 tablet_bootstrap.cc:492] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:14.887423 31886 raft_consensus.cc:2749] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:14.888433 31969 ts_tablet_manager.cc:1403] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.009s
I20260709 13:10:14.887866 31970 tablet_bootstrap.cc:492] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:14.890444 31971 ts_tablet_manager.cc:1434] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 13:10:14.891026 31970 ts_tablet_manager.cc:1403] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.008s
I20260709 13:10:14.891695 31971 tablet_bootstrap.cc:492] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:14.891995 31969 raft_consensus.cc:359] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.892841 31969 raft_consensus.cc:385] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.893158 31969 raft_consensus.cc:740] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.893986 31969 consensus_queue.cc:260] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.894825 31970 raft_consensus.cc:359] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.895588 31970 raft_consensus.cc:385] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.895869 31970 raft_consensus.cc:740] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.896703 31969 ts_tablet_manager.cc:1434] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:14.897943 31969 tablet_bootstrap.cc:492] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
W20260709 13:10:14.898054 31848 tablet.cc:2406] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:14.899513 31971 tablet_bootstrap.cc:654] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.902778 31569 catalog_manager.cc:5697] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 0 to 1, leader changed from <none> to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 1 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.905674 31969 tablet_bootstrap.cc:654] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.909179 31970 consensus_queue.cc:260] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.912331 31970 ts_tablet_manager.cc:1434] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:10:14.913601 31970 tablet_bootstrap.cc:492] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:14.925443 31970 tablet_bootstrap.cc:654] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.937800 31970 tablet_bootstrap.cc:492] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:14.938380 31970 ts_tablet_manager.cc:1403] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 13:10:14.941409 31970 raft_consensus.cc:359] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.942277 31970 raft_consensus.cc:385] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.942611 31970 raft_consensus.cc:740] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.943645 31971 tablet_bootstrap.cc:492] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:14.943498 31970 consensus_queue.cc:260] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.944263 31971 ts_tablet_manager.cc:1403] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.023s
I20260709 13:10:14.944700 31969 tablet_bootstrap.cc:492] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:14.945340 31969 ts_tablet_manager.cc:1403] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.015s
I20260709 13:10:14.946688 31970 ts_tablet_manager.cc:1434] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:14.947886 31970 tablet_bootstrap.cc:492] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:14.947607 31971 raft_consensus.cc:359] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.948490 31971 raft_consensus.cc:385] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.948837 31971 raft_consensus.cc:740] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.949219 31969 raft_consensus.cc:359] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.949645 31971 consensus_queue.cc:260] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.950309 31969 raft_consensus.cc:385] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.950831 31969 raft_consensus.cc:740] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.952325 31971 ts_tablet_manager.cc:1434] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:10:14.951921 31969 consensus_queue.cc:260] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:14.953513 31971 tablet_bootstrap.cc:492] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:14.955188 31969 ts_tablet_manager.cc:1434] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:10:14.960438 31970 tablet_bootstrap.cc:654] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.961297 31971 tablet_bootstrap.cc:654] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.962898 31969 tablet_bootstrap.cc:492] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:14.971007 31969 tablet_bootstrap.cc:654] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.992908 31978 raft_consensus.cc:493] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.993659 31978 raft_consensus.cc:515] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.009120 31671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a51abc95984430bb9df37c5f2db4f4" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:15.010367 31671 raft_consensus.cc:2468] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.012560 31786 leader_election.cc:304] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:15.013866 31981 raft_consensus.cc:2804] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.014339 31981 raft_consensus.cc:493] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.014711 31981 raft_consensus.cc:3060] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.015580 31971 tablet_bootstrap.cc:492] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:15.016211 31971 ts_tablet_manager.cc:1403] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.016s
I20260709 13:10:15.019793 31971 raft_consensus.cc:359] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.020591 31971 raft_consensus.cc:385] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.020906 31971 raft_consensus.cc:740] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.021744 31971 consensus_queue.cc:260] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.024302 31971 ts_tablet_manager.cc:1434] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 13:10:15.025115 31978 leader_election.cc:290] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.025415 31971 tablet_bootstrap.cc:492] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:15.027009 31981 raft_consensus.cc:515] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.030102 31671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a51abc95984430bb9df37c5f2db4f4" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:15.030715 31671 raft_consensus.cc:3060] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.030941 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a51abc95984430bb9df37c5f2db4f4" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
W20260709 13:10:15.032625 31787 leader_election.cc:343] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.033285 31971 tablet_bootstrap.cc:654] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.037405 31969 tablet_bootstrap.cc:492] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:15.038283 31969 ts_tablet_manager.cc:1403] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.076s	user 0.027s	sys 0.033s
I20260709 13:10:15.041438 31969 raft_consensus.cc:359] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.042309 31969 raft_consensus.cc:385] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.042672 31969 raft_consensus.cc:740] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.043545 31969 consensus_queue.cc:260] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.046965 31969 ts_tablet_manager.cc:1434] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:15.048148 31969 tablet_bootstrap.cc:492] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:15.049816 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a51abc95984430bb9df37c5f2db4f4" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:15.051003 31746 raft_consensus.cc:3060] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.053848 31671 raft_consensus.cc:2468] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.059713 31746 raft_consensus.cc:2468] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.060796 31978 raft_consensus.cc:493] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.050374 31981 leader_election.cc:290] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.061311 31787 leader_election.cc:304] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:15.062657 31981 raft_consensus.cc:2804] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.063234 31981 raft_consensus.cc:697] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:15.064121 31981 consensus_queue.cc:237] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.061470 31978 raft_consensus.cc:515] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.068168 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f8bab2c07449c9738c4140450f5ff" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:15.069025 31672 raft_consensus.cc:2468] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.069438 31969 tablet_bootstrap.cc:654] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.080459 31969 tablet_bootstrap.cc:492] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:15.082031 31969 ts_tablet_manager.cc:1403] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.006s
I20260709 13:10:15.082994 31786 leader_election.cc:304] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:15.084079 31981 raft_consensus.cc:2804] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.084465 31981 raft_consensus.cc:493] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.084872 31981 raft_consensus.cc:3060] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.087713 31969 raft_consensus.cc:359] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.088714 31969 raft_consensus.cc:385] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.088725 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f8bab2c07449c9738c4140450f5ff" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:15.089171 31969 raft_consensus.cc:740] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.089690 31746 raft_consensus.cc:2468] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.090209 31969 consensus_queue.cc:260] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.092628 31970 tablet_bootstrap.cc:492] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:15.092782 31971 tablet_bootstrap.cc:492] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:15.093035 31969 ts_tablet_manager.cc:1434] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:10:15.093305 31970 ts_tablet_manager.cc:1403] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.146s	user 0.022s	sys 0.027s
I20260709 13:10:15.094429 31969 tablet_bootstrap.cc:492] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:15.093389 31971 ts_tablet_manager.cc:1403] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.036s
I20260709 13:10:15.096145 31570 catalog_manager.cc:5697] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 0 to 1, leader changed from <none> to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 1 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.096896 31970 raft_consensus.cc:359] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.097709 31970 raft_consensus.cc:385] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.099213 31978 leader_election.cc:290] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.099604 31971 raft_consensus.cc:359] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.100347 31971 raft_consensus.cc:385] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.100682 31971 raft_consensus.cc:740] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.101471 31971 consensus_queue.cc:260] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.102886 31969 tablet_bootstrap.cc:654] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.103991 31971 ts_tablet_manager.cc:1434] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:15.096060 31981 raft_consensus.cc:515] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.106546 31981 leader_election.cc:290] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.107632 31971 tablet_bootstrap.cc:492] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:15.110615 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f8bab2c07449c9738c4140450f5ff" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:15.110882 31970 raft_consensus.cc:740] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.111388 31746 raft_consensus.cc:3060] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.112231 31970 consensus_queue.cc:260] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.114009 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f8bab2c07449c9738c4140450f5ff" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:15.114691 31672 raft_consensus.cc:3060] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.115115 31971 tablet_bootstrap.cc:654] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.118338 31970 ts_tablet_manager.cc:1434] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 13:10:15.118497 31986 raft_consensus.cc:493] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.119165 31986 raft_consensus.cc:515] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.119560 31970 tablet_bootstrap.cc:492] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:15.123696 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ad04fdee44d719203135135323820" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:15.127550 31986 leader_election.cc:290] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:15.131095 31671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ad04fdee44d719203135135323820" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:15.131436 31969 tablet_bootstrap.cc:492] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:15.131579 31971 tablet_bootstrap.cc:492] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:15.132073 31671 raft_consensus.cc:2393] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40160dd8a5d24fa0b035643d5b06852b in current term 1: Already voted for candidate 725413eea23c4befac3b8c042489f99d in this term.
I20260709 13:10:15.132071 31969 ts_tablet_manager.cc:1403] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.017s
I20260709 13:10:15.132366 31971 ts_tablet_manager.cc:1403] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.007s
I20260709 13:10:15.134136 31970 tablet_bootstrap.cc:654] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.135818 31969 raft_consensus.cc:359] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.136186 31971 raft_consensus.cc:359] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.136804 31969 raft_consensus.cc:385] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.137285 31971 raft_consensus.cc:385] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.137324 31969 raft_consensus.cc:740] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.137919 31971 raft_consensus.cc:740] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.138440 31969 consensus_queue.cc:260] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.139211 31971 consensus_queue.cc:260] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.141140 31969 ts_tablet_manager.cc:1434] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:15.142422 31969 tablet_bootstrap.cc:492] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:15.142423 31971 ts_tablet_manager.cc:1434] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:15.146483 31971 tablet_bootstrap.cc:492] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:15.147688 31672 raft_consensus.cc:2468] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.150122 31969 tablet_bootstrap.cc:654] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.150234 31786 leader_election.cc:304] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:15.151297 31981 raft_consensus.cc:2804] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.151485 31970 tablet_bootstrap.cc:492] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:15.151947 31981 raft_consensus.cc:697] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:15.135941 31712 leader_election.cc:304] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b; no voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:15.152949 31981 consensus_queue.cc:237] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.153258 31986 raft_consensus.cc:3060] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.148728 31746 raft_consensus.cc:2468] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.152060 31970 ts_tablet_manager.cc:1403] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.010s
I20260709 13:10:15.164603 31969 tablet_bootstrap.cc:492] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:15.165212 31969 ts_tablet_manager.cc:1403] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:10:15.165375 31970 raft_consensus.cc:359] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.166199 31970 raft_consensus.cc:385] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.166489 31970 raft_consensus.cc:740] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.167663 31886 raft_consensus.cc:493] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.168206 31886 raft_consensus.cc:515] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.168192 31969 raft_consensus.cc:359] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.168181 31986 raft_consensus.cc:2749] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:15.169361 31969 raft_consensus.cc:385] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.169137 31971 tablet_bootstrap.cc:654] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.169690 31969 raft_consensus.cc:740] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.167264 31970 consensus_queue.cc:260] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.170524 31969 consensus_queue.cc:260] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.172878 31969 ts_tablet_manager.cc:1434] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:15.172956 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c7099b6bb04b3299bcc8ae30f05e00" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:15.173725 31822 raft_consensus.cc:2468] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:15.173815 31969 tablet_bootstrap.cc:492] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b: Bootstrap starting.
I20260709 13:10:15.175004 31970 ts_tablet_manager.cc:1434] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:10:15.176165 31970 tablet_bootstrap.cc:492] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:15.177706 31711 leader_election.cc:304] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:15.178640 31986 raft_consensus.cc:2804] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.179069 31986 raft_consensus.cc:493] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.179426 31986 raft_consensus.cc:3060] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.180174 31969 tablet_bootstrap.cc:654] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.195380 31971 tablet_bootstrap.cc:492] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:15.196221 31971 ts_tablet_manager.cc:1403] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.050s	user 0.003s	sys 0.011s
I20260709 13:10:15.198218 31969 tablet_bootstrap.cc:492] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b: No bootstrap required, opened a new log
I20260709 13:10:15.198799 31969 ts_tablet_manager.cc:1403] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.007s
I20260709 13:10:15.201373 31971 raft_consensus.cc:359] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.202203 31971 raft_consensus.cc:385] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.202450 31971 raft_consensus.cc:740] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.173020 31886 leader_election.cc:290] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:15.205021 31971 consensus_queue.cc:260] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.206459 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c7099b6bb04b3299bcc8ae30f05e00" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:15.207181 31672 raft_consensus.cc:2468] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 0.
I20260709 13:10:15.202670 31970 tablet_bootstrap.cc:654] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.203640 31969 raft_consensus.cc:359] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.208746 31969 raft_consensus.cc:385] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.205384 31567 catalog_manager.cc:5697] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 0 to 1, leader changed from <none> to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 1 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.209074 31969 raft_consensus.cc:740] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.192791 31986 raft_consensus.cc:515] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.214432 31986 leader_election.cc:290] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:15.209822 31969 consensus_queue.cc:260] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.217068 31969 ts_tablet_manager.cc:1434] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:10:15.218065 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c7099b6bb04b3299bcc8ae30f05e00" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:15.218657 31971 ts_tablet_manager.cc:1434] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:10:15.220201 31971 tablet_bootstrap.cc:492] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:15.225287 31970 tablet_bootstrap.cc:492] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:15.225715 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c7099b6bb04b3299bcc8ae30f05e00" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:15.226176 31970 ts_tablet_manager.cc:1403] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.009s
I20260709 13:10:15.226521 31672 raft_consensus.cc:3060] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.227973 31971 tablet_bootstrap.cc:654] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.230530 31970 raft_consensus.cc:359] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.231704 31970 raft_consensus.cc:385] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.232115 31970 raft_consensus.cc:740] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.233568 31822 raft_consensus.cc:3060] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.234095 31970 consensus_queue.cc:260] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.236550 31971 tablet_bootstrap.cc:492] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:15.237182 31970 ts_tablet_manager.cc:1434] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:10:15.237368 31971 ts_tablet_manager.cc:1403] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.002s
I20260709 13:10:15.238636 31970 tablet_bootstrap.cc:492] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:15.240933 31971 raft_consensus.cc:359] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.241835 31971 raft_consensus.cc:385] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.242192 31971 raft_consensus.cc:740] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.243096 31971 consensus_queue.cc:260] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.245563 31971 ts_tablet_manager.cc:1434] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:10:15.246763 31971 tablet_bootstrap.cc:492] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d: Bootstrap starting.
I20260709 13:10:15.247162 31970 tablet_bootstrap.cc:654] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.255297 31971 tablet_bootstrap.cc:654] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.262986 31822 raft_consensus.cc:2468] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:15.270231 31672 raft_consensus.cc:2468] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 1.
I20260709 13:10:15.270334 31711 leader_election.cc:304] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:15.271548 31986 raft_consensus.cc:2804] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.272110 31986 raft_consensus.cc:697] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:15.273743 31986 consensus_queue.cc:237] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.275925 31970 tablet_bootstrap.cc:492] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:15.276201 31971 tablet_bootstrap.cc:492] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d: No bootstrap required, opened a new log
I20260709 13:10:15.276556 31970 ts_tablet_manager.cc:1403] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.038s	user 0.026s	sys 0.010s
I20260709 13:10:15.277637 31971 ts_tablet_manager.cc:1403] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.012s
I20260709 13:10:15.279827 31970 raft_consensus.cc:359] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.280694 31970 raft_consensus.cc:385] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.280993 31970 raft_consensus.cc:740] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.281781 31971 raft_consensus.cc:359] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.281942 31970 consensus_queue.cc:260] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.282789 31971 raft_consensus.cc:385] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.283250 31971 raft_consensus.cc:740] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.284005 31971 consensus_queue.cc:260] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.284976 31970 ts_tablet_manager.cc:1434] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:15.286413 31971 ts_tablet_manager.cc:1434] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:15.287283 31569 catalog_manager.cc:5697] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 1 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.292245 31970 tablet_bootstrap.cc:492] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721: Bootstrap starting.
I20260709 13:10:15.295464 31981 raft_consensus.cc:493] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.296097 31981 raft_consensus.cc:515] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.298753 31981 leader_election.cc:290] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.299505 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718e675c107b46118802c8c22df47215" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:15.299942 31970 tablet_bootstrap.cc:654] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.300243 31746 raft_consensus.cc:2468] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.299948 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718e675c107b46118802c8c22df47215" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:15.301988 31787 leader_election.cc:304] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
W20260709 13:10:15.302634 31786 leader_election.cc:343] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.303119 31981 raft_consensus.cc:2804] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.303738 31981 raft_consensus.cc:493] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.304107 31981 raft_consensus.cc:3060] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.312561 31970 tablet_bootstrap.cc:492] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721: No bootstrap required, opened a new log
I20260709 13:10:15.312263 31981 raft_consensus.cc:515] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.313153 31970 ts_tablet_manager.cc:1403] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.014s
I20260709 13:10:15.315202 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718e675c107b46118802c8c22df47215" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:15.315253 31981 leader_election.cc:290] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.315475 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718e675c107b46118802c8c22df47215" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:15.316288 31746 raft_consensus.cc:3060] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.316166 31970 raft_consensus.cc:359] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
W20260709 13:10:15.316727 31786 leader_election.cc:343] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.316921 31970 raft_consensus.cc:385] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.317291 31970 raft_consensus.cc:740] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.317905 31970 consensus_queue.cc:260] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.319705 31970 ts_tablet_manager.cc:1434] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:15.323155 31746 raft_consensus.cc:2468] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.324369 31787 leader_election.cc:304] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:15.325228 31981 raft_consensus.cc:2804] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.325675 31981 raft_consensus.cc:697] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:15.326368 31981 consensus_queue.cc:237] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.335321 31569 catalog_manager.cc:5697] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 0 to 1, leader changed from <none> to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 1 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.368887 31981 consensus_queue.cc:1048] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.372810 31981 raft_consensus.cc:493] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.373378 31981 raft_consensus.cc:515] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.375610 31981 leader_election.cc:290] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.376663 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabc6e419b2f476f9628c27fe54731db" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:15.376940 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabc6e419b2f476f9628c27fe54731db" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:15.377434 31746 raft_consensus.cc:2468] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.377656 31672 raft_consensus.cc:2468] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.378661 31787 leader_election.cc:304] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:15.379140 31948 raft_consensus.cc:493] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.379513 31978 raft_consensus.cc:2804] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.379963 31978 raft_consensus.cc:493] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.379668 31948 raft_consensus.cc:515] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.380448 31978 raft_consensus.cc:3060] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.382239 31948 leader_election.cc:290] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:15.384773 31952 raft_consensus.cc:493] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.385373 31952 raft_consensus.cc:515] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.388769 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:15.389674 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:15.390473 31747 raft_consensus.cc:2468] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.391305 31978 raft_consensus.cc:515] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.393569 31978 leader_election.cc:290] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.394424 31787 leader_election.cc:304] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:15.388877 32009 consensus_queue.cc:1048] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:10:15.393440 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:15.395906 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabc6e419b2f476f9628c27fe54731db" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:15.396303 31673 raft_consensus.cc:2468] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.396718 31952 leader_election.cc:290] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.397257 31952 raft_consensus.cc:2804] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.397605 31952 raft_consensus.cc:493] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.400784 31952 raft_consensus.cc:3060] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.398140 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:15.397782 31746 raft_consensus.cc:3060] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.400031 31672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabc6e419b2f476f9628c27fe54731db" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:15.403249 31672 raft_consensus.cc:3060] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.409327 31952 raft_consensus.cc:515] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.409770 31746 raft_consensus.cc:2468] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.410879 31822 raft_consensus.cc:2393] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8cafcc485f084cd79accfcaab629c721 in current term 1: Already voted for candidate 725413eea23c4befac3b8c042489f99d in this term.
I20260709 13:10:15.413358 31787 leader_election.cc:304] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:15.414340 31636 leader_election.cc:304] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cafcc485f084cd79accfcaab629c721; no voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d
I20260709 13:10:15.414865 32010 raft_consensus.cc:2804] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.415452 32010 raft_consensus.cc:697] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:15.416126 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:15.416145 31948 raft_consensus.cc:3060] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.416337 32010 consensus_queue.cc:237] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.417073 31952 leader_election.cc:290] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.416862 31747 raft_consensus.cc:3060] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.421838 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:15.426623 31747 raft_consensus.cc:2468] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.428062 31787 leader_election.cc:304] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:15.429134 31952 raft_consensus.cc:2804] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.413378 31672 raft_consensus.cc:2468] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.429818 31952 raft_consensus.cc:697] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:15.430936 31952 consensus_queue.cc:237] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.432278 31948 raft_consensus.cc:2749] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:15.437342 31569 catalog_manager.cc:5697] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 0 to 1, leader changed from <none> to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 1 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.440589 31673 raft_consensus.cc:2468] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.452721 31569 catalog_manager.cc:5697] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 0 to 1, leader changed from <none> to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 1 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.464071 31952 raft_consensus.cc:493] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.464689 31952 raft_consensus.cc:515] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.466441 31952 leader_election.cc:290] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.467135 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60620f72924f63b6386eb5fa0169eb" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:15.467487 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60620f72924f63b6386eb5fa0169eb" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:15.467754 31673 raft_consensus.cc:2468] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.468081 31747 raft_consensus.cc:2468] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.468827 31786 leader_election.cc:304] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:15.469661 31952 raft_consensus.cc:2804] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.469959 31952 raft_consensus.cc:493] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.470208 31952 raft_consensus.cc:3060] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.476030 31952 raft_consensus.cc:515] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.477837 31952 leader_election.cc:290] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.478559 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60620f72924f63b6386eb5fa0169eb" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:15.478909 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60620f72924f63b6386eb5fa0169eb" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:15.479278 31673 raft_consensus.cc:3060] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.479487 31747 raft_consensus.cc:3060] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.487046 31747 raft_consensus.cc:2468] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.487046 31673 raft_consensus.cc:2468] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.488355 31786 leader_election.cc:304] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:15.489228 31952 raft_consensus.cc:2804] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.489724 31952 raft_consensus.cc:697] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:15.490477 31952 consensus_queue.cc:237] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.491576 32010 consensus_queue.cc:1048] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.499366 31569 catalog_manager.cc:5697] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 0 to 1, leader changed from <none> to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 1 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.504740 31978 consensus_queue.cc:1048] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:15.512362 31978 raft_consensus.cc:493] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.512905 31978 raft_consensus.cc:515] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.515837 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defaac93f924c8eb4e37d05fe7b3b5f" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721" is_pre_election: true
I20260709 13:10:15.516551 31673 raft_consensus.cc:2468] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.517793 31786 leader_election.cc:304] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:15.518584 32009 raft_consensus.cc:2804] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.518734 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defaac93f924c8eb4e37d05fe7b3b5f" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:15.519045 32009 raft_consensus.cc:493] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.519234 31978 leader_election.cc:290] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.519394 31747 raft_consensus.cc:2468] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 0.
I20260709 13:10:15.519586 32009 raft_consensus.cc:3060] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.527333 32009 raft_consensus.cc:515] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.530014 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defaac93f924c8eb4e37d05fe7b3b5f" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:15.530241 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defaac93f924c8eb4e37d05fe7b3b5f" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:15.530756 31673 raft_consensus.cc:3060] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.530931 31747 raft_consensus.cc:3060] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.533346 32009 leader_election.cc:290] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:15.537572 31747 raft_consensus.cc:2468] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.537572 31673 raft_consensus.cc:2468] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 1.
I20260709 13:10:15.538821 31787 leader_election.cc:304] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:15.539547 32009 raft_consensus.cc:2804] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.540027 32009 raft_consensus.cc:697] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:15.540781 32009 consensus_queue.cc:237] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.547971 31570 catalog_manager.cc:5697] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 0 to 1, leader changed from <none> to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 1 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.550841 32009 consensus_queue.cc:1048] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.565829 32009 consensus_queue.cc:1048] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.602401 31948 raft_consensus.cc:493] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.602871 31948 raft_consensus.cc:515] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.604681 31948 leader_election.cc:290] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:15.605520 31747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718e675c107b46118802c8c22df47215" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40160dd8a5d24fa0b035643d5b06852b" is_pre_election: true
I20260709 13:10:15.605698 31822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718e675c107b46118802c8c22df47215" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725413eea23c4befac3b8c042489f99d" is_pre_election: true
I20260709 13:10:15.606338 31747 raft_consensus.cc:2393] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8cafcc485f084cd79accfcaab629c721 in current term 1: Already voted for candidate 725413eea23c4befac3b8c042489f99d in this term.
I20260709 13:10:15.607282 31638 leader_election.cc:304] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cafcc485f084cd79accfcaab629c721; no voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d
I20260709 13:10:15.608057 31948 raft_consensus.cc:3060] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.613484 31948 raft_consensus.cc:2749] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:15.664460 31986 consensus_queue.cc:1048] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.676438 32023 consensus_queue.cc:1048] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:15.745520 31821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d3f8bab2c07449c9738c4140450f5ff"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
mode: GRACEFUL
new_leader_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:54324
I20260709 13:10:15.746088 31821 raft_consensus.cc:606] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Received request to transfer leadership to TS 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:15.751245 31821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5a51abc95984430bb9df37c5f2db4f4"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
mode: GRACEFUL
new_leader_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:54324
I20260709 13:10:15.751899 31821 raft_consensus.cc:606] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Received request to transfer leadership to TS 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:15.757685 31821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "718e675c107b46118802c8c22df47215"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
mode: GRACEFUL
new_leader_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:54324
I20260709 13:10:15.758337 31821 raft_consensus.cc:606] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Received request to transfer leadership to TS 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:15.764212 31821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
mode: GRACEFUL
new_leader_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:54324
I20260709 13:10:15.764900 31821 raft_consensus.cc:606] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Received request to transfer leadership to TS 8cafcc485f084cd79accfcaab629c721
I20260709 13:10:15.771003 31821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e21ad04fdee44d719203135135323820"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
mode: GRACEFUL
new_leader_uuid: "40160dd8a5d24fa0b035643d5b06852b"
 from {username='slave'} at 127.0.0.1:54324
I20260709 13:10:15.771669 31821 raft_consensus.cc:606] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Received request to transfer leadership to TS 40160dd8a5d24fa0b035643d5b06852b
I20260709 13:10:15.778293 31821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b60620f72924f63b6386eb5fa0169eb"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
mode: GRACEFUL
new_leader_uuid: "40160dd8a5d24fa0b035643d5b06852b"
 from {username='slave'} at 127.0.0.1:54324
I20260709 13:10:15.778903 31821 raft_consensus.cc:606] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Received request to transfer leadership to TS 40160dd8a5d24fa0b035643d5b06852b
I20260709 13:10:15.783905 31821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6defaac93f924c8eb4e37d05fe7b3b5f"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
mode: GRACEFUL
new_leader_uuid: "40160dd8a5d24fa0b035643d5b06852b"
 from {username='slave'} at 127.0.0.1:54324
I20260709 13:10:15.784399 31821 raft_consensus.cc:606] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Received request to transfer leadership to TS 40160dd8a5d24fa0b035643d5b06852b
I20260709 13:10:15.795760 31978 raft_consensus.cc:993] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d: : Instructing follower 40160dd8a5d24fa0b035643d5b06852b to start an election
I20260709 13:10:15.796223 32009 raft_consensus.cc:1081] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Signalling peer 40160dd8a5d24fa0b035643d5b06852b to start an election
I20260709 13:10:15.798666 31747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e21ad04fdee44d719203135135323820"
dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
 from {username='slave'} at 127.0.0.1:59910
I20260709 13:10:15.799322 31747 raft_consensus.cc:493] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.799691 31747 raft_consensus.cc:3060] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.800240 31978 consensus_queue.cc:1048] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.806183 31747 raft_consensus.cc:515] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.807668 32009 raft_consensus.cc:993] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d: : Instructing follower 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:15.808219 32009 raft_consensus.cc:1081] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Signalling peer 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:15.809312 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ad04fdee44d719203135135323820" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:15.809958 31673 raft_consensus.cc:3060] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.814803 32010 consensus_queue.cc:1048] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:15.815971 31672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "718e675c107b46118802c8c22df47215"
dest_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:58298
I20260709 13:10:15.816766 31672 raft_consensus.cc:493] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.817166 31672 raft_consensus.cc:3060] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.819041 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ad04fdee44d719203135135323820" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:15.819720 31821 raft_consensus.cc:3055] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:15.820009 31821 raft_consensus.cc:740] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:15.820844 31821 consensus_queue.cc:260] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.822106 31821 raft_consensus.cc:3060] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.829502 32009 consensus_queue.cc:1048] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:15.832192 31821 raft_consensus.cc:2468] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 2.
I20260709 13:10:15.816063 31747 leader_election.cc:290] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 2 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:15.826514 31673 raft_consensus.cc:2468] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 2.
I20260709 13:10:15.833763 31711 leader_election.cc:304] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:15.835023 31886 raft_consensus.cc:2804] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:15.835462 31886 raft_consensus.cc:697] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 2 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:15.836208 31886 consensus_queue.cc:237] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.840059 31672 raft_consensus.cc:515] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.847357 31672 leader_election.cc:290] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Requested vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:15.849165 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718e675c107b46118802c8c22df47215" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:15.849850 31952 consensus_queue.cc:1048] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.850764 31748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718e675c107b46118802c8c22df47215" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:15.851356 31748 raft_consensus.cc:3060] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.851858 31821 raft_consensus.cc:3055] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:15.852216 31821 raft_consensus.cc:740] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:15.853082 31821 consensus_queue.cc:260] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.854441 31821 raft_consensus.cc:3060] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.858022 31569 catalog_manager.cc:5697] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 1 to 2, leader changed from 725413eea23c4befac3b8c042489f99d (127.20.208.3) to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 2 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.859405 31748 raft_consensus.cc:2468] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:15.860785 31638 leader_election.cc:304] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:15.861743 31948 raft_consensus.cc:2804] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:15.862309 31948 raft_consensus.cc:697] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Becoming Leader. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:15.862677 31821 raft_consensus.cc:2468] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:15.863166 31948 consensus_queue.cc:237] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.878628 31952 consensus_queue.cc:1048] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.880646 31569 catalog_manager.cc:5697] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 reported cstate change: term changed from 1 to 2, leader changed from 725413eea23c4befac3b8c042489f99d (127.20.208.3) to 8cafcc485f084cd79accfcaab629c721 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "8cafcc485f084cd79accfcaab629c721" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.895023 32010 consensus_queue.cc:1048] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.903208 31978 raft_consensus.cc:993] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d: : Instructing follower 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:15.903752 32010 raft_consensus.cc:1081] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Signalling peer 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:15.905576 31673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f"
dest_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:58298
I20260709 13:10:15.906210 31673 raft_consensus.cc:493] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.906525 31673 raft_consensus.cc:3060] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.912094 31673 raft_consensus.cc:515] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.913978 31673 leader_election.cc:290] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Requested vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:15.915251 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:15.915489 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193128ed48b64520811ed4ec111bd61f" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:15.916002 31746 raft_consensus.cc:3060] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.916173 31821 raft_consensus.cc:3055] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:15.916704 31821 raft_consensus.cc:740] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:15.917649 31821 consensus_queue.cc:260] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.919209 31821 raft_consensus.cc:3060] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.924348 31746 raft_consensus.cc:2468] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:15.926649 31638 leader_election.cc:304] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:15.927496 31948 raft_consensus.cc:2804] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:15.927960 31948 raft_consensus.cc:697] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Becoming Leader. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:15.928844 31948 consensus_queue.cc:237] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:15.929613 31821 raft_consensus.cc:2468] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:15.937003 31569 catalog_manager.cc:5697] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 reported cstate change: term changed from 1 to 2, leader changed from 725413eea23c4befac3b8c042489f99d (127.20.208.3) to 8cafcc485f084cd79accfcaab629c721 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "8cafcc485f084cd79accfcaab629c721" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.990664 32010 consensus_queue.cc:1048] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.997337 31978 raft_consensus.cc:993] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d: : Instructing follower 40160dd8a5d24fa0b035643d5b06852b to start an election
I20260709 13:10:15.997840 31978 raft_consensus.cc:1081] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Signalling peer 40160dd8a5d24fa0b035643d5b06852b to start an election
I20260709 13:10:16.001597 31746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6defaac93f924c8eb4e37d05fe7b3b5f"
dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
 from {username='slave'} at 127.0.0.1:59910
I20260709 13:10:16.002269 31746 raft_consensus.cc:493] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.002671 31746 raft_consensus.cc:3060] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.004740 31978 consensus_queue.cc:1048] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.009685 31978 consensus_queue.cc:1048] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.010119 31746 raft_consensus.cc:515] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.017130 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defaac93f924c8eb4e37d05fe7b3b5f" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:16.017765 31821 raft_consensus.cc:3055] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.018081 31821 raft_consensus.cc:740] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:16.018904 31821 consensus_queue.cc:260] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.020073 31821 raft_consensus.cc:3060] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.020651 31746 leader_election.cc:290] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 2 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:16.019718 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defaac93f924c8eb4e37d05fe7b3b5f" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:16.021962 31673 raft_consensus.cc:3060] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.028323 31821 raft_consensus.cc:2468] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 2.
I20260709 13:10:16.029666 31711 leader_election.cc:304] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:16.030613 31886 raft_consensus.cc:2804] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.031082 31886 raft_consensus.cc:697] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 2 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:16.031875 31886 consensus_queue.cc:237] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.033716 31673 raft_consensus.cc:2468] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 2.
I20260709 13:10:16.034142 32009 raft_consensus.cc:993] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d: : Instructing follower 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:16.034938 32010 raft_consensus.cc:1081] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Signalling peer 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:16.038576 31671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d3f8bab2c07449c9738c4140450f5ff"
dest_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:58298
I20260709 13:10:16.039160 31671 raft_consensus.cc:493] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.039525 31671 raft_consensus.cc:3060] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.040464 32009 consensus_queue.cc:1048] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.045397 31567 catalog_manager.cc:5697] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 1 to 2, leader changed from 725413eea23c4befac3b8c042489f99d (127.20.208.3) to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 2 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.047976 31671 raft_consensus.cc:515] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.051888 31671 leader_election.cc:290] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Requested vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:16.052065 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f8bab2c07449c9738c4140450f5ff" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:16.054433 31821 raft_consensus.cc:3055] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.054751 31821 raft_consensus.cc:740] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:16.055480 31821 consensus_queue.cc:260] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.056746 31821 raft_consensus.cc:3060] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.057822 31978 raft_consensus.cc:993] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d: : Instructing follower 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:16.058324 31978 raft_consensus.cc:1081] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Signalling peer 8cafcc485f084cd79accfcaab629c721 to start an election
I20260709 13:10:16.052891 31748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3f8bab2c07449c9738c4140450f5ff" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:16.059680 31748 raft_consensus.cc:3060] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.060096 31671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5a51abc95984430bb9df37c5f2db4f4"
dest_uuid: "8cafcc485f084cd79accfcaab629c721"
 from {username='slave'} at 127.0.0.1:58298
I20260709 13:10:16.060753 31671 raft_consensus.cc:493] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.061163 31671 raft_consensus.cc:3060] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.064719 31821 raft_consensus.cc:2468] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:16.067278 32009 raft_consensus.cc:993] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d: : Instructing follower 40160dd8a5d24fa0b035643d5b06852b to start an election
I20260709 13:10:16.067849 32009 raft_consensus.cc:1081] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Signalling peer 40160dd8a5d24fa0b035643d5b06852b to start an election
I20260709 13:10:16.068800 31636 leader_election.cc:304] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:16.069833 31746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b60620f72924f63b6386eb5fa0169eb"
dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
 from {username='slave'} at 127.0.0.1:59910
I20260709 13:10:16.070089 31748 raft_consensus.cc:2468] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:16.070564 31746 raft_consensus.cc:493] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.071247 31746 raft_consensus.cc:3060] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.069777 31948 raft_consensus.cc:2804] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.072561 31948 raft_consensus.cc:697] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Becoming Leader. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:16.073372 31948 consensus_queue.cc:237] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.077790 31746 raft_consensus.cc:515] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.078212 31671 raft_consensus.cc:515] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.079977 31746 leader_election.cc:290] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 2 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:16.080768 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60620f72924f63b6386eb5fa0169eb" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:16.080814 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60620f72924f63b6386eb5fa0169eb" candidate_uuid: "40160dd8a5d24fa0b035643d5b06852b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:16.081835 31673 raft_consensus.cc:3060] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.081871 31748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a51abc95984430bb9df37c5f2db4f4" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:16.082470 31748 raft_consensus.cc:3060] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.083449 31821 raft_consensus.cc:3055] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.083880 31821 raft_consensus.cc:740] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:16.084693 31821 consensus_queue.cc:260] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.086026 31821 raft_consensus.cc:3060] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.089440 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a51abc95984430bb9df37c5f2db4f4" candidate_uuid: "8cafcc485f084cd79accfcaab629c721" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "725413eea23c4befac3b8c042489f99d"
I20260709 13:10:16.089952 31748 raft_consensus.cc:2468] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:16.090252 31820 raft_consensus.cc:3055] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.090605 31820 raft_consensus.cc:740] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:16.091411 31820 consensus_queue.cc:260] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.092355 31820 raft_consensus.cc:3060] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.092223 31569 catalog_manager.cc:5697] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 reported cstate change: term changed from 1 to 2, leader changed from 725413eea23c4befac3b8c042489f99d (127.20.208.3) to 8cafcc485f084cd79accfcaab629c721 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "8cafcc485f084cd79accfcaab629c721" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.093977 31821 raft_consensus.cc:2468] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 2.
I20260709 13:10:16.094079 31638 leader_election.cc:304] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:16.095050 31948 raft_consensus.cc:2804] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.095484 31711 leader_election.cc:304] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40160dd8a5d24fa0b035643d5b06852b, 725413eea23c4befac3b8c042489f99d; no voters: 
I20260709 13:10:16.096391 31886 raft_consensus.cc:2804] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.096859 31886 raft_consensus.cc:697] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 2 LEADER]: Becoming Leader. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:16.097606 31886 consensus_queue.cc:237] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.098150 31948 raft_consensus.cc:697] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Becoming Leader. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:16.100859 31948 consensus_queue.cc:237] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:16.103801 31671 leader_election.cc:290] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [CANDIDATE]: Term 2 election: Requested vote from peers 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751), 725413eea23c4befac3b8c042489f99d (127.20.208.3:37305)
I20260709 13:10:16.104825 31820 raft_consensus.cc:2468] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafcc485f084cd79accfcaab629c721 in term 2.
I20260709 13:10:16.105028 31673 raft_consensus.cc:2468] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40160dd8a5d24fa0b035643d5b06852b in term 2.
I20260709 13:10:16.107268 31567 catalog_manager.cc:5697] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b reported cstate change: term changed from 1 to 2, leader changed from 725413eea23c4befac3b8c042489f99d (127.20.208.3) to 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2). New cstate: current_term: 2 leader_uuid: "40160dd8a5d24fa0b035643d5b06852b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.111836 31569 catalog_manager.cc:5697] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 reported cstate change: term changed from 1 to 2, leader changed from 725413eea23c4befac3b8c042489f99d (127.20.208.3) to 8cafcc485f084cd79accfcaab629c721 (127.20.208.1). New cstate: current_term: 2 leader_uuid: "8cafcc485f084cd79accfcaab629c721" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.289287 31673 raft_consensus.cc:1275] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Refusing update from remote peer 40160dd8a5d24fa0b035643d5b06852b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.290424 32023 consensus_queue.cc:1048] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.298285 31820 raft_consensus.cc:1275] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 40160dd8a5d24fa0b035643d5b06852b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.299779 31986 consensus_queue.cc:1048] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.310226 31748 raft_consensus.cc:1275] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.311479 31948 consensus_queue.cc:1048] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.319653 31820 raft_consensus.cc:1275] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.321426 32035 consensus_queue.cc:1048] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.323757 31821 raft_consensus.cc:1275] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.326063 32035 consensus_queue.cc:1048] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.334995 31748 raft_consensus.cc:1275] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.336266 31968 consensus_queue.cc:1048] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.502861 31820 raft_consensus.cc:1275] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 40160dd8a5d24fa0b035643d5b06852b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.504273 31986 consensus_queue.cc:1048] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.511662 31673 raft_consensus.cc:1275] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Refusing update from remote peer 40160dd8a5d24fa0b035643d5b06852b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.513441 31886 consensus_queue.cc:1048] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.514051 31821 raft_consensus.cc:1275] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.516904 31948 consensus_queue.cc:1048] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.520363 31748 raft_consensus.cc:1275] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.522418 31948 consensus_queue.cc:1048] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.531795 31746 raft_consensus.cc:1275] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.533111 31948 consensus_queue.cc:1048] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.537689 31821 raft_consensus.cc:1275] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 8cafcc485f084cd79accfcaab629c721: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.541332 32035 consensus_queue.cc:1048] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.552772 31821 raft_consensus.cc:1275] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Refusing update from remote peer 40160dd8a5d24fa0b035643d5b06852b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.554631 31886 consensus_queue.cc:1048] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.562584 31673 raft_consensus.cc:1275] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Refusing update from remote peer 40160dd8a5d24fa0b035643d5b06852b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.564273 31986 consensus_queue.cc:1048] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.793531 31567 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55496:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:18.813232 31567 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55496:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:18.860301 21312 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.965601 32075 tablet.cc:1724] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:18.980194 31638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.2:43751, user_credentials={real_user=slave}} blocked reactor thread for 89358.6us
I20260709 13:10:19.045315 32090 tablet.cc:1724] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.052634 32089 tablet.cc:1724] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:19.071287 31636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.208.3:37305, user_credentials={real_user=slave}} blocked reactor thread for 117859us
I20260709 13:10:19.071954 32101 tablet.cc:1724] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.078184 32102 tablet.cc:1724] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.083330 32099 tablet.cc:1724] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.061683 32098 tablet.cc:1724] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.092748 32105 tablet.cc:1724] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.095952 32107 tablet.cc:1724] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.111785 32108 tablet.cc:1724] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.123733 32107 tablet.cc:1724] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.125547 32101 tablet.cc:1724] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.137398 32105 tablet.cc:1724] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.160831 32104 tablet.cc:1724] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.181833 32109 tablet.cc:1724] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.184403 31745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "092fe73e98964dcb88e38942af7f7547"
dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
mode: GRACEFUL
new_leader_uuid: "725413eea23c4befac3b8c042489f99d"
 from {username='slave'} at 127.0.0.1:59940
I20260709 13:10:19.185199 31745 raft_consensus.cc:606] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Received request to transfer leadership to TS 725413eea23c4befac3b8c042489f99d
I20260709 13:10:19.196144 32099 tablet.cc:1724] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.193673 32101 tablet.cc:1724] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.198796 32098 tablet.cc:1724] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.204948 32096 raft_consensus.cc:993] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b: : Instructing follower 725413eea23c4befac3b8c042489f99d to start an election
I20260709 13:10:19.205518 32096 raft_consensus.cc:1081] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Signalling peer 725413eea23c4befac3b8c042489f99d to start an election
I20260709 13:10:19.207937 31819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "092fe73e98964dcb88e38942af7f7547"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
 from {username='slave'} at 127.0.0.1:54298
I20260709 13:10:19.208537 31819 raft_consensus.cc:493] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.213963 31819 raft_consensus.cc:3060] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.215931 32108 tablet.cc:1724] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.168658 32090 tablet.cc:1724] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.237064 32089 tablet.cc:1724] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.244078 32104 tablet.cc:1724] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.251760 32107 tablet.cc:1724] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.244859 32075 tablet.cc:1724] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.235224 32099 tablet.cc:1724] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.258786 31819 raft_consensus.cc:515] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:19.261720 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092fe73e98964dcb88e38942af7f7547" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:19.262276 31673 raft_consensus.cc:3060] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.272891 31569 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6: soft_deleted_table [id=1248521eaced4aa5b1a9116fcb566971] alter complete (version 1)
I20260709 13:10:19.280295 32089 tablet.cc:1724] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.274444 31673 raft_consensus.cc:2468] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 2.
I20260709 13:10:19.297470 31786 leader_election.cc:304] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:19.297122 32104 tablet.cc:1724] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:19.299168 31978 raft_consensus.cc:2804] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:19.299685 31978 raft_consensus.cc:697] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 2 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:19.300626 31978 consensus_queue.cc:237] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:19.308429 31819 leader_election.cc:290] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 2 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:19.309674 31745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092fe73e98964dcb88e38942af7f7547" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:19.310462 31745 raft_consensus.cc:3055] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:19.310783 31745 raft_consensus.cc:740] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40160dd8a5d24fa0b035643d5b06852b, State: Running, Role: LEADER
I20260709 13:10:19.310964 31673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee"
dest_uuid: "8cafcc485f084cd79accfcaab629c721"
mode: GRACEFUL
new_leader_uuid: "725413eea23c4befac3b8c042489f99d"
 from {username='slave'} at 127.0.0.1:58322
I20260709 13:10:19.311594 31673 raft_consensus.cc:606] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Received request to transfer leadership to TS 725413eea23c4befac3b8c042489f99d
I20260709 13:10:19.313041 21312 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:19.313685 21312 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:19.314842 31745 consensus_queue.cc:260] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:19.316223 31745 raft_consensus.cc:3060] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.323100 31745 raft_consensus.cc:2468] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 2.
I20260709 13:10:19.322832 31570 catalog_manager.cc:5697] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 1 to 2, leader changed from 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2) to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 2 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.358645 32073 raft_consensus.cc:993] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721: : Instructing follower 725413eea23c4befac3b8c042489f99d to start an election
I20260709 13:10:19.359081 32073 raft_consensus.cc:1081] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Signalling peer 725413eea23c4befac3b8c042489f99d to start an election
I20260709 13:10:19.360561 31817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee"
dest_uuid: "725413eea23c4befac3b8c042489f99d"
 from {username='slave'} at 127.0.0.1:54314
I20260709 13:10:19.361029 31817 raft_consensus.cc:493] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.361292 31817 raft_consensus.cc:3060] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.366644 31817 raft_consensus.cc:515] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:19.368399 31817 leader_election.cc:290] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 3 election: Requested vote from peers 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965), 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751)
I20260709 13:10:19.369195 31673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8cafcc485f084cd79accfcaab629c721"
I20260709 13:10:19.369416 31745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1d7a1d3fa74b59b53889e43b4c17ee" candidate_uuid: "725413eea23c4befac3b8c042489f99d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40160dd8a5d24fa0b035643d5b06852b"
I20260709 13:10:19.369855 31673 raft_consensus.cc:3055] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:19.370036 31745 raft_consensus.cc:3060] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.370152 31673 raft_consensus.cc:740] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8cafcc485f084cd79accfcaab629c721, State: Running, Role: LEADER
I20260709 13:10:19.370822 31673 consensus_queue.cc:260] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:19.371721 31673 raft_consensus.cc:3060] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.376142 31745 raft_consensus.cc:2468] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 3.
I20260709 13:10:19.376135 31673 raft_consensus.cc:2468] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725413eea23c4befac3b8c042489f99d in term 3.
I20260709 13:10:19.377502 31786 leader_election.cc:304] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725413eea23c4befac3b8c042489f99d, 8cafcc485f084cd79accfcaab629c721; no voters: 
I20260709 13:10:19.378144 31978 raft_consensus.cc:2804] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:19.378589 31978 raft_consensus.cc:697] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 3 LEADER]: Becoming Leader. State: Replica: 725413eea23c4befac3b8c042489f99d, State: Running, Role: LEADER
I20260709 13:10:19.379336 31978 consensus_queue.cc:237] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } }
I20260709 13:10:19.386628 31570 catalog_manager.cc:5697] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d reported cstate change: term changed from 2 to 3, leader changed from 8cafcc485f084cd79accfcaab629c721 (127.20.208.1) to 725413eea23c4befac3b8c042489f99d (127.20.208.3). New cstate: current_term: 3 leader_uuid: "725413eea23c4befac3b8c042489f99d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "725413eea23c4befac3b8c042489f99d" member_type: VOTER last_known_addr { host: "127.20.208.3" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.705863 31673 raft_consensus.cc:1275] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Refusing update from remote peer 725413eea23c4befac3b8c042489f99d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.707132 31978 consensus_queue.cc:1048] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.719215 31745 raft_consensus.cc:1275] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Refusing update from remote peer 725413eea23c4befac3b8c042489f99d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.720944 31978 consensus_queue.cc:1048] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.895476 31745 raft_consensus.cc:1275] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 3 FOLLOWER]: Refusing update from remote peer 725413eea23c4befac3b8c042489f99d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:19.897039 31978 consensus_queue.cc:1048] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40160dd8a5d24fa0b035643d5b06852b" member_type: VOTER last_known_addr { host: "127.20.208.2" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:19.906646 31673 raft_consensus.cc:1275] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 3 FOLLOWER]: Refusing update from remote peer 725413eea23c4befac3b8c042489f99d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:19.911417 31978 consensus_queue.cc:1048] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cafcc485f084cd79accfcaab629c721" member_type: VOTER last_known_addr { host: "127.20.208.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:20.379108 21312 tablet_server.cc:179] TabletServer@127.20.208.1:0 shutting down...
I20260709 13:10:20.403218 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:20.404175 21312 tablet_replica.cc:333] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.405071 21312 raft_consensus.cc:2243] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.406186 21312 raft_consensus.cc:2272] T 718e675c107b46118802c8c22df47215 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.408458 21312 tablet_replica.cc:333] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.409128 21312 raft_consensus.cc:2243] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.409580 21312 raft_consensus.cc:2272] T 6defaac93f924c8eb4e37d05fe7b3b5f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.411528 21312 tablet_replica.cc:333] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.412103 21312 raft_consensus.cc:2243] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.412612 21312 raft_consensus.cc:2272] T 83c7099b6bb04b3299bcc8ae30f05e00 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.414474 21312 tablet_replica.cc:333] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.414976 21312 raft_consensus.cc:2243] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.415380 21312 raft_consensus.cc:2272] T 5b60620f72924f63b6386eb5fa0169eb P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.417471 21312 tablet_replica.cc:333] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.418213 21312 raft_consensus.cc:2243] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.419027 21312 raft_consensus.cc:2272] T 4d3f8bab2c07449c9738c4140450f5ff P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.421101 21312 tablet_replica.cc:333] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.421702 21312 raft_consensus.cc:2243] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.422524 21312 raft_consensus.cc:2272] T 193128ed48b64520811ed4ec111bd61f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.424540 21312 tablet_replica.cc:333] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.425112 21312 raft_consensus.cc:2243] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.425560 21312 raft_consensus.cc:2272] T e21ad04fdee44d719203135135323820 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.427412 21312 tablet_replica.cc:333] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.427937 21312 raft_consensus.cc:2243] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.428447 21312 raft_consensus.cc:2272] T cbfbe8b26a41464a9cb202c8da214541 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.430967 21312 tablet_replica.cc:333] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.431649 21312 raft_consensus.cc:2243] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.432508 21312 raft_consensus.cc:2272] T 12d6957f83594a099f9c3ba7be1b2954 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.434542 21312 tablet_replica.cc:333] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.435101 21312 raft_consensus.cc:2243] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.435544 21312 raft_consensus.cc:2272] T 7451f4fda1dd4f55bdfddb9ab544753e P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.437700 21312 tablet_replica.cc:333] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.438328 21312 raft_consensus.cc:2243] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.438793 21312 raft_consensus.cc:2272] T eabc6e419b2f476f9628c27fe54731db P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.440985 21312 tablet_replica.cc:333] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.441605 21312 raft_consensus.cc:2243] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.442086 21312 raft_consensus.cc:2272] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 8cafcc485f084cd79accfcaab629c721 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.444182 21312 tablet_replica.cc:333] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.444756 21312 raft_consensus.cc:2243] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.445528 21312 raft_consensus.cc:2272] T d5a51abc95984430bb9df37c5f2db4f4 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.447358 21312 tablet_replica.cc:333] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.447924 21312 raft_consensus.cc:2243] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.448395 21312 raft_consensus.cc:2272] T 092fe73e98964dcb88e38942af7f7547 P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.451033 21312 tablet_replica.cc:333] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.451618 21312 raft_consensus.cc:2243] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.452453 21312 raft_consensus.cc:2272] T 866e0a18158041bf9305e80037c1348e P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.454680 21312 tablet_replica.cc:333] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.455222 21312 raft_consensus.cc:2243] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.455662 21312 raft_consensus.cc:2272] T fba1459b707d44b4aa23227d78f85d4f P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.457769 21312 tablet_replica.cc:333] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.458277 21312 raft_consensus.cc:2243] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.458676 21312 raft_consensus.cc:2272] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 8cafcc485f084cd79accfcaab629c721 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.461077 21312 tablet_replica.cc:333] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721: stopping tablet replica
I20260709 13:10:20.461581 21312 raft_consensus.cc:2243] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.462405 21312 raft_consensus.cc:2272] T a97017c1d79a46a8825c86ac5a84510e P 8cafcc485f084cd79accfcaab629c721 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:20.485821 31712 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 13:10:20.489655 31712 consensus_peers.cc:597] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b -> Peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Couldn't send request to peer 8cafcc485f084cd79accfcaab629c721. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.507565 21312 tablet_server.cc:196] TabletServer@127.20.208.1:0 shutdown complete.
W20260709 13:10:20.543026 31786 consensus_peers.cc:597] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d -> Peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Couldn't send request to peer 8cafcc485f084cd79accfcaab629c721. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.548293 21312 tablet_server.cc:179] TabletServer@127.20.208.2:0 shutting down...
I20260709 13:10:20.574548 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:20.575230 21312 tablet_replica.cc:333] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.575831 21312 raft_consensus.cc:2243] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.576663 21312 raft_consensus.cc:2272] T 5b60620f72924f63b6386eb5fa0169eb P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.578958 21312 tablet_replica.cc:333] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.579504 21312 raft_consensus.cc:2243] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.580260 21312 raft_consensus.cc:2272] T 83c7099b6bb04b3299bcc8ae30f05e00 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.582134 21312 tablet_replica.cc:333] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.582679 21312 raft_consensus.cc:2243] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.583381 21312 raft_consensus.cc:2272] T 6defaac93f924c8eb4e37d05fe7b3b5f P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.585191 21312 tablet_replica.cc:333] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.585722 21312 raft_consensus.cc:2243] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.586105 21312 raft_consensus.cc:2272] T d5a51abc95984430bb9df37c5f2db4f4 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.587898 21312 tablet_replica.cc:333] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.588398 21312 raft_consensus.cc:2243] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.588883 21312 raft_consensus.cc:2272] T 718e675c107b46118802c8c22df47215 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.590683 21312 tablet_replica.cc:333] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.591207 21312 raft_consensus.cc:2243] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.591938 21312 raft_consensus.cc:2272] T e21ad04fdee44d719203135135323820 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.593964 21312 tablet_replica.cc:333] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.594578 21312 raft_consensus.cc:2243] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.595060 21312 raft_consensus.cc:2272] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 40160dd8a5d24fa0b035643d5b06852b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.597680 21312 tablet_replica.cc:333] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.598285 21312 raft_consensus.cc:2243] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.598716 21312 raft_consensus.cc:2272] T a97017c1d79a46a8825c86ac5a84510e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.600781 21312 tablet_replica.cc:333] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.601272 21312 raft_consensus.cc:2243] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.602079 21312 raft_consensus.cc:2272] T cbfbe8b26a41464a9cb202c8da214541 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.604085 21312 tablet_replica.cc:333] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.604635 21312 raft_consensus.cc:2243] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.605026 21312 raft_consensus.cc:2272] T 193128ed48b64520811ed4ec111bd61f P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.606803 21312 tablet_replica.cc:333] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.607324 21312 raft_consensus.cc:2243] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.607715 21312 raft_consensus.cc:2272] T 4d3f8bab2c07449c9738c4140450f5ff P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.609571 21312 tablet_replica.cc:333] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.610092 21312 raft_consensus.cc:2243] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.610556 21312 raft_consensus.cc:2272] T eabc6e419b2f476f9628c27fe54731db P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.612665 21312 tablet_replica.cc:333] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.613212 21312 raft_consensus.cc:2243] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.613924 21312 raft_consensus.cc:2272] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 40160dd8a5d24fa0b035643d5b06852b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.616065 21312 tablet_replica.cc:333] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.616632 21312 raft_consensus.cc:2243] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.617395 21312 raft_consensus.cc:2272] T fba1459b707d44b4aa23227d78f85d4f P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.619405 21312 tablet_replica.cc:333] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.619939 21312 raft_consensus.cc:2243] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.620354 21312 raft_consensus.cc:2272] T 12d6957f83594a099f9c3ba7be1b2954 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.622336 21312 tablet_replica.cc:333] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.622856 21312 raft_consensus.cc:2243] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.623268 21312 raft_consensus.cc:2272] T 7451f4fda1dd4f55bdfddb9ab544753e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.625342 21312 tablet_replica.cc:333] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.625877 21312 raft_consensus.cc:2243] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.626289 21312 raft_consensus.cc:2272] T 866e0a18158041bf9305e80037c1348e P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.628306 21312 tablet_replica.cc:333] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b: stopping tablet replica
I20260709 13:10:20.628829 21312 raft_consensus.cc:2243] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.629217 21312 raft_consensus.cc:2272] T 092fe73e98964dcb88e38942af7f7547 P 40160dd8a5d24fa0b035643d5b06852b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:20.645804 31786 consensus_peers.cc:597] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d -> Peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Couldn't send request to peer 8cafcc485f084cd79accfcaab629c721. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:20.646083 31787 consensus_peers.cc:597] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d -> Peer 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751): Couldn't send request to peer 40160dd8a5d24fa0b035643d5b06852b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.669067 21312 tablet_server.cc:196] TabletServer@127.20.208.2:0 shutdown complete.
I20260709 13:10:20.700445 21312 tablet_server.cc:179] TabletServer@127.20.208.3:0 shutting down...
W20260709 13:10:20.711983 31786 consensus_peers.cc:597] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d -> Peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Couldn't send request to peer 8cafcc485f084cd79accfcaab629c721. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.729542 21312 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:20.730384 21312 tablet_replica.cc:333] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.731019 21312 raft_consensus.cc:2243] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.731524 21312 raft_consensus.cc:2272] T 6defaac93f924c8eb4e37d05fe7b3b5f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.733578 21312 tablet_replica.cc:333] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.734148 21312 raft_consensus.cc:2243] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.734589 21312 raft_consensus.cc:2272] T 5b60620f72924f63b6386eb5fa0169eb P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.736589 21312 tablet_replica.cc:333] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.737118 21312 raft_consensus.cc:2243] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.737555 21312 raft_consensus.cc:2272] T 718e675c107b46118802c8c22df47215 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.739333 21312 tablet_replica.cc:333] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.739853 21312 raft_consensus.cc:2243] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.740278 21312 raft_consensus.cc:2272] T 83c7099b6bb04b3299bcc8ae30f05e00 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.742184 21312 tablet_replica.cc:333] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.743000 21312 raft_consensus.cc:2243] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.743549 21312 raft_consensus.cc:2272] T 193128ed48b64520811ed4ec111bd61f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.745645 21312 tablet_replica.cc:333] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.746212 21312 raft_consensus.cc:2243] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.746670 21312 raft_consensus.cc:2272] T 4d3f8bab2c07449c9738c4140450f5ff P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:20.747040 31787 consensus_peers.cc:597] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d -> Peer 40160dd8a5d24fa0b035643d5b06852b (127.20.208.2:43751): Couldn't send request to peer 40160dd8a5d24fa0b035643d5b06852b. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.2:43751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.748889 21312 tablet_replica.cc:333] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.749560 21312 raft_consensus.cc:2243] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.750073 21312 raft_consensus.cc:2272] T e21ad04fdee44d719203135135323820 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.752692 21312 tablet_replica.cc:333] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
W20260709 13:10:20.753293 31786 consensus_peers.cc:597] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d -> Peer 8cafcc485f084cd79accfcaab629c721 (127.20.208.1:43965): Couldn't send request to peer 8cafcc485f084cd79accfcaab629c721. Status: Network error: Client connection negotiation failed: client connection to 127.20.208.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.753460 21312 raft_consensus.cc:2243] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.754431 21312 raft_consensus.cc:2272] T 5b1d7a1d3fa74b59b53889e43b4c17ee P 725413eea23c4befac3b8c042489f99d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.757005 21312 tablet_replica.cc:333] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.757589 21312 raft_consensus.cc:2243] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.758045 21312 raft_consensus.cc:2272] T a97017c1d79a46a8825c86ac5a84510e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.760212 21312 tablet_replica.cc:333] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.760828 21312 raft_consensus.cc:2243] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.761633 21312 raft_consensus.cc:2272] T eabc6e419b2f476f9628c27fe54731db P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.763622 21312 tablet_replica.cc:333] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.764195 21312 raft_consensus.cc:2243] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.764679 21312 raft_consensus.cc:2272] T 4e8e775b928e4fe6bd777c353f4d1eb9 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.766793 21312 tablet_replica.cc:333] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.767338 21312 raft_consensus.cc:2243] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.767787 21312 raft_consensus.cc:2272] T d5a51abc95984430bb9df37c5f2db4f4 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.769747 21312 tablet_replica.cc:333] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.770303 21312 raft_consensus.cc:2243] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.770769 21312 raft_consensus.cc:2272] T 866e0a18158041bf9305e80037c1348e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.772922 21312 tablet_replica.cc:333] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.773488 21312 raft_consensus.cc:2243] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.774261 21312 raft_consensus.cc:2272] T 092fe73e98964dcb88e38942af7f7547 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.776189 21312 tablet_replica.cc:333] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.776744 21312 raft_consensus.cc:2243] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.777175 21312 raft_consensus.cc:2272] T 12d6957f83594a099f9c3ba7be1b2954 P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.779052 21312 tablet_replica.cc:333] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.779522 21312 raft_consensus.cc:2243] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.780310 21312 raft_consensus.cc:2272] T 7451f4fda1dd4f55bdfddb9ab544753e P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.782325 21312 tablet_replica.cc:333] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.782807 21312 raft_consensus.cc:2243] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.783237 21312 raft_consensus.cc:2272] T fba1459b707d44b4aa23227d78f85d4f P 725413eea23c4befac3b8c042489f99d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.785181 21312 tablet_replica.cc:333] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d: stopping tablet replica
I20260709 13:10:20.785652 21312 raft_consensus.cc:2243] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.786038 21312 raft_consensus.cc:2272] T cbfbe8b26a41464a9cb202c8da214541 P 725413eea23c4befac3b8c042489f99d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.824153 21312 tablet_server.cc:196] TabletServer@127.20.208.3:0 shutdown complete.
I20260709 13:10:20.854776 21312 master.cc:562] Master@127.20.208.62:46033 shutting down...
W20260709 13:10:20.877184 31619 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:10:20.878227 21312 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.878754 21312 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.879072 21312 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7cabd3083fff4882b97bf3e541924bc6: stopping tablet replica
I20260709 13:10:20.898913 21312 master.cc:584] Master@127.20.208.62:46033 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11375 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24121 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (294380 ms total)
[  PASSED  ] 8 tests.
I20260709 13:10:20.955827 21312 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:10:20.956034 21312 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:10:20.956225 21312 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 410 messages since previous log ~14 seconds ago
I20260709 13:10:20.956374 21312 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:10:20.956563 21312 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:10:20.956722 21312 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 6 messages since previous log ~172 seconds ago
I20260709 13:10:20.956871 21312 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~142 seconds ago
I20260709 13:10:20.957060 21312 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:10:20.957309 21312 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
